Talent.com
Mercor
Remote Applied Psychology Benchmark Specialist - AI Trainer ($50-$63 per hour)Mercor • Fairfield, California, US
Remote Applied Psychology Benchmark Specialist - AI Trainer ($50-$63 per hour)

Remote Applied Psychology Benchmark Specialist - AI Trainer ($50-$63 per hour)

Mercor • Fairfield, California, US
1 day ago
Salary
$50.00–$63.00 hourly
Job type
  • Full-time
  • Remote
Job description
  • Role Overview We are seeking expert psychologists to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core psychology domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be assigned one of two task types : - Question Authoring — Create original, challenging multiple-choice questions in your area of psychology expertise, rate their difficulty, and submit them for review. - Question Verification — Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made. Psychology Domains Covered Neuromorphic Engineering, Human Factors and Engineering Psychology, Consumer and Market Psychology, Psychometrics, Digital Health, Psychedelic-assisted Therapy. Key Responsibilities - Author original psychology questions that test deep conceptual understanding, not surface-level recall - Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement - Rate each question's difficulty : Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above) - Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers - Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format - Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, university repositories) - For verification tasks : flag issues with clarity, completeness, precision, or solvability and justify any edits made Ideal Qualifications - PhD, PsyD, or doctoral candidate in Psychology or a closely related field - Master's degree considered for candidates with exceptional depth in a specific subdomain - Strong command of graduate-level psychological theory, research methodology, and empirical literature - Clinical licensure or research publications in psychology is a strong plus - Excellent written English and ability to express complex ideas clearly and concisely More About the Opportunity - Expected commitment : 10+ hours / week - Asynchronous, fully remote work
Create a job alert for this search

Remote Applied Psychology Benchmark Specialist - AI Trainer ($50-$63 per hour) • Fairfield, California, US

Similar jobs

Remote Consumer Research Participant

GL IncVacaville, California
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Psychological Services Specialist

Choice in AgingPleasant Hill, CA, United States
Full-time

About the JobUnder the direction of the Program Director, the Psychological Services Specialist (PSS) provides consultation services to Bedford Center & Mt.Diablo Center staff for at least 6 ho... Show more

 • Promoted

Mental Health Clinician

Breakaway PsychotherapyVacaville, CA, United States
Full-time

Therapist Opportunities - Associate & Licensed Clinicians Breakaway Psychotherapy Vacaville In-Person Telehealth Breakaway Psychotherapy is a growing group practice serving individuals, couples... Show more

 • Promoted

Remote Work – Product Assessments - $25-$45 per hour (No Experience)

Online Consumer Panels AmericaFairfield, California, US
$25.00–$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Remote Study Participants (Hiring Immediately)

Maxion ResearchVacaville, CA, United States
Remote
Part-time

Join Our Part-Time Research Studies Today!Are you eager to earn extra income from the comfort of your home? We are looking for motivated individuals to participate in paid research studies includin... Show more

 • Promoted

Associate Behavior Specialist/Behavior Technician

MCGREW BEHAVIOR INTERVENTION SERVICES INCVacaville, CA, United States
Full-time +1

McGrew Behavior Services - Join us to Make a Difference! Position Type:Part Time Associate Behavior Specialist/ ABS/ Behavioral Tutor/ ABA Therapist/ Tutor/ Registered Behavior Technician/ RBT Job ... Show more

 • Promoted

Mothers Wanted – Women 21–39 With Prior Pregnancy (Paid $50K–$85K)

Surrogacy4AllMonument Hills, CA, US
Full-time

Help Create Families — Become a Surrogate mother (Earn $50,000–$85,000+) .Perfect for Stay-at-Home Moms · Ages 21–39 · Remote Opportunity.Are you a caring mom who wants to make a meaningful differe... Show more

 • Promoted

Work From Home

Remote JobsWinters, CA
Remote
Full-time

Remote Jobs are now available in your area.This position is a work from home position.You will not need to come into the office.Benefits: Health Insurance, 401K, Vacation& PTO.Apply now! Work f... Show more

 • Promoted

Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands

OCPAMonument Hills, California, us
$25.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Virtual Assistant trainer (remote)

Odixcity ConsultingVacaville, CA, United States
Remote
Full-time

We are an International Hr consulting and procurement firm.With expertise in Recruitment & Selection, Performance management, Training & Development, Compensation and benefits as well as Ou... Show more

 • Promoted

amazon warehouse associate $15+/ Hour (Sign on Bonus)!

AmazonWinters, CA
Full-time +1

Amazon warehouse associates hiring in your area.If you are looking for outstanding pay, flexible part-time, full-time and seasonal schedules, plus benefits for you and your family, the Amazon Logis... Show more

 • Promoted

Caregiver

Home Helpers Home Care of Woodland/DavisWinters, CA, United States
Full-time +1

Home Helpers Home Care of Woodland Davis - We take our commitment to families seriously, and we're proud of our talented team and the work we do.Serving families in their homes is a special calling... Show more

 • Promoted

Flexible remote AI work. Your schedule. Paid weekly, straight to your bank account.

Meridian.aiSuisun, CA, US
Remote
Full-time

Review and label digital content including text, images, and documents.Every task you complete helps improve how technology interprets information and performs in practical settings.Detail-oriented... Show more

 • Promoted

Clinical Psychologist

Military Treatment Facilities under DHATravis Afb, CA, United States
Permanent

SummaryAbout the Position: This position is located at Travis Air Force Base, California.Salary negotiation may be available for those candidates who are new to Federal service.A recruitment or rel... Show more

 • Promoted

Information Technology Professional

US NavyMonument Hills, CA, US
Full-time

Information Technology Professional (IT/CTN/IS).Information Systems Technicians, Cryptologic Technician Networks, and Intelligence Specialists keep the Fleet connected, informed, and secure by oper... Show more

 • Promoted

Psychological Assistant - Trauma Track

Kaiser PermanenteFairfield, CA, United States
Part-time

Description:Job Summary:Under the supervision of a licensed Psychologist or board certified Psychiatrist, provides mental health assessment, diagnosis, treatment and crisis intervention services fo... Show more

 • Promoted

Home Caregiver

Comfort KeepersWinters, CA, United States
Full-time

Become a home caregiver with Comfort Keepers and make a difference in the life and wellbeing of local seniors in Dixon, CA today!.Comfort Keepers Home Care is hiring caregivers and home health aide... Show more

 • Promoted

Remote Research Panel Participant

GL IncVacaville, California
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Work From Home

AmazonWinters, CA
Remote
Full-time

Job Title: Work From Home Customer Service Representative.As a Work From Home Customer Service Representative at Amazon, you will be the first point of contact for customers seeking assistance.You ... Show more

 • Promoted

Virtual Assistant trainer (remote)

SnaphuntVacaville, CA, United States
Remote
Full-time

The OfferLeadership RoleExcellent career development opportunitiesWork within a company with a solid track record of successThe JobResponsibilities :Develop & Deliver Training :Design and deliv... Show more