Talent.com
Mercor
Remote Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) - AIMercor • Ceres, California, US
Remote Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) - AI

Remote Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) - AI

Mercor • Ceres, California, US
2 days ago
Salary
$70.00–$100.00 hourly
Job type
  • Full-time
  • Remote
Job description
  • Role Overview Mercor is running a short, structured evaluation pilot to measure how frontier AI models perform on realistic professional work — and how experienced practitioners judge that work. We are hiring 50 experts across two business domains. Each expert completes one task, then evaluates five model attempts at that same task. This is a one-time study, not ongoing production work. What You'll Do - Sign an NDA before receiving any materials. - Solve one realistic, domain-specific task using the source files provided. - Review five model-generated outputs for that task. Rank them 1–5 with no ties, score each 0–100, and write evidence-based rationales that cite specific parts of the output. - Provide structured feedback on the task itself and on the study design. Time Commitment Estimated 8-12 hours. Study Conditions - No rubric and no golden answer are provided. Your professional judgment is the measurement. - Use of LLMs or other AI assistants is prohibited at every stage — solving, ranking, scoring, and writing rationales. Domains we are focused on - Human Resources - Accounting Who We're Looking For - 5+ years of hands-on professional experience in one of the two domains above. - Currently or recently practicing, so you can judge the work the way a working professional would. - Able to write a clear, specific, evidence-grounded rationale for a judgment. - Reliable within a short turnaround window. Eligibility Restriction You are not eligible for this pilot if you have worked on Project Alchemy in any capacity — task author, reviewer, world expert, or anyone who has had access to its source world data. Prior exposure to that material would invalidate the study.
Create a job alert for this search

Remote Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) - AI Trainer ($70-$100 per hour) • Ceres, California, US

Similar jobs

Work From Home Fast & Serious 100% Free - No experience

Clubshop | USEugene, California
Remote
Full-time

Discover The System MyLeadBiz  That’s Helping Newbies Earn Daily.Turn free traffic into  $100+ per day  with this beginner-friendly biz opp strategy.No product or tech skills n... Show more

Dont see what youre looking for?Remote

Nozomi NetworksSalida, CA, United States
Remote
Full-time

Join Nozomi Networks/h2pNow is an amazing time to join Nozomi Networks as we build the future of OT and IoT cybersecurity.We defend some of the worlds largest organizations and critical infrastruct... Show more

 • Promoted

Plant Manager

Scotts Miracle-GroLinden, CA, United States
Full-time

Here at Scotts Miracle-Gro there is no such thing as a typical day.Our culture is constantly energized by new and exciting growth opportunities and at a rapid pace.Below are details on an open job.... Show more

 • Promoted

Remote Product Tester - Flexible Studies

BuzzTestersModesto, CA
Remote
Full-time

Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more

 • Promoted

Remote Web3 Marketing Specialist

CointelegraphSalida, CA, United States
Remote
Full-time

A leading digital media company is seeking a Marketing Specialist to drive Web3 marketing strategies and campaigns.The role involves conducting market research, crafting engaging content, and colla... Show more

 • Promoted

Remote Clinical Data Manager (Manager to AD level)

Hydrogen GroupModesto, CA, United States
Remote
Full-time

In this individual contributor position, you will not manage direct reports but will be responsible for study-level data management oversight, including CRO and vendor management.You will play a ke... Show more

 • Promoted

Work From Home

AmazonLockeford, CA
Remote
Full-time

Job Title: Work From Home Customer Service Representative.As a Work From Home Customer Service Representative at Amazon, you will be the first point of contact for customers seeking assistance.You ... Show more

 • Promoted

Work from home - Market Research Study

Earn HausLinden, California, United States
Remote
Full-time +1

We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more

 • Promoted

Employment Law Associate | 100% Fully Remote | Up to $180k | AMLAW200 | Award-Winning Culture | T...

We Are Legal RevolutionModesto, CA, United States
Remote
Full-time

Job DescriptionEmployment Law Associate 100% Fully Remote Up to $180k AMLAW200 Award-Winning Culture Top 10 for Diversity in the U.Location :Fully Remote - Work from Anywhere in the U.Must be Calif... Show more

 • Promoted

Work From Home

Remote JobsLinden, CA
Remote
Full-time

Remote Jobs are now available in your area.This position is a work from home position.You will not need to come into the office.Benefits: Health Insurance, 401K, Vacation& PTO.Apply now! Work f... Show more

 • Promoted

Full Remote - Personal Injury Plaintiff Associate Attorney

Law FirmsLinden, CA, United States
Remote
Full-time

Job DescriptionJob Title :Personal Injury Plaintiff's Associate AttorneyLocation :Full Remote (California)About Us :Our client is a nationally recognized plaintiff's personal injury law firm dedica... Show more

 • Promoted

flex driver

AmazonLockeford, CA
Full-time +1

Amazon needs you as a flex driver Representative (Work From Home) to help their mission of making customers lives easier.If you are looking for outstanding pay, flexible part-time, full-time and se... Show more

 • Promoted

Consumer Insights Analyst

Earn HausLinden, California, United States
Full-time +1

We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more

 • Promoted

County Meter Reader

Meter ReaderLockeford, CA
Full-time

Responsibilities The primary responsibility of this position is to read meters and record consumption of the water used, cleaning of meter boxes, and removal of vegetation impeding access to meters... Show more

 • Promoted

Freelance Influencer Marketer / Strategist Remote

CrowdPharmSalida, CA, United States
Remote
Full-time

Freelance Influencer Marketer / StrategistJob :Influencer Marketer / StrategistCompany :CrowdPharmLocation :RemoteJob Type :FreelanceJob Description :A new project is coming down the pipeline for C... Show more

 • Promoted

Paid Online Survey Participant - No Experience

Clubshop | USLinden, California
Full-time

Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more