Talent.com
Mercor
Data Science Expert - Evaluation Specialist - AI TrainerMercor • Philadelphia, Pennsylvania, United States
Data Science Expert - Evaluation Specialist - AI Trainer

Data Science Expert - Evaluation Specialist - AI Trainer

Mercor • Philadelphia, Pennsylvania, United States
4 days ago
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Data Science Expert
Type: Contract
Compensation: $120–$170/hour
Location: Remote

Role Responsibilities

  • Design precise, task-specific grading criteria for real-world data science deliverables, including analyses, models, dashboards, and experiment readouts.
  • Score AI-generated and human work samples against established criteria with detailed, well-reasoned written justifications.
  • Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
  • Incorporate structured feedback from senior reviewers and iterate quickly on your work.
  • Collaborate with AI research teams to improve training data quality and downstream performance.

Qualifications

Must-Have

  • 5+ years of professional data science experience in industry.
  • Background in business operations, product, or growth data science at top-tier technology companies.
  • Deep fluency in experiment design, A/B testing, metric definition, SQL/Python analysis, and communicating findings to executive stakeholders.
  • Exceptionally strong written communication.
  • Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers.

Preferred

  • Prior experience with AI training, evaluation, or human-data projects.

Application Process (Takes 20–30 mins to complete)

  • Submit your resume or relevant technical background to get started.
  • Qualified applicants may be asked to complete a brief technical assessment or submit additional information.

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.



#hiringmercor

Create a job alert for this search

Data Science Expert - Evaluation Specialist - AI Trainer • Philadelphia, Pennsylvania, United States

Similar jobs

Flexible remote AI work. Your schedule. Paid weekly, straight to your bank account.

Meridian.aiGlassboro, NJ, US
Remote
Full-time

Review and label digital content including text, images, and documents.Every task you complete helps improve how technology interprets information and performs in practical settings.Detail-oriented... Show more

 • Promoted

Director Product Portfolio - Life Sciences

LexisNexisHorsham, PA, United States
Full-time

Director, Product Portfolio Life Sciences.LexisNexis is seeking a Director, Product Portfolio Life Sciences to lead portfolio strategy, investment planning, and product execution across our Life ... Show more

 • Promoted

Senior Learning Manager - Learning Excellence Neuroscience, Schizophrenia

Johnson and JohnsonTitusville, NJ, United States
Full-time

At Johnson & Johnson,we believe health is everything.Our strength in healthcare innovation empowers us to build aworld where complex diseases are prevented, treated, and cured,where treatments ... Show more

 • Promoted

AI Sales Specialist

AHEADPhiladelphia, PA, United States
Full-time

AI Enterprise Sales Specialist.AHEAD builds platforms for digital business.By weaving together advances in cloud infrastructure, automation and analytics, and software delivery, we help enterprises... Show more

 • Promoted

Online Market Research Participant

GL IncLindenwold, New Jersey
$15.00 hourly
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Employment Verification Specialist (Entry-Level)

Vertical ScreenWarminster, PA, United States
Full-time

Job TitleVerification ResearcherJob DescriptionAt Vertical Screen, Inc.As a Verification Researcher, you'll conduct phone-based investigations in a non-sales call center environment, using your att... Show more

 • Promoted

FT Data Entry Assistant - Transportation Safety (Work From Home)

ProSidianClementon, NJ, United States
Remote
Full-time

Administrative Assistant / Fully Remote] - Anywhere in U.Competitive pay / Medical, dental and vision / 401k / PTO - As a Data Entry Assistant you'll: Perform accurate and timely data entry tasks, ... Show more

 • Promoted

Regional Sales Specialist

EurofinsHorsham, PA, United States
Full-time

The Sales Specialist is responsible for selling and promoting all existing and new Gold Standard Diagnostics (GSD) and partner products to food processors, food and beverage manufacturers, service ... Show more

 • Promoted

Data Analytics Developer- Remote Eligible (Health Division)

MathematicaPhiladelphia, PA, United States
Remote
Full-time

Pay CompetitiveEmployment type :Full-TimeJob DescriptionReq# :5337Mathematica applies expertise at the intersection of data, methods, policy, and practice to improve well-being around the world.We ... Show more

 • Promoted

Remote - Population Health

KellyHorsham, PA, United States
Remote
Full-time

Population Health JOB TITLE:Scientific Partnership Enablement Operations Leader, Scientific Partnerships & Population Health GENERAL JOB DESCRIPTION The Scientific Partnership Enablement Operat... Show more

 • Promoted

Director Product Portfolio - Life Sciences

ReedtechHorsham, PA, United States
Full-time

Director, Product Portfolio Life Sciences.LexisNexis is seeking a Director, Product Portfolio Life Sciences to lead portfolio strategy, investment planning, and product execution across our Life Sc... Show more

 • Promoted

Director Product Portfolio - Life Sciences

RELXHorsham, PA, United States
Full-time

Director, Product Portfolio Life Sciences.LexisNexis is seeking a Director, Product Portfolio Life Sciences to lead portfolio strategy, investment planning, and product execution across our Life ... Show more

 • Promoted

Python with AI developer- Remote

Advantra Consulting GroupDoylestown, PA, United States
Remote
Full-time

Python with AI DeveloperRemote (EST CST candidates only)Must have an active LinkedIn profileContractRole Overview :We are seeking a Python with AI Developer who brings hands-on expertise in Python ... Show more

 • Promoted

Project Manager, Environmental Engineer, Geologist or Scientist

Haley & AldrichHolicong, PA, United States
Full-time

Project Manager, Environmental Engineer, Geologist Or Scientist.Find your path and enjoy the journey at Haley & Aldrich.With us, you'll tackle clients' most meaningful challenges in the built and n... Show more

 • Promoted

PK PD Analyst using R Remote

TechData Service CompanyFairless Hills, PA, United States
Remote
Full-time

Job DescriptionJob DescriptionPKPD R programmerSummary of the Essential Functions of the JobData preparation and cleaning :Cleaning and transforming raw clinical trial data from various sources to ... Show more

 • Promoted

PathConnexx Externship - Lab Animal or Toxicologic Pathology (North America)

IDEXX LaboratoriesDoylestown, PA, United States
Full-time

PathConnexx Externship Opportunity.Anatomic Pathology PathConnexx opportunity is a chance to gain hands-on experience with the IDEXX BioAnalytics team.It's offered to a resident interested in labor... Show more