Talent.com

Program evaluation Jobs in Oakland, CA

Create a job alert for this search

Program evaluation • oakland ca

Last updated: 1 day ago

Data Scientist - AI Evaluation

mercorSan Francisco, California, United States
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.Design precise, task-specific grading criteria for data science deliverables.Provide detailed written justifications for evaluations and scores... Show more

Senior Product Operations Manager, Evaluation Quality

harveySan Francisco, CA, United States
$155,400.00–$233,200.00 yearly
Full-time

At Harvey, we're transforming how legal and professional services operate.By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we're reshaping how critical kno... Show more

Program Director

cross country healthcareAlameda, CA, United States
Full-time

Cross Country is looking for top talent to join our team! We are a market-leading, tech-enabled workforce solutions and advisory firm with more than four decades of experience helping organizations... Show more

Program Supervisor

public health foundation enterprises insan francisco, US
Full-time

The Community Safety Ambassador Program is part of San Francisco’s “Breaking the Cycle” initiative, which emphasizes a comprehensive approach to tackling homelessness and behavioral health crises.T... Show more

Program Assistant

junior center art scienceOakland, CA, US
$23.00–$25.00 hourly
Part-time

Create, Explore and Connect .Part-Time (20 hours/week), Non-Exempt.Bellevue Avenue, Oakland, CA 94610.About East Bay Creative Lab ( Formerly the Junior Center of Art and Science) .For over 72 ... Show more

Director, Business Development - Search & Evaluation

formation bioSan Francisco, CA, United States
Full-time

Director, Business Development - Search & Evaluation.Formation Bio is a tech and AI driven pharma company differentiated by radically more efficient drug development.Advancements in AI and drug dis... Show more

Program Manager

aditi consultingSan Francisco, CA, United States
$70.00–$73.00 hourly
Full-time

Summary: Biocompatibility PM is expected to have a good understanding of consumer electronics, analytical testing, demonstrated experience in program management and has worked in a collaborative cr... Show more

Evaluation and Learning Director

cycSan Francisco, CA, United States
$90,000.00–$105,000.00 yearly
Full-time

Evaluation And Learning Director.For more than 54 years, Community Youth Center of San Francisco (CYC) has given San Francisco youth a sense of belonging and the tools and experiences they need to ... Show more

Evaluation and Learning Director

cycsfSan Francisco, CA, US
$90,000.00–$105,000.00 yearly
Full-time
Quick Apply

JOB ANNOUNCEMENT For more than 54 years, Community Youth Center of San Francisco (CYC) has given San Francisco youth a sense of belonging and the tools and experiences they need to succeed in life.... Show more

Program Manager

heart flowSan Francisco, CA, United States
$150,000.00–$185,000.00 yearly
Full-time

Heartflow is a medical technology company advancing the diagnosis and management of coronary artery disease, the #1 cause of death worldwide, using cutting-edge technology.The flagship productan AI... Show more

Program Director

posse foundationSan Francisco, CA, United States
$70,000.00–$75,000.00 yearly
Full-time

Posse Bay Area - San Francisco, CA 94104.The primary responsibilities of the program director are to oversee and manage the Posse program for up to six (6) university partners; manage a staff of up... Show more

Director, Search and Evaluation - Immunology

biogenSan Francisco, CA, United States
$196,000.00–$270,000.00 yearly
Full-time

Director Of Search & Evaluation, Immunology.As the Director of Search & Evaluation, Immunology, you will be a pivotal member of Biogen's Corporate Development team.Reporting to the Search & Evaluat... Show more

Program Supervisor

felton instituteSan Francisco, CA, United States
$85,000.00–$95,000.00 yearly
Full-time

The Program Supervisor is responsible for overseeing the operations of the Program including planning, organizing, coordinating, and directing the daily operations of the Felton Learning Center.Are... Show more

Program Manager

rit solutionsSan Francisco, CA, United States
Full-time

Program Manager/Project Manager, Web I (Website & CMS systems, Drupal).You are an experienced Web Program Manager with a proven track record of managing high-volume web projects, including redesign... Show more

Merchant Mariner Evaluation Specialist (Deck)

tsaOakland, CA, United States
Full-time

Merchant Mariner Evaluation Specialist (Deck).You will serve as a Merchant Mariner Evaluation Specialist (Deck) and be responsible for providing advice and administration on the regulatory provisio... Show more

Agent Evaluation Infrastructure Engineer

max it consulting max corporate groupSan Francisco, California, United States
Full-time
Quick Apply

San Francisco, California | Primarily On-site.Agent Evaluation Infrastructure Engineer.You will work on the engineering and research problems behind realistic agent environments, post-training syst... Show more

Program Manager

treasury departmentOakland, CA, United States
Full-time

Exercise delegated managerial authority to oversee the overall planning, directing and timely execution of a program, several program segments (each of which is managed through separate subordinate... Show more

Program Manager

us government jobsOakland, CA, United States
Full-time

A description of the business units can be found at:.Position(s) are to be filled in following area(s):.TS - Operation Support Business Systems Modernization (BSM).Review the additional information... Show more

Software Developer – AI Research & Evaluation

turingSan Francisco, California, United States
Full-time
Quick Apply

Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems.Turing support... Show more

1P Sales Domain Expert (Data SFT & Evaluation)

resource logisticsSan Francisco, CA, United States
Full-time

Professional Seniority - Approximately 10 years of active, professional experience operating inside an enterprise sales environment.Quota Achievement - Candidates must provide objective proof that ... Show more

People also ask
Data Scientist - AI Evaluation

Data Scientist - AI Evaluation

mercorSan Francisco, California, United States
30+ days ago
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Data Scientist Talent Network
Type: Contract
Compensation: $100–$150/hour
Location: Remote

Role Responsibilities

  • Design precise, task-specific grading criteria for data science deliverables. This includes exploratory data analyses, statistical modeling work, machine learning pipelines, and technical reports.
  • Evaluate AI-generated or human-created work against established criteria to ensure quality and accuracy.
  • Provide detailed written justifications for evaluations and scores to maintain transparency.
  • Apply consistent, evidence-based judgment for reproducible and defensible assessments.
  • Incorporate structured feedback from senior reviewers and iterate on submitted work for continuous improvement.

Qualifications

Must-Have

  • 1+ years of professional data science experience.
  • Experience at a leading technology, research, or quantitative firm.
  • Strong command of Python, SQL, statistical modeling, and machine learning.
  • Exceptional written communication skills for conveying technical findings.
  • Detail-oriented and consistent approach to evaluating complex work.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.