Talent.com

Program evaluation Jobs in Sunnyvale, CA

Create a job alert for this search

Program evaluation • sunnyvale ca

Last updated: 1 day ago

Medical Evaluation Specialist - Remote

YO AI LabsSan Jose, CA, United States
Remote
Full-time
Quick Apply

Job Title: Medical Evaluation Specialist.Medical Evaluation Specialists.In this role, you will create and validate challenging medical questions and answers designed to test advanced clinical reaso... Show more

Engineering Manager - Autonomy Evaluation

General MotorsSunnyvale, CA, United States
$185,100.00–$284,100.00 yearly
Full-time

General Motors is a global leader in advanced driver assistance.With Super Cruise hands-free technology in more than 500,000 Super Cruiseequipped vehicles on the road and over 700 million hands-fre... Show more

Program Supervisor - Adult Program

Gardner Health ServicesSan Jose, CA, United States
$98,700.00–$110,000.00 yearly
Full-time

Gardner Health Services is currently recruiting to fill a Program Supervisor position.This is a full-time position in the Adult/Older Adult Division of the Behavioral Health Department based out of... Show more

Program Manager

Diversity NexusSan Jose, CA, United States
Full-time

Job Description: 10+ years of experience in Program and Project Management within a technical environment, specifically overseeing large-scale software or product development initiatives.Demonstra... Show more

Human Evaluation & Content Quality Vendor Operations Manager

US Tech SolutionsMountain View, CA, United States
Temporary

Human Evaluation & Content Quality Vendor Operations Manager.Location: Mountain View, CA (Hybrid) Duration: 5 months contract.As a Human Evaluation & Content Quality Vendor Operations Manager, you ... Show more

Program Manager (program management, analyze)

Argyle InfotechSunnyvale, CA, United States
Full-time

Coordinates projects and ensures company resources are utilized appropriately.Compiles project status reports, coordinates project schedules, manages project meetings, and identifies and resolves t... Show more

Program Manager

KaavSunnyvale, CA, United States
Full-time

Principal Technical Program Manager/Engineering Manager.Extremely strong top notch candidates with 10+ years of experience in principal technical program management and as engineering manager.Extre... Show more

Program Leader

Think TogetherMilpitas, CA, United States
Part-time

Program Leaders work with an assigned group of students, student to staff ratio is contingent upon CDC guidelines.This is a part time, in-person position in districts and school site locations thro... Show more

Program Manager

E-SolutionsSan Jose, CA, United States
Full-time

Location: Remote - West Coast Hours Preferred.Experience managing a portfolio of application support.Working with different vendors to bring operational efficiency.Experience driving strategy for t... Show more

Sr Engineering Program Manager, Evaluation - Special Projects

AppleCupertino, CA, United States
$175,500.00–$311,700.00 yearly
Full-time

Sr Engineering Program Manager, Evaluation - Special Projects.Apple's Special Projects team is seeking a Senior Engineering Program Manager (EPM) to lead our AI evaluation framework at the forefron... Show more

Program Manager

Unlimited Technology, Inc.Sunnyvale, CA, United States
Full-time

Come join our team! At Unlimited Technology, we are committed to our company's core values of Passion, Collaboration, Innovation, and Adaptability.With offices throughout the United States, we are ... Show more

Product Manager, Safety Evaluation

WaymoMountain View, CA, United States
$204,000.00 yearly
Full-time

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin... Show more

Program Manager | (Program management) | Hybrid |

SamprasoftSunnyvale, CA, United States
Full-time

Coordinates projects and ensures company resources are utilized appropriately.Compiles project status reports, coordinates project schedules, manages project meetings, and identifies and resolves t... Show more

Senior Director - AI Evaluation Platform

ServiceNowSanta Clara, CA, United States
Full-time

Senior Director - AI Evaluation Platform.It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis.That moment inspired Fred to build a company that... Show more

Program Manager

Apex SystemsCupertino, CA, United States
Full-time

Technical Program Manager Data Platform Initiatives.We are seeking a Technical Program Manager contractor to support strategic Data Platform initiatives.This role will provide program leadership a... Show more

Product Manager, Safety Evaluation

Latent LogicMountain View, CA, United States
$204,000.00 yearly
Full-time

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin... Show more

Program Lead

Catalyst FamilySunnyvale, CA, United States
Full-time

The Program Lead manages all programmatic and staffing aspects of an early care and education center, in accordance with the agency's program and people management goals.This position ensures progr... Show more

Director, Simulation and Evaluation - Autonomous Driving

Bosch GroupSunnyvale, California, United States
$240,000.00 yearly
Full-time

Company Description* *We Are Bosch.At Bosch, we shape the future by inventing high-quality technologies and services that spark enthusiasm and enrich people’s lives.Our areas of activity are ever... Show more

Senior Research Manager, World Model Evaluation

NVIDIASanta Clara, CA, United States
Full-time

At NVIDIA, we're not just building the future, we're generating it! Our world model team is pushing the boundaries of multimodal AI, robotics, and world foundation models for Physical AI.We are loo... Show more

Director, Evaluation - Graduate School of Business

StanfordStanford, CA, United States
$162,809.00–$197,109.00 yearly
Full-time

Residing in Silicon Valley, the heart of innovation, Stanford Graduate School of Business has built a global reputation based on its immersive and innovative management programs.We provide students... Show more

People also ask
Medical Evaluation Specialist - Remote

Medical Evaluation Specialist - Remote

YO AI LabsSan Jose, CA, United States
6 days ago
Job type
  • Full-time
  • Remote
  • Quick Apply
Job description

Job Title: Medical Evaluation Specialist

Role Type: Contractor
Location: Remote

Job Overview

We are seeking Medical Evaluation Specialists, including medical students, residents, physicians, and qualified biomedical professionals, to contribute clinical expertise to a project focused on evaluating and improving next-generation AI systems.

In this role, you will create and validate challenging medical questions and answers designed to test advanced clinical reasoning. Your work will help assess whether AI systems can accurately interpret medical evidence, synthesize complex information, and apply nuanced clinical judgment.

No prior AI experience is required—your medical knowledge, research skills, and clinical reasoning are what matter most.

Scope of Work

  • Create original, high-difficulty medical question-and-answer pairs covering areas such as diagnosis, pathophysiology, pharmacology, clinical guidelines, and clinical decision-making.
  • Develop questions that require synthesis, interpretation, and genuine medical reasoning rather than simple factual recall.
  • Research and verify answers using primary literature, clinical guidelines, systematic reviews, and authoritative medical references.
  • Document the rationale behind answers and provide appropriate supporting citations.
  • Evaluate AI-generated responses for clinical accuracy, completeness, reasoning quality, and adherence to available evidence.
  • Identify questions that are too straightforward and refine them to increase complexity while maintaining clinical validity.
  • Review questions and answers for ambiguity, unsupported assumptions, factual errors, and inconsistencies.
  • Ensure all deliverables are written with clarity, precision, and defensibility.
  • Incorporate reviewer feedback and adapt work to evolving project guidelines and quality standards.
  • Contribute insights that help establish rigorous benchmarks for medical AI evaluation.

Required Skills

  • Medical Training
  • Research & Source Triangulation
  • Attention to Detail
  • Written Precision
  • Analytical Thinking
  • Clinical Reasoning
  • Medical Literature Review
  • Evidence Synthesis
  • Self-Direction & Reliability
  • Medical Question Development

Preferred Qualifications

  • Current or recent medical training or clinical practice as a medical student, resident, or physician, or equivalent expertise in a relevant biomedical discipline.
  • Demonstrated ability to locate, interpret, compare, and synthesize information from primary research and clinical guidelines.
  • Strong written English skills with exceptional attention to detail.
  • Ability to create engaging, well-structured, challenging, and clinically nuanced questions.
  • Strong understanding of evidence-based medicine and clinical reasoning.
  • Ability to work independently, manage deadlines, and consistently deliver high-quality work in a remote environment.
  • Previous experience with medical question writing, peer review, clinical education, medical content evaluation, or research is a plus.
  • Familiarity with AI/ML systems, AI evaluation, or medical AI applications is advantageous but not required.

Compensation Structure

Compensation is output-based, with contributors paid per task that meets the applicable project specifications and quality standards. The time required to complete each task may vary depending on experience and individual workflow.

Minimum submission requirements apply, and selected contributors are expected to complete a minimum number of tasks per week.

Start Timeline & Availability

Roles are typically filled within 48 hours. Selected contributors should be prepared to begin their first assignments within 24–48 hours of completing onboarding.