Talent.com

Program evaluation Jobs in Los Angeles, CA

Create a job alert for this search

Program evaluation • los angeles ca

Last updated: 13 hours ago

AI Evaluation Specialist - Remote

YO AI LabsLos Angeles, CA, USA
RemoteRemote
Full-timeFull-time
Quick Apply

Remote — US, Canada, UK, Ireland, Australia, New Zealand.AI assistant outputs for an enterprise AI training project.You'll evaluate AI-generated responses using defined quality standards, identify ... Show more

Associate Dean, Assess & Evaluation

Kaiser PermanentePasadena, CA, United States
Full-timeFull-time

Associate Dean, Assess & Eval- SOM.Primary Location Pasadena, California Employee Status: Regular Worker Location: Flexible Schedule Full-time Scheduled Weekly Hours: 40.Job Summary: The Associate ... Show more

Director of Outcomes and Evaluation

National Health FoundationLos Angeles, CA, United States
Full-timeFull-time

Director Of Outcomes And Evaluation.The Director of Outcomes and Evaluation provides strategic leadership for National Health Foundation's (NHF) organizational research, data collection, program ev... Show more

Program Analyst

US Government JobsLos Angeles, CA, United States
Full-timeFull-time

Office Of Acceptance Facility Oversight.This position is in the Office of Acceptance Facility Oversight, Directorate of Passport Services, Bureau of Consular Affairs.AFO is responsible for managing... Show more

Diagnostic Supervisor (Remote) - Veterans Evaluation Services

MaximusLos Angeles, CA, US
$69,250.00 yearly$69,250.00 yearly
RemoteRemote
Full-timeFull-time

Essential Duties and Responsibilities: - Supervise, instruct, and support the Diagnostics team: Diagnostic Cappers, Diagnostic Facility Recruiters, Diagnostic Schedulers, Diagnostic Uploader... Show more

Real Estate Evaluation Officer

East West BancorpMonterey Park, CA, United States
$75,000.00 yearly$75,000.00 yearly
Full-timeFull-time

Real Estate Evaluation Analyst.East West Bank is seeking a Real Estate Evaluation Analyst for our Appraisal team.Conduct independent administrative compliance (non-licensed task) review of commerci... Show more

Program Specialist

Creative Employment Services Inc.Los Angeles, CA, US
$20.00–$27.50 hourly$20.00–$27.50 hourly
Full-timeFull-time

Program Specialist (I, II, III).OPERATIONS & COMPLIANCE DEPARTMENT.Must be energetic and self-starting individual.Must have professional demeanor and appearance.Our program specialist will assi... Show more

Program Manager

DHD ConsultingLos Angeles, CA, United States
Full-timeFull-time

Commerce, California, United States Or refer someone Job Openings.Lead Mobile App Launch: Oversee the execution and implementation of the new mobile application, working closely with the analyst an... Show more

Program Director

Youth Advocate ProgramsLos Angeles, CA, United States
$85,000.00 yearly$85,000.00 yearly
Full-timeFull-time

Summary of Position: The Program Director is responsible for the overall administration and daily operations of the Los Angeles County Program, serving the kids and families as well as the referrin... Show more

Program Leader – Aftercare Program

St. Paul the Apostle SchoolLos Angeles, CA, US
$20.00 hourly$20.00 hourly
Full-timeFull-time

Saint Paul the Apostle School, a Developmental Kindergarten through 8th grade Catholic Elementary and Middle School located near Westwood in Los Angeles, is accepting applications for Program Leade... Show more

Program Manager

Publicis Groupe Holdings B.VInglewood, CA, United States
$72,390.00–$104,720.00 yearly$72,390.00–$104,720.00 yearly
Full-timeFull-time

A Program Manager at Razorfish is equal parts planner, problem solver, strategic thinker, client relationship builder, and team leader.You'll be leading local teams and clients to deliver digital s... Show more

Script Planning & Evaluation Manager (Short Drama) - TikTok

TikTokLos Angeles, CA, United States
$102,600.00–$198,360.00 yearly$102,600.00–$198,360.00 yearly
Full-timeFull-time

Script Planning & Evaluation Manager (Short Drama) - TikTok.About the Team: The Short Drama Team is a dynamic and forward-thinking team under TikTok, we are dedicated to curating, producing, and lo... Show more

Program Manager, Stroke Program

Adventist HealthLos Angeles, CA, United States
Full-timeFull-time

Stroke And Neuro-interventional Program Manager.Centered in the heart of Boyle Heights, Adventist Health White Memorial is one of the area's leading healthcare providers since 1913.We are comprised... Show more

Program Leader - After School Program

LA Conservation CorpsLos Angeles, CA, United States
Part-timePart-time

Program Leader - After School Program.After School Program River Center - Los Angeles, CA 90065.Hourly Position Type Part Time Education Level High School.The LA Conservation Corps After School Pro... Show more

Program Manager

HarmonicLos Angeles, CA, United States
$80,000.00–$100,000.00 yearly$80,000.00–$100,000.00 yearly
Full-timeFull-time

We are looking for a Program Manager to ensure successful and timely execution of technical programs across multiple teams in multiple geo-locations and throughout the full system development life ... Show more

Program Leader

Arc After School & Experiential EducationLos Angeles, CA, United States
Part-timePart-time

Equitas Academy 5 - Los Angeles, CA 90015.Do you love working with kids? Can you inspire young people to reach their full potential? Do you have a special talent, hobby, or passion you'd love to sh... Show more

 • New!

Program Director

HealogicsGlendale, CA, United States
Full-timeFull-time

Program Director/Program Manager.The rewards at Healogics are immense, starting with the important work we do to change patients' lives.We also understand that meaningful work is hard work, and we ... Show more

Mathematics PhD - AI Evaluation Expert - AI Trainer

MercorLos Angeles, California, United States
$70.00 hourly$70.00 hourly
RemoteRemote
Part-timePart-time
Quick Apply

Headquartered in San Francisco, our investors include.Mathematics PhD Coding Experts.Source original material from published papers,.Write scientific prompts based on sourced input to challenge fro... Show more

Program Manager

ArtechLos Angeles, CA, United States
Full-timeFull-time

Program Manager, Change Governance.Location: Onsite Foster City, CA.Local travel to Hayward, CA and Kato, CA required.Up to 20% out-of-station travel.Zoox is seeking a Program Manager, Change Gove... Show more

Program Manager

Insight GlobalGlendale, CA, United States
Full-timeFull-time

Lead Technical Program Manager.The successful candidate will be a career TPM who has consistently led large, complex programs rather than an individual who recently transitioned into program manage... Show more

People also ask
AI Evaluation Specialist - Remote

AI Evaluation Specialist - Remote

YO AI LabsLos Angeles, CA, USA
4 days ago
Job type
  • Full-time
  • Remote
  • Quick Apply
Job description

AI Evaluation Specialist

Role Type: Contractor
Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand

We are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project.

You'll evaluate AI-generated responses using defined quality standards, identify issues, and provide clear feedback to help improve AI systems. No prior formal AI experience is required.

Scope of Work

  • Evaluate AI-generated outputs against detailed rubrics for accuracy, relevance, quality, and adherence to guidelines.
  • Apply consistent and objective judgment across large volumes of examples.
  • Identify reasoning gaps, tool-use issues, logical errors, and inconsistencies.
  • Provide concise, actionable feedback highlighting strengths and areas for improvement.
  • Participate in discussions around rubric interpretation and evolving quality standards.
  • Contribute to process improvements and evaluation best practices.
  • Maintain accurate documentation of evaluations and recommendations.

Preferred Qualifications

  • Experience in grading, quality assurance, editorial review, assessment, annotation, or similar analytical work.
  • Advanced, daily use of AI assistants such as ChatGPT, Claude, or similar tools.
  • Strong ability to analyze complex information and communicate findings clearly in writing.
  • Experience with process improvement, rubric development, or quality assessment.
  • Strong critical-thinking skills with a focus on consistency, accuracy, and fairness.
  • Comfortable working independently on high-volume evaluation tasks.
  • Strong attention to detail and ability to identify subtle quality issues.
  • Collaborative approach to resolving ambiguous cases and improving evaluation criteria.