Talent.com
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsHuntsville, Alabama, United States
19 hours ago
Job type
  • Full-time
Job description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors (gold standards) for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats, such as JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

Create a job alert for this search

Ai Analyst • Huntsville, Alabama, United States

Related jobs
  • Promoted
Tax Expert - 2+ Yrs Paid Tax Experience Required

Tax Expert - 2+ Yrs Paid Tax Experience Required

IntuitGURLEY, Alabama, United States
Full-time
Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Experts in one of our new TurboTax locations across the United States on a ...Show moreLast updated: 8 days ago
  • Promoted
  • New!
Tax Associate - Onsite - 2+ Yrs Paid Tax Experience Required

Tax Associate - Onsite - 2+ Yrs Paid Tax Experience Required

IntuitGurley, AL, United States
Full-time
Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Associates in one of our new TurboTax locations across the United States on...Show moreLast updated: 5 hours ago
  • Promoted
  • New!
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocationsHuntsville, Alabama, United States
Full-time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...Show moreLast updated: 19 hours ago
  • Promoted
  • New!
AI Trainer

AI Trainer

VirtualVocationsHuntsville, Alabama, United States
Full-time
A company is looking for an AI Trainer / Senior Prompt Evaluation.Key Responsibilities Conduct thorough reviews of AI model dialogues with users to assess quality and relevance Identify growth a...Show moreLast updated: 15 hours ago
  • Promoted
Radar Model Independent Verification & Validation Analyst

Radar Model Independent Verification & Validation Analyst

Phased n Research, Inc.Huntsville, AL, US
Full-time
Phased n Research is seeking a highly motivated.Radar Model Independent Verification and Validation (IV&V) Analyst.This group performs IV&V on radar and missile simulation products capable ...Show moreLast updated: 30+ days ago
  • Promoted
  • New!
Tax Associate - Local

Tax Associate - Local

IntuitGURLEY, Alabama, United States
Full-time
Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Associates in one of our new TurboTax locations across the United States on...Show moreLast updated: 12 hours ago
  • Promoted
Remote Senior Financial Analyst - AI Trainer

Remote Senior Financial Analyst - AI Trainer

Data AnnotationDecatur, Alabama
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 30+ days ago
  • Promoted
Test and Evaluation (T&E) Engineer / Analyst

Test and Evaluation (T&E) Engineer / Analyst

Intuitive Research and Technology CorporationHuntsville, AL, United States
Full-time
Best Place to Work that provides solutions from design through production to sustainment by delivering targeted results.Our approach couples the latest technology with engineering expertise and ana...Show moreLast updated: 30+ days ago
  • Promoted
Remote Financial Planner - AI Trainer

Remote Financial Planner - AI Trainer

Data AnnotationDecatur, Alabama
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 30+ days ago
  • Promoted
Tax Expert - Local

Tax Expert - Local

IntuitGURLEY, Alabama, United States
Full-time
Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Experts in one of our new TurboTax locations across the United States on a ...Show moreLast updated: 8 days ago
  • Promoted
Remote Finance Director - AI Trainer

Remote Finance Director - AI Trainer

Data AnnotationDecatur, Alabama
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 30+ days ago
  • Promoted
Tax Expert - Onsite - 2+ Yrs Paid Tax Experience Required

Tax Expert - Onsite - 2+ Yrs Paid Tax Experience Required

IntuitGURLEY, Alabama, United States
Full-time
Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Experts in one of our new TurboTax locations across the United States on a ...Show moreLast updated: 5 days ago
  • Promoted
  • New!
Tax Associate - Onsite

Tax Associate - Onsite

IntuitGURLEY, Alabama, United States
Full-time
Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Associates in one of our new TurboTax locations across the United States on...Show moreLast updated: 12 hours ago
Radar Model Independent Verification & Validation Analyst

Radar Model Independent Verification & Validation Analyst

Phased n Research, Inc.Huntsville, AL, USA
Full-time
Quick Apply
Phased n Research is seeking a highly motivated.Radar Model Independent Verification and Validation (IV&V) Analyst.This group performs IV&V on radar and missile simulation products capable ...Show moreLast updated: 30+ days ago
  • Promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data AnnotationDecatur, Alabama
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 30+ days ago
  • Promoted
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data AnnotationDecatur, Alabama
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 30+ days ago
  • Promoted
Remote Finance Advisor - AI Trainer

Remote Finance Advisor - AI Trainer

Data AnnotationDecatur, Alabama
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 30+ days ago
  • Promoted
Travel CT Technologist

Travel CT Technologist

Voyage HealthcareDecatur, AL, US
Full-time
Voyage Healthcare is seeking a travel CT Technologist for a travel job in Decatur, Alabama.Job Description & Requirements. Voyage Healthcare Job ID #JOB-419245.Pay package is based on 8 hour shi...Show moreLast updated: 4 days ago