Talent.com
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocationsLincolnwood, Illinois, United States
5 hours ago
Job type
  • Full-time
Job description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats like JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

Create a job alert for this search

Ai Analyst • Lincolnwood, Illinois, United States

Related jobs
  • Promoted
  • New!
AI Engineer & Researcher, Inference - Chicago, USA (Chicago)

AI Engineer & Researcher, Inference - Chicago, USA (Chicago)

SpeechifyChicago, IL, United States
Full-time
AI Engineer & Researcher, Inference.The mission of Speechify is to make sure that reading is never a barrier to learning. Over 50 million people use Speechify's text-to-speech products to turn whate...Show moreLast updated: 2 hours ago
Become a Luxury Brand Evaluator in Lake Bluff, IL- Apply Now

Become a Luxury Brand Evaluator in Lake Bluff, IL- Apply Now

CXGLake Bluff, IL, US
Full-time
Quick Apply
Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in custo...Show moreLast updated: 30+ days ago
Technology Fellow – AI Systems & Automation (GenAI & Agentic AI)

Technology Fellow – AI Systems & Automation (GenAI & Agentic AI)

Coalfire SystemsChicago, Illinois, United States, 60611
Full-time
We celebrate diversity and are committed to respecting one another, embracing individual differences, and creating an inclusive environment for all employees. Technology Fellow AI Systems & Autom...Show moreLast updated: 30+ days ago
VP, Data, Analytics & AI

VP, Data, Analytics & AI

Potbelly CorporateChicago, IL, US
Full-time
Quick Apply
Do you hunger for more? Potbelly Sandwich Shop is looking for friendly and outgoing people who enjoy working in a fast-paced, friendly environment. We are where good vibes and great careers are a wa...Show moreLast updated: 30+ days ago
AI Engineer

AI Engineer

ManevaChicago, IL, US
Remote
Full-time
Quick Apply
Maneva, a startup founded by an ex-Google Deepmind researcher, is an AI service provider revolutionizing manufacturing operations with cutting-edge AI solutions for autonomous factory operation and...Show moreLast updated: 17 days ago
Research Analyst

Research Analyst

Human Capital EducationChicago, IL, USA
Full-time
Quick Apply
About Human Capital Education : .Human Capital Education (HCE) empowers colleges and universities to grow enrollment, build internal capacity, and improve student success through marketing, CRM optim...Show moreLast updated: 11 days ago
  • Promoted
Associate Partner, Data and AI, Telco

Associate Partner, Data and AI, Telco

IBM ComputingChicago, IL, United States
Full-time
A Business Sales & Delivery Executive for Data Platforms plays a pivotal role in expanding CBDS's market presence and ensuring the successful implementation and adoption of CBDS Data Platform Servi...Show moreLast updated: 30+ days ago
AI Deployment Engineer

AI Deployment Engineer

CrescendoChicago, IL, US
Full-time
Quick Apply
United States Work Arrangement : Remote About Us Crescendo represents peak CX performance in the AI era.We combine world-class outsourcing expertise with innovative technology to set a new st...Show moreLast updated: 30+ days ago
  • Promoted
Competitive Intelligence Analyst (Chicago)

Competitive Intelligence Analyst (Chicago)

CooleyChicago, IL, United States
Full-time
Competitive Intelligence Analyst.Cooley is seeking a Competitive Intelligence Analyst to join the Data Delivery team.Position summary : Cooley Innovation embraces a culture of customer service excel...Show moreLast updated: 4 days ago
  • Promoted
Market Research Analyst

Market Research Analyst

Health Care Service CorporationChicago, IL, US
Full-time
At HCSC, our employees are the cornerstone of our business and the foundation to our success.We empower employees with curated development plans that foster growth and promote rewarding, fulfilling...Show moreLast updated: 9 days ago
  • Promoted
Senior Analyst, Market Research

Senior Analyst, Market Research

AbbVieLake Forest, IL, US
Full-time
Payer Contract Analytics Team Member.AbbVie's mission is to discover and deliver innovative medicines and solutions that solve serious health issues today and address the medical challenges of tomo...Show moreLast updated: 10 days ago
  • Promoted
Competitive Intelligence Analyst

Competitive Intelligence Analyst

CooleyChicago, IL, US
Full-time
Competitive Intelligence Analyst.Cooley is seeking a Competitive Intelligence Analyst to join the Data Delivery team.Position summary : Cooley Innovation embraces a culture of customer service excel...Show moreLast updated: 26 days ago
Full Stack Developer - OpenAI / GPT3 Expert / AI / ML Developer

Full Stack Developer - OpenAI / GPT3 Expert / AI / ML Developer

Rise25Chicago, IL, US
Full-time +1
Quick Apply
Want to help change the world, one relationship at a time?.We help businesses build great relationships using podcasts and content marketing. Rise25 is looking for a full stack developer with experi...Show moreLast updated: 30+ days ago
  • Promoted
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data AnnotationWaukegan, Illinois
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 30+ days ago
  • Promoted
  • New!
Customer AI engineer (Chicago)

Customer AI engineer (Chicago)

Writer CorporationChicago, IL, United States
Full-time
As a Customer AI engineer at WRITER, you'll play a critical role in developing and building complex prompts, applications, and agents to support our most important customers.You'll work closely wit...Show moreLast updated: 2 hours ago
Data Analytics Engineer

Data Analytics Engineer

Spring-Green Enterprises Inc. & SubsidiariesNaperville, IL, US
Full-time
Quick Apply
SGE Marketing- IT Services Inc.Spring-Green Enterprise company) is seeking a talented and self-motivated individual to become an integral part of our IT team. The Data Analytic Engineer is a full-ti...Show moreLast updated: 26 days ago
Freelance Luxury Brand Evaluator in Chicago, IL

Freelance Luxury Brand Evaluator in Chicago, IL

CXGNaperville, IL, US
Full-time
Quick Apply
Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in custo...Show moreLast updated: 13 days ago
Freelance Luxury Brand Evaluator Automotive Project - Illinois

Freelance Luxury Brand Evaluator Automotive Project - Illinois

CXGBarrington, IL, US
Full-time
Quick Apply
Are you a luxury automobile enthusiast who appreciates the finer details of high-end vehicles? If the answer is yes, we are looking for you!. As a Luxury Brand Evaluator, you will step into the worl...Show moreLast updated: 30+ days ago
  • Promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data AnnotationJoliet, Illinois
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 30+ days ago
AI Engineer

AI Engineer

KonnectITChicago, Illinois, US
Full-time
Quick Apply
The ideal candidate will have strong expertise in.This role will focus on building intelligent applications that leverage data to generate insights, automate processes, and enable decision-making.A...Show moreLast updated: 27 days ago