AI Agent Evaluation Analyst
VirtualVocationsOceanside, California, United StatesHace 15 horas
Tipo de contrato
- A tiempo completo
Descripción del trabajo
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
Crear una alerta de empleo para esta búsqueda
Ai Analyst • Oceanside, California, United States
Ofertas relacionadas A company is looking for a Search Analyst to support SEO and SEM campaigns.Key Responsibilities Assist with planning, execution, optimization, and reporting of SEM campaigns Support organic sear...Mostrar másÚltima actualización: hace 7 horas A company is looking for an AI Adoption Solution Architect.Key Responsibilities Drive AI adoption and enablement across the enterprise through hands-on learning experiences Design and build prot...Mostrar másÚltima actualización: hace 9 horas 
Tutor Map are offering new tuition and teaching positions in Temecula.We are seeking Biology tutors and teachers in Temecula.
You can register for free, we take zero commission.Tutor Map is the larg...Mostrar másÚltima actualización: hace más de 30 días
Home-based Permanent BCBA - Paid Relocation + Sign-on Bonus.This Jobot Job is hosted by : Lauren Jessup.Are you a fit? Easy Apply now by clicking the "Apply Now" buttonand sending us your ...Mostrar másÚltima actualización: hace más de 30 días A company is looking for a Product Analyst to join their Product Analytics team.Key Responsibilities Participate in product planning, design, execution, and continuous improvement of product feat...Mostrar másÚltima actualización: hace más de 30 días A company is looking for an AI Content Editor to join their SEO team in a remote, full-time capacity.Key Responsibilities Proofread and fact-check AI-assisted content for accuracy, clarity, and c...Mostrar másÚltima actualización: hace 13 horas A company is looking for an AI Prototype Specialist (Vibe Coder).Key Responsibilities Collaborate with strategy and sales teams to understand client needs and challenges Design and build functio...Mostrar másÚltima actualización: hace 9 horas A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...Mostrar másÚltima actualización: hace 15 horas 
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Mostrar másÚltima actualización: hace más de 30 días We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Mostrar másÚltima actualización: hace más de 30 días A company is looking for an AI Trainer / Senior Prompt Evaluation.Key Responsibilities Conduct thorough reviews of AI model dialogues with users to assess quality and relevance Identify growth a...Mostrar másÚltima actualización: hace 11 horas A company is looking for a Generative AI Specialist - Humanities (English and Slovak).Key Responsibilities Evaluate and rate the performance of AI models based on output Annotate and classify co...Mostrar másÚltima actualización: hace más de 30 días A company is looking for an AI Engineer (FinTech Workflow Automation).Key Responsibilities Design, build, and deploy AI models into production Develop and maintain backend Python services for in...Mostrar másÚltima actualización: hace más de 30 días A company is looking for an AI / ML Engineer (REMOTE).Key Responsibilities Develop, train, evaluate, and deploy machine learning models focused on computer vision and predictive analytics Optimize...Mostrar másÚltima actualización: hace más de 30 días We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Mostrar másÚltima actualización: hace más de 30 días A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...Mostrar másÚltima actualización: hace 15 horas We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Mostrar másÚltima actualización: hace más de 30 días We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Mostrar másÚltima actualización: hace más de 30 días We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Mostrar másÚltima actualización: hace más de 30 días A company is looking for a Staff AI & ML Engineer to build and own end-to-end applications across the business.Key Responsibilities Build technical solutions using appropriate frameworks and data...Mostrar másÚltima actualización: hace 3 horas
- Oferta promocionada
- Nueva oferta
Search Analyst
VirtualVocationsOceanside, California, United StatesA tiempo completo
- Oferta promocionada
- Nueva oferta
AI Adoption Solutions Architect
VirtualVocationsOceanside, California, United StatesA tiempo completo
- Oferta promocionada
Biology Tutors Jobs
Tutor MapTemecula, California, USA tiempo completo
- Oferta promocionada
Board Certified Behavior Analyst / BCBA
JobotHemet, CA, USA tiempo completo +1
- Oferta promocionada
Product Analyst
VirtualVocationsOceanside, California, United StatesA tiempo completo
- Oferta promocionada
- Nueva oferta
AI Content Editor
VirtualVocationsMission Viejo, California, United StatesA tiempo completo
- Oferta promocionada
- Nueva oferta
AI Prototype Specialist
VirtualVocationsOceanside, California, United StatesA tiempo completo
- Oferta promocionada
- Nueva oferta
AI Agent Evaluation Analyst
VirtualVocationsMission Viejo, California, United StatesA tiempo completo
- Oferta promocionada
Remote Senior Financial Analyst - AI Trainer
Data AnnotationMurrieta, CaliforniaTeletrabajo
A tiempo completo +1
- Oferta promocionada
Remote Finance Director - AI Trainer
Data AnnotationLake Elsinore, CaliforniaTeletrabajo
A tiempo completo +1
- Oferta promocionada
- Nueva oferta
AI Trainer
VirtualVocationsMission Viejo, California, United StatesA tiempo completo
- Oferta promocionada
Generative AI Specialist
VirtualVocationsIrvine, California, United StatesA tiempo completo
- Oferta promocionada
AI Engineer
VirtualVocationsOceanside, California, United StatesA tiempo completo
- Oferta promocionada
AI / ML Engineer
VirtualVocationsIrvine, California, United StatesA tiempo completo
- Oferta promocionada
Remote Commercial Banking Analyst - AI Trainer
Data AnnotationHemet, CaliforniaTeletrabajo
A tiempo completo +1
- Oferta promocionada
- Nueva oferta
AI Evaluation Analyst
VirtualVocationsOceanside, California, United StatesA tiempo completo
- Oferta promocionada
Remote Finance Advisor - AI Trainer
Data AnnotationHemet, CaliforniaTeletrabajo
A tiempo completo +1
- Oferta promocionada
Remote Financial Planner - AI Trainer
Data AnnotationHemet, CaliforniaTeletrabajo
A tiempo completo +1
- Oferta promocionada
Remote Financial Analyst - AI Trainer
Data AnnotationSan Marcos, CaliforniaTeletrabajo
A tiempo completo +1
- Oferta promocionada
- Nueva oferta
Staff AI & ML Engineer
VirtualVocationsOceanside, California, United StatesA tiempo completo