AI Agent Evaluation AnalystVirtualVocations • Ontario, California, United States
AI Agent Evaluation Analyst
VirtualVocations • Ontario, California, United States
Hace 20 días
Tipo de contrato
- A tiempo completo
Descripción del trabajo
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking with the ability to reason about complex systems
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
Crear una alerta de empleo para esta búsqueda
Ai Analyst • Ontario, California, United States
Ofertas relacionadas
Driving with Uber is an alternative to a part-time or full-time job and can get you earning cash on the road quickly.Driving with Uber allows you to earn quick cash while maintaining the flexibilit...Mostrar más A company is looking for an AI Solutions Analyst to support the design and adoption of AI workstreams from an administrative perspective.
Key Responsibilities Partner with teams to identify high-v...Mostrar más A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...Mostrar más A company is looking for an Agent Evaluation Analyst.Key Responsibilities Take ownership of delivery team projects, ensuring data quality and timely delivery Lead a cross-functional team to keep...Mostrar más A company is looking for a Multimodal AI Evaluation Analyst.Key Responsibilities Evaluate and score AI-generated outputs across various modalities Assess quality, correctness, coherence, style, ...Mostrar más A company is looking for an AI Agent Developer.Key Responsibilities Architect and implement AI-powered agents using Large Language Models (LLMs) Connect agents to internal systems and databases,...Mostrar más A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...Mostrar más 
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Mostrar más A company is looking for an Applied AI Engineer to develop and deploy AI models and hybrid AI frameworks.Key Responsibilities Develop and deploy AI models and hybrid AI frameworks Conduct resear...Mostrar más A company is looking for a Market Research Principal Analyst, AI.Key Responsibilities Serve as a subject matter expert on emerging AI technology and its impact on B2B software markets Engage wit...Mostrar más A company is looking for a Software Engineer II to evaluate AI multimedia generation products for images and videos.Key Responsibilities Set up Halo tasks and run model inference Audit annotatio...Mostrar más A company is looking for a Data Specialist to assist in training AI applications through video and audio annotation and prompt evaluation.
Key Responsibilities Annotate audio events within video c...Mostrar más We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Mostrar más We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Mostrar más We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Mostrar más 
Corporate M&A Associate Attorney – Top-Tier Tech & Life Sciences Deals.Are you a strategic dealmaker with a passion for high-stakes M&A work? Ready to take your legal career to th...Mostrar más A company is looking for an AI Multimedia Generation Product Evaluator.Key Responsibilities Set up Halo tasks and run model inference Audit annotations from vendors and manage evaluation dataset...Mostrar más We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Mostrar más
Earn Extra Income Driving
Uber • Lytle Creek, CA, US
A tiempo completo +1
Última actualización: hace 4 días • Oferta promocionada
AI Solutions Analyst
VirtualVocations • Ontario, California, United States
A tiempo completo
Última actualización: hace 5 días • Oferta promocionada
AI Evaluation Analyst
VirtualVocations • Ontario, California, United States
A tiempo completo
Última actualización: hace 20 días • Oferta promocionada
AI Data Project Manager
VirtualVocations • Huntington Beach, California, United States
A tiempo completo
Última actualización: hace 3 días • Oferta promocionada
Multimodal AI Evaluation Analyst
VirtualVocations • Pasadena, California, United States
A tiempo completo
Última actualización: hace 2 días • Oferta promocionada
AI Agent Developer
VirtualVocations • Whittier, California, United States
A tiempo completo
Última actualización: hace más de 30 días • Oferta promocionada
AI Agent Evaluation Analyst
VirtualVocations • Mission Viejo, California, United States
A tiempo completo
Última actualización: hace 20 días • Oferta promocionada
Remote Financial Analyst - AI Trainer ($50-$60 / hour)
Data Annotation • Perris, California
Teletrabajo
A tiempo completo +1
Última actualización: hace 11 días • Oferta promocionada
Applied AI Engineer
VirtualVocations • Ontario, California, United States
A tiempo completo
Última actualización: hace más de 30 días • Oferta promocionada
Market Research Analyst
VirtualVocations • Huntington Beach, California, United States
A tiempo completo
Última actualización: hace más de 30 días • Oferta promocionada
AI Multimedia Generation Evaluator
VirtualVocations • Ontario, California, United States
A tiempo completo
Última actualización: hace 12 horas • Oferta promocionada • Nueva oferta
Data Specialist for AI Evaluation
VirtualVocations • Fullerton, California, United States
A tiempo completo
Última actualización: hace más de 30 días • Oferta promocionada
Remote Corporate Development Analyst – AI Trainer ($50-$60 / hour)
Data Annotation • Stanton, California
Teletrabajo
A tiempo completo +1
Última actualización: hace 11 días • Oferta promocionada
Remote FinTech Product Analyst - AI Trainer ($50-$60 / hour)
Data Annotation • Westminster, California
Teletrabajo
A tiempo completo +1
Última actualización: hace 11 días • Oferta promocionada
Remote FP&A Manager – AI Trainer ($50-$60 / hour)
Data Annotation • Lake Elsinore, California
Teletrabajo
A tiempo completo +1
Última actualización: hace 11 días • Oferta promocionada
Corporate M&A Associate Attorney
Kaizen Stackup • Altadena, CA, US
A tiempo completo
Última actualización: hace más de 30 días • Oferta promocionada
AI Multimedia Evaluator
VirtualVocations • Ontario, California, United States
A tiempo completo
Última actualización: hace 5 días • Oferta promocionada
Remote Equity Research Analyst – AI Trainer ($50-$60 / hour)
Data Annotation • Pasadena, California
Teletrabajo
A tiempo completo +1
Última actualización: hace 11 días • Oferta promocionada