Talent.com
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocationsDurham, North Carolina, United States
Hace 1 día
Tipo de contrato
  • A tiempo completo
Descripción del trabajo

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats like JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

Crear una alerta de empleo para esta búsqueda

Ai Analyst • Durham, North Carolina, United States

Ofertas relacionadas
  • Oferta promocionada
AI Implementation Specialist

AI Implementation Specialist

VirtualVocationsRaleigh, North Carolina, United States
A tiempo completo
A company is looking for an AI Implementation Specialist for Automated Portfolio Analysis and Reporting.Key Responsibilities Develop a GUI-based prototype for AI-powered document analysis and vis...Mostrar másÚltima actualización: hace más de 30 días
  • Oferta promocionada
Senior Big Data Engineer

Senior Big Data Engineer

VirtualVocationsRaleigh, North Carolina, United States
A tiempo completo
A company is looking for a Senior Big Data Engineer to join their team.Key Responsibilities Support the transition from a monolithic application to loosely coupled microservices Ensure data is c...Mostrar másÚltima actualización: hace más de 30 días
  • Oferta promocionada
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocationsDurham, North Carolina, United States
A tiempo completo
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...Mostrar másÚltima actualización: hace 1 día
  • Oferta promocionada
Senior AI Consultant

Senior AI Consultant

VirtualVocationsRaleigh, North Carolina, United States
A tiempo completo
A company is looking for a Senior Consultant AI.Key Responsibilities Utilize Azure AI Services to build and optimize OpenAI solutions Develop and manage data ingestion and transformation pipelin...Mostrar másÚltima actualización: hace más de 30 días
  • Oferta promocionada
Senior Business Intelligence Developer

Senior Business Intelligence Developer

VirtualVocationsDurham, North Carolina, United States
A tiempo completo
A company is looking for a Senior Business Intelligence Developer - Product & Platform Innovation.Key Responsibilities Collaborate with cross-functional teams to drive data enablement and support...Mostrar másÚltima actualización: hace más de 30 días
  • Oferta promocionada
  • Nueva oferta
Generative AI Scientist

Generative AI Scientist

VirtualVocationsDurham, North Carolina, United States
A tiempo completo
A company is looking for a Generative AI Scientist.Key Responsibilities Deliver solutions to identify payment integrity issues and improve healthcare quality Develop exploratory data analysis ap...Mostrar másÚltima actualización: hace 4 horas
  • Oferta promocionada
  • Nueva oferta
Deep Learning Software Engineer

Deep Learning Software Engineer

VirtualVocationsRaleigh, North Carolina, United States
A tiempo completo
A company is looking for a Deep Learning Software Engineer, Inference and Model Optimization - New College Grad 2025.Key Responsibilities Train, develop, and deploy generative AI models using the...Mostrar másÚltima actualización: hace 10 horas
  • Oferta promocionada
AI Solutions Specialist

AI Solutions Specialist

VirtualVocationsRaleigh, North Carolina, United States
A tiempo completo
A company is looking for an AI Solutions Specialist to drive business innovation through artificial intelligence.Key Responsibilities Analyze complex datasets to uncover trends and actionable ins...Mostrar másÚltima actualización: hace más de 30 días
  • Oferta promocionada
Epic Cogito Reporting Advisor

Epic Cogito Reporting Advisor

VirtualVocationsRaleigh, North Carolina, United States
A tiempo completo
A company is looking for an Epic Cogito BID.Key Responsibilities Gather reporting requirements and design reports for healthcare organizations Conduct testing and validation of reports and provi...Mostrar másÚltima actualización: hace 1 día
  • Oferta promocionada
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocationsRaleigh, North Carolina, United States
A tiempo completo
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...Mostrar másÚltima actualización: hace 1 día
  • Oferta promocionada
  • Nueva oferta
Data Engineer with GCP Certification

Data Engineer with GCP Certification

VirtualVocationsRaleigh, North Carolina, United States
A tiempo completo
A company is looking for a Data Engineer (Gen AI).Key Responsibilities Install and test Looker and Looker Studio extensions or API plugins Identify and deprecate unused Looker dashboards Enhanc...Mostrar másÚltima actualización: hace 4 horas
  • Oferta promocionada
AI Engineer

AI Engineer

RELIASMorrisville, NC, United States
A tiempo completo
Are you looking for a high energy, strategic, and fast-paced position as an AI Engineer? Join Relias, the company changing lives throughout the world by helping healthcare organizations improve th...Mostrar másÚltima actualización: hace más de 30 días
  • Oferta promocionada
  • Nueva oferta
Senior AI Agent Developer

Senior AI Agent Developer

VirtualVocationsDurham, North Carolina, United States
A tiempo completo
Key Responsibilities Design, develop, and deploy production-ready AI agents that support critical workflows across the enterprise Rapidly prototype, test, and refine agents to ensure high perfor...Mostrar másÚltima actualización: hace 10 horas
  • Oferta promocionada
Azure Data Engineer

Azure Data Engineer

TEKsystemsRaleigh, NC, United States
A tiempo completo
Candidates must be local to North Carolina.The company is continuing to scale their Azure, Data and AI service offerings to internal stakeholders and partners. The Web Services team is in serious ne...Mostrar másÚltima actualización: hace 1 día
  • Oferta promocionada
Junior Machine Learning Engineer

Junior Machine Learning Engineer

VirtualVocationsDurham, North Carolina, United States
A tiempo completo
A company is looking for a Junior Machine Learning Engineer to support the design, development, and deployment of machine learning models. Key Responsibilities Support the end-to-end lifecycle of ...Mostrar másÚltima actualización: hace más de 30 días
  • Oferta promocionada
Advanced Analytics Expert

Advanced Analytics Expert

VirtualVocationsRaleigh, North Carolina, United States
A tiempo completo
A company is looking for an Advanced Analytics Expert to collaborate with teams and utilize advanced analytics for data-driven decision-making. Key Responsibilities Builds advanced analytics solut...Mostrar másÚltima actualización: hace 1 día
  • Oferta promocionada
OmniStudio Developer

OmniStudio Developer

VirtualVocationsRaleigh, North Carolina, United States
A tiempo completo
A company is looking for an OmniStudio Developer to contribute to transformative public sector projects.Key Responsibilities : Design and configure responsive user interfaces using FlexCards Crea...Mostrar másÚltima actualización: hace más de 30 días
  • Oferta promocionada
Epic Certified BI Developer

Epic Certified BI Developer

VirtualVocationsRaleigh, North Carolina, United States
A tiempo completo
A company is looking for an IT Data Solutions Developer Associate.Key Responsibilities Analyze, develop, and improve BI solutions to meet business needs Collaborate with operations teams to desi...Mostrar másÚltima actualización: hace 28 días
  • Oferta promocionada
  • Nueva oferta
Tech Lead for AI & Data

Tech Lead for AI & Data

VirtualVocationsRaleigh, North Carolina, United States
A tiempo completo
A company is looking for a Tech Lead with AI & Data expertise (Remote, LATAM).Key Responsibilities Lead the technical effort for the Delivery Team, ensuring clarity and confidence with clients an...Mostrar másÚltima actualización: hace 14 horas
  • Oferta promocionada
AI Prototype Specialist

AI Prototype Specialist

VirtualVocationsRaleigh, North Carolina, United States
A tiempo completo
A company is looking for an AI Prototype Specialist (Vibe Coder).Key Responsibilities Collaborate with strategy and sales teams to understand client needs and challenges Design and build functio...Mostrar másÚltima actualización: hace 1 día