Talent.com
Gen AI Evaluation Analyst
Gen AI Evaluation AnalystVirtualVocations • Chesapeake, Virginia, United States
No longer accepting applications
Gen AI Evaluation Analyst

Gen AI Evaluation Analyst

VirtualVocations • Chesapeake, Virginia, United States
23 days ago
Job type
  • Full-time
Job description

A company is looking for an English Language / Gen AI Specialist.

Key Responsibilities :

Evaluate outputs generated by LLMs across multiple modalities

Assess quality against project-specific criteria such as correctness and coherence

Provide detailed written feedback and collaborate with Project Managers to meet benchmarks

Required Qualifications :

Bachelor's degree / diploma or equivalent educational qualification

1+ years of experience in data annotation, LLM evaluation, or related AI / ML domains

Experience with data annotation tools and software platforms

Strong understanding of language and multimodal communication

Ability to adapt quickly to changing project directions

Create a job alert for this search

Evaluation Analyst • Chesapeake, Virginia, United States

Related jobs
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocations • Portsmouth, Virginia, United States
Full-time
A company is looking for an AI Evaluator / Annotator (Remote- freelance, 100+ openings).Key Responsibilities Evaluate outputs generated by large language models (LLMs) across multiple modalities ...Show more
Last updated: 18 days ago • Promoted
AI Solutions Analyst

AI Solutions Analyst

VirtualVocations • Norfolk, Virginia, United States
Full-time
A company is looking for an AI Solutions Analyst to support the design and adoption of AI workstreams from an administrative perspective. Key Responsibilities Partner with teams to identify high-v...Show more
Last updated: 30+ days ago • Promoted
AI Data Specialist

AI Data Specialist

VirtualVocations • Portsmouth, Virginia, United States
Part-time
A company is looking for an AI Data Specialist to support the improvement of AI-generated content in English.Key Responsibilities Perform data collection, evaluation, and annotation Conduct pair...Show more
Last updated: 30+ days ago • Promoted
Senior AI Engineer

Senior AI Engineer

VirtualVocations • Portsmouth, Virginia, United States
Full-time
AI Engineer to join their team remotely.Key Responsibilities Designing, developing, and implementing AI models Analyzing and improving existing AI architectures Researching and implementing new...Show more
Last updated: 30+ days ago • Promoted
Generative AI Red Team Specialist

Generative AI Red Team Specialist

VirtualVocations • Portsmouth, Virginia, United States
Full-time
A company is looking for a Generative AI Associate - Red Teaming Specialist.Key Responsibilities Complete training on AI / ML, LLMs, Red Teaming, and jailbreaking Craft prompts to bypass filters o...Show more
Last updated: 3 days ago • Promoted
Senior UX Researcher - AI / ML

Senior UX Researcher - AI / ML

VirtualVocations • Portsmouth, Virginia, United States
Full-time
A company is looking for a Senior UX Researcher (AI / ML - Healthcare / SaaS).Key Responsibilities Drive AI-enhanced product insights through user behavior analysis and feedback Leverage continuous ...Show more
Last updated: 10 hours ago • Promoted • New!
Research & Knowledge Analyst

Research & Knowledge Analyst

VirtualVocations • Portsmouth, Virginia, United States
Full-time
A company is looking for a Research & Knowledge Analyst to join its Knowledge & Innovation team.Key Responsibilities Conducts legal and business research, providing concise summaries of findings ...Show more
Last updated: 1 day ago • Promoted
Research Analyst

Research Analyst

VirtualVocations • Portsmouth, Virginia, United States
Part-time
A company is looking for a Research Analyst to support data management and analytics in a remote, part-time role.Key Responsibilities Lead project writing, analysis, and coordination with other d...Show more
Last updated: 30+ days ago • Promoted
Applied AI Engineer Consultant

Applied AI Engineer Consultant

VirtualVocations • Norfolk, Virginia, United States
Full-time
A company is looking for an Applied AI Engineer Consultant.Key Responsibilities Build production-ready Intelligent Automations and Agentic AI solutions for enterprise clients Guide clients in de...Show more
Last updated: 30+ days ago • Promoted
AI Multimedia Evaluator

AI Multimedia Evaluator

VirtualVocations • Portsmouth, Virginia, United States
Full-time
A company is looking for an AI Multimedia Generation Product Evaluator.Key Responsibilities Set up Halo tasks and run model inference Audit annotations from vendors and manage evaluation dataset...Show more
Last updated: 3 days ago • Promoted
Applied AI Engineer

Applied AI Engineer

VirtualVocations • Portsmouth, Virginia, United States
Full-time
A company is looking for an Applied AI Engineer to develop and deploy AI models and hybrid AI frameworks.Key Responsibilities Develop and deploy AI models and hybrid AI frameworks Conduct resear...Show more
Last updated: 30+ days ago • Promoted
Multimodal AI Evaluation Analyst

Multimodal AI Evaluation Analyst

VirtualVocations • Norfolk, Virginia, United States
Full-time
A company is looking for a Multimodal AI Evaluation Analyst.Key Responsibilities Evaluate and score AI-generated outputs across various modalities Assess quality, correctness, coherence, style, ...Show more
Last updated: 10 hours ago • Promoted • New!
Market Research Analyst

Market Research Analyst

VirtualVocations • Portsmouth, Virginia, United States
Full-time
A company is looking for a Market Research Principal Analyst, AI.Key Responsibilities Serve as a subject matter expert on emerging AI technology and its impact on B2B software markets Engage wit...Show more
Last updated: 30+ days ago • Promoted
AI Engineer

AI Engineer

VirtualVocations • Portsmouth, Virginia, United States
Full-time
A company is looking for an AI Engineer to join a global medical technology company.Key Responsibilities Building production-ready agentic AI systems Designing and implementing CI / CD pipelines f...Show more
Last updated: 30+ days ago • Promoted
AI Multimedia Generation Evaluator

AI Multimedia Generation Evaluator

VirtualVocations • Norfolk, Virginia, United States
Full-time
A company is looking for a Software Engineer II to evaluate AI multimedia generation products for images and videos.Key Responsibilities Set up Halo tasks and run model inference Audit annotatio...Show more
Last updated: 1 day ago • Promoted
AI Integration Engineer

AI Integration Engineer

VirtualVocations • Norfolk, Virginia, United States
Full-time
A company is looking for an AI Integration Engineer - ServiceNow / Workday.Key Responsibilities Lead deployment and configuration of ServiceNow / Workday connectors Translate HR / IT / Facilities use ca...Show more
Last updated: 30+ days ago • Promoted
AI Data Project Manager

AI Data Project Manager

VirtualVocations • Norfolk, Virginia, United States
Full-time
A company is looking for an Agent Evaluation Analyst.Key Responsibilities Take ownership of delivery team projects, ensuring data quality and timely delivery Lead a cross-functional team to keep...Show more
Last updated: 1 day ago • Promoted
Strategy Analyst

Strategy Analyst

VirtualVocations • Norfolk, Virginia, United States
Full-time
A company is looking for a Strategy Analyst to support effective allocation of philanthropic resources.Key Responsibilities Conduct research and analysis to identify and evaluate potential grant ...Show more
Last updated: 30+ days ago • Promoted