Talent.com
Multimodal AI Evaluation Analyst
Multimodal AI Evaluation AnalystVirtualVocations • Rockville, Maryland, United States
Multimodal AI Evaluation Analyst

Multimodal AI Evaluation Analyst

VirtualVocations • Rockville, Maryland, United States
2 days ago
Job type
  • Full-time
Job description

A company is looking for a Multimodal AI Evaluation Analyst.

Key Responsibilities

Evaluate and score AI-generated outputs across various modalities

Assess quality, correctness, coherence, style, and cultural alignment of outputs

Provide detailed feedback and collaborate with Quality Leads and Project Managers

Required Qualifications

BA degree or equivalent experience (preferred)

Experience with annotation tools or AI data platforms

Understanding of multimodal communication

Experience in data annotation or AI evaluation (preferred)

Able to work in fast-paced projects with evolving quality standards

Create a job alert for this search

Ai Analyst • Rockville, Maryland, United States

Related jobs
Lead AI Engineer (AI Foundations, LLM Core)

Lead AI Engineer (AI Foundations, LLM Core)

Capital One • BALTIMORE, Maryland, United States
Full-time +1
Lead AI Engineer (AI Foundations, LLM Core).At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in usin...Show more
Last updated: 30+ days ago • Promoted
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocations • Alexandria, Virginia, United States
Full-time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...Show more
Last updated: 21 days ago • Promoted
Applied Researcher 1

Applied Researcher 1

Capital One • BALTIMORE, Maryland, United States
Full-time +1
At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good.For years, Capital One has been leading the industry in using machine learning to create real-time, in...Show more
Last updated: 30+ days ago • Promoted
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocations • Rockville, Maryland, United States
Full-time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...Show more
Last updated: 21 days ago • Promoted
Principal Associate, Ontology and Data Modeling- Retail Bank

Principal Associate, Ontology and Data Modeling- Retail Bank

Capital One • BALTIMORE, Maryland, United States
Full-time +1
Principal Associate, Ontology and Data Modeling- Retail Bank.The role of the Principal Associate of Ontology and Data Modeling is to develop, implement, and maintain enterprise ontologies in suppor...Show more
Last updated: 30+ days ago • Promoted
Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)

Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)

Capital One • BALTIMORE, Maryland, United States
Full-time +1
Lead AI Engineer (AI Foundations, LLM Core and Agentic AI).At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry...Show more
Last updated: 12 hours ago • Promoted • New!
Senior AI Engineer (AI Foundations, LLM Core, Agentic AI)

Senior AI Engineer (AI Foundations, LLM Core, Agentic AI)

Capital One • BALTIMORE, Maryland, United States
Full-time +1
Senior AI Engineer (AI Foundations, LLM Core, Agentic AI).At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry ...Show more
Last updated: 12 hours ago • Promoted • New!
Lead Machine Learning Engineer (Intelligent Foundations & Experiences)

Lead Machine Learning Engineer (Intelligent Foundations & Experiences)

Capital One • BALTIMORE, Maryland, United States
Full-time +1
Lead Machine Learning Engineer (Intelligent Foundations & Experiences).As a Capital One Machine Learning Engineer (MLE), you'll be part of an Agile team dedicated to productionizing machine learnin...Show more
Last updated: 21 days ago • Promoted
Lead AI Engineer (FM Hosting, LLM Inference)

Lead AI Engineer (FM Hosting, LLM Inference)

Capital One • BALTIMORE, Maryland, United States
Full-time +1
Lead AI Engineer (FM Hosting, LLM Inference).At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in usi...Show more
Last updated: 30+ days ago • Promoted
Lead AI Engineer (AI Foundations, LLM Core, Agentic AI)

Lead AI Engineer (AI Foundations, LLM Core, Agentic AI)

Capital One • BALTIMORE, Maryland, United States
Full-time +1
Lead AI Engineer (AI Foundations, LLM Core, Agentic AI).At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry le...Show more
Last updated: 12 hours ago • Promoted • New!
Senior AI Engineer (AI Foundations, LLM Core)

Senior AI Engineer (AI Foundations, LLM Core)

Capital One • BALTIMORE, Maryland, United States
Full-time +1
Senior AI Engineer (AI Foundations, LLM Core).At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in us...Show more
Last updated: 30+ days ago • Promoted
Lead Machine Learning Engineer - ML / AI

Lead Machine Learning Engineer - ML / AI

Capital One • BALTIMORE, Maryland, United States
Full-time +1
Lead Machine Learning Engineer - ML / AI.At Capital One, we are changing banking for good by creating responsible and reliable AI-powered systems. Our investments in technology infrastructure and worl...Show more
Last updated: 21 days ago • Promoted
AI Multimedia Generation Evaluator

AI Multimedia Generation Evaluator

VirtualVocations • Alexandria, Virginia, United States
Full-time
A company is looking for a Software Engineer II to evaluate AI multimedia generation products for images and videos.Key Responsibilities Set up Halo tasks and run model inference Audit annotatio...Show more
Last updated: 3 days ago • Promoted
Applied Researcher I

Applied Researcher I

Capital One • MCLEAN, Virginia, United States
Full-time +1
At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good.For years, Capital One has been leading the industry in using machine learning to create real-time, in...Show more
Last updated: 30+ days ago • Promoted
Lead Machine Learning Engineer -ML / AI

Lead Machine Learning Engineer -ML / AI

Capital One • BALTIMORE, Maryland, United States
Full-time +1
Lead Machine Learning Engineer -ML / AI.At Capital One, we are changing banking for good by creating responsible and reliable AI-powered systems. Our investments in technology infrastructure and world...Show more
Last updated: 12 hours ago • Promoted • New!
Senior Machine Learning Engineer (Intelligent Foundations & Experiences)

Senior Machine Learning Engineer (Intelligent Foundations & Experiences)

Capital One • BALTIMORE, Maryland, United States
Full-time +1
Senior Machine Learning Engineer (Intelligent Foundations & Experiences).As a Capital One Machine Learning Engineer (MLE), you'll be part of an Agile team dedicated to productionizing machine learn...Show more
Last updated: 12 hours ago • Promoted • New!
AI Multimedia Evaluator

AI Multimedia Evaluator

VirtualVocations • Alexandria, Virginia, United States
Full-time
A company is looking for an AI Multimedia Generation Product Evaluator.Key Responsibilities Set up Halo tasks and run model inference Audit annotations from vendors and manage evaluation dataset...Show more
Last updated: 5 days ago • Promoted
Applied Researcher I (AI Foundations)

Applied Researcher I (AI Foundations)

Capital One • BALTIMORE, Maryland, United States
Full-time +1
Applied Researcher I (AI Foundations).At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good. For years, Capital One has been leading the industry in using ma...Show more
Last updated: 12 hours ago • Promoted • New!