Talent.com
AI Multimedia Evaluator
AI Multimedia EvaluatorVirtualVocations • Fullerton, California, United States
AI Multimedia Evaluator

AI Multimedia Evaluator

VirtualVocations • Fullerton, California, United States
4 days ago
Job type
  • Full-time
Job description

A company is looking for an AI Multimedia Generation Product Evaluator.

Key Responsibilities

Set up Halo tasks and run model inference

Audit annotations from vendors and manage evaluation datasets

Collaborate with model development teams to conduct offline evaluations and automate pipelines

Required Qualifications

2 years of basic Python knowledge, particularly with image / video data and JSON

Experience in SQL and handling large data tables

Experience in the image and video domain

Flexibility in working hours

Bachelor's degree preferred, not required

Create a job alert for this search

Evaluator • Fullerton, California, United States

Related jobs
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocations • Pasadena, California, United States
Full-time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...Show more
Last updated: 20 days ago • Promoted
Research Lead - AI Cyber Testing & Evaluation

Research Lead - AI Cyber Testing & Evaluation

RAND • Santa Monica, CA, United States
Temporary
RAND's Meselson Center, part of the Global and Emerging Risks (GER) division, is seeking an accomplished technical leader to drive our ambitious AI cyber evaluation agenda.As Research Lead - AI Cyb...Show more
Last updated: 30+ days ago • Promoted
Intellectual Property - Life Sciences - Midlevel Associate

Intellectual Property - Life Sciences - Midlevel Associate

Direct Counsel • Orange, CA, US
Full-time
Direct Counsel is partnering with a distinguished American international law firm to find a midlevel associate with 1–5 years of patent prosecution experience in biotechnology.The ideal candi...Show more
Last updated: 30+ days ago • Promoted
Research Lead - AI Cyber Testing & Evaluation

Research Lead - AI Cyber Testing & Evaluation

RAND Corporation • Santa Monica, CA, United States
Temporary
Global and Emerging Risks (GER) division.As Research Lead - AI Cyber Testing & Evaluation, you'll direct a comprehensive research portfolio focused on assessing the offensive cyber capabilities of ...Show more
Last updated: 30+ days ago • Promoted
Adjunct Faculty in Artificial Intelligence

Adjunct Faculty in Artificial Intelligence

VirtualVocations • Norwalk, California, United States
Full-time
A company is looking for an Adjunct Faculty - Artificial Intelligence.Key Responsibilities Provide instruction in assigned courses and engage with students to enhance learning Maintain accessibi...Show more
Last updated: 3 days ago • Promoted
Artificial Intelligence Engineer

Artificial Intelligence Engineer

VirtualVocations • Pasadena, California, United States
Full-time
A company is looking for an Artificial Intelligence Engineer.Key Responsibilities Design and implement scalable agentic solutions for diverse organizational use cases Develop and maintain a cent...Show more
Last updated: 30+ days ago • Promoted
Multimodal AI Evaluation Analyst

Multimodal AI Evaluation Analyst

VirtualVocations • Fullerton, California, United States
Full-time
A company is looking for a Multimodal AI Evaluation Analyst.Key Responsibilities Evaluate and score AI-generated outputs across various modalities Assess quality, correctness, coherence, style, ...Show more
Last updated: 2 days ago • Promoted
Senior UX Researcher - AI / ML

Senior UX Researcher - AI / ML

VirtualVocations • Huntington Beach, California, United States
Full-time
A company is looking for a Senior UX Researcher (AI / ML - Healthcare / SaaS).Key Responsibilities Drive AI-enhanced product insights through user behavior analysis and feedback Leverage continuous ...Show more
Last updated: 2 days ago • Promoted
AI Content Creator

AI Content Creator

VirtualVocations • Carson, California, United States
Full-time
A company is looking for an AI-Powered Content Creator / Video Editor.Key Responsibilities Create and edit high-quality videos using AI tools and traditional editing software Integrate AI-powere...Show more
Last updated: 30+ days ago • Promoted
Product Manager, Medical Imaging AI

Product Manager, Medical Imaging AI

VirtualVocations • Huntington Beach, California, United States
Full-time
A company is looking for a Product Manager, Medical Imaging AI (Platform).Key Responsibilities Manage the cross-portfolio roadmap of Clinical AI products and ensure alignment with stakeholders G...Show more
Last updated: 30+ days ago • Promoted
Remote FinTech Product Analyst - AI Trainer ($50-$60 / hour)

Remote FinTech Product Analyst - AI Trainer ($50-$60 / hour)

Data Annotation • Long Beach, California
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Show more
Last updated: 11 days ago • Promoted
Impact Evaluator

Impact Evaluator

VirtualVocations • Long Beach, California, United States
Full-time
A company is looking for an Impact Evaluator to design and implement systemic impact evaluation across the organization.Key Responsibilities Develop and refine the organization's evaluation frame...Show more
Last updated: 2 days ago • Promoted
Remote Investment Analyst – AI Trainer ($50-$60 / hour)

Remote Investment Analyst – AI Trainer ($50-$60 / hour)

Data Annotation • Yorba Linda, California
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Show more
Last updated: 11 days ago • Promoted
AI Multimedia Evaluator

AI Multimedia Evaluator

VirtualVocations • Glendale, California, United States
Full-time
A company is looking for an AI Multimedia Generation Product Evaluator.Key Responsibilities Set up Halo tasks and run model inference Audit annotations from vendors and manage evaluation dataset...Show more
Last updated: 4 days ago • Promoted
AI Multimedia Generation Evaluator

AI Multimedia Generation Evaluator

VirtualVocations • Carson, California, United States
Full-time
A company is looking for a Software Engineer II to evaluate AI multimedia generation products for images and videos.Key Responsibilities Set up Halo tasks and run model inference Audit annotatio...Show more
Last updated: 3 days ago • Promoted
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocations • Fullerton, California, United States
Full-time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...Show more
Last updated: 20 days ago • Promoted
Artificial Intelligence (AI) Technology Instructor - Pool - UCLA Extension

Artificial Intelligence (AI) Technology Instructor - Pool - UCLA Extension

University of California - Los Angeles (UCLA) • Los Angeles, CA, United States
Full-time
Wednesday, Dec 31, 2025 at 11 : 59pm (Pacific Time).Apply by this date to ensure full consideration by the committee.Tuesday, Jun 30, 2026 at 11 : 59pm (Pacific Time). Applications will continue to be a...Show more
Last updated: 30+ days ago • Promoted
Remote Video Research Participant $25 / Session Help Build AI Security Tools

Remote Video Research Participant $25 / Session Help Build AI Security Tools

Your Personal AI • Los Angeles, CA, US
Remote
Full-time
Join a cutting-edge research initiative developing AI systems that protect against digital fraud and deepfakes.We're seeking participants across major North American cities to contribute to this im...Show more
Last updated: 30+ days ago