Talent.com
AI Multimedia Generation Evaluator
AI Multimedia Generation EvaluatorVirtualVocations • Fullerton, California, United States
AI Multimedia Generation Evaluator

AI Multimedia Generation Evaluator

VirtualVocations • Fullerton, California, United States
3 days ago
Job type
  • Full-time
Job description

A company is looking for a Software Engineer II to evaluate AI multimedia generation products for images and videos.

Key Responsibilities

Set up Halo tasks and run model inference

Audit annotations from vendors and manage evaluation datasets

Collaborate with model development teams to conduct offline evaluations

Required Qualifications

1-2 years of basic Python knowledge, especially with image / video data and JSON

Experience in SQL and handling large data tables

Experience in the image and video domain

Ability to adapt to new code and flexible working hours

Basic shell script knowledge is a plus

Create a job alert for this search

Evaluator • Fullerton, California, United States

Related jobs
Research Lead - AI Cyber Testing & Evaluation

Research Lead - AI Cyber Testing & Evaluation

RAND Corporation • Santa Monica, CA, United States
Temporary
Global and Emerging Risks (GER) division.As Research Lead - AI Cyber Testing & Evaluation, you'll direct a comprehensive research portfolio focused on assessing the offensive cyber capabilities of ...Show more
Last updated: 30+ days ago • Promoted
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocations • Huntington Beach, California, United States
Full-time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...Show more
Last updated: 20 days ago • Promoted
Research Lead - AI Cyber Testing & Evaluation

Research Lead - AI Cyber Testing & Evaluation

RAND • Santa Monica, CA, United States
Temporary
RAND's Meselson Center, part of the Global and Emerging Risks (GER) division, is seeking an accomplished technical leader to drive our ambitious AI cyber evaluation agenda.As Research Lead - AI Cyb...Show more
Last updated: 30+ days ago • Promoted
AI Engineer Team Lead

AI Engineer Team Lead

VirtualVocations • Signal Hill, California, United States
Full-time
A company is looking for an AI Engineer and Team Lead to enhance its core product with innovative AI features.Key Responsibilities Lead and support the AI team, ensuring alignment across discipli...Show more
Last updated: 3 days ago • Promoted
Multimodal AI Evaluation Analyst

Multimodal AI Evaluation Analyst

VirtualVocations • Mission Viejo, California, United States
Full-time
A company is looking for a Multimodal AI Evaluation Analyst.Key Responsibilities Evaluate and score AI-generated outputs across various modalities Assess quality, correctness, coherence, style, ...Show more
Last updated: 2 days ago • Promoted
Applied AI Engineer

Applied AI Engineer

VirtualVocations • Van Nuys, California, United States
Full-time
A company is looking for an Applied AI Engineer to develop and deploy AI models and hybrid AI frameworks.Key Responsibilities Develop and deploy AI models and hybrid AI frameworks Conduct resear...Show more
Last updated: 30+ days ago • Promoted
Impact Evaluator

Impact Evaluator

VirtualVocations • Norwalk, California, United States
Full-time
A company is looking for an Impact Evaluator to design and implement systemic impact evaluation across the organization.Key Responsibilities Develop and refine the organization's evaluation frame...Show more
Last updated: 2 days ago • Promoted
Remote Corporate Development Analyst – AI Trainer ($50-$60 / hour)

Remote Corporate Development Analyst – AI Trainer ($50-$60 / hour)

Data Annotation • Rancho Cucamonga, California
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Show more
Last updated: 11 days ago • Promoted
Research Lead - AI Security Field-Building & Partnerships

Research Lead - AI Security Field-Building & Partnerships

RAND Corporation • Santa Monica, CA, United States
Temporary
Global and Emerging Risks (GER) division.As Research Lead - AI Security Field-Building & Partnerships, you'll shape how organizations work together to address critical challenges in securing powerf...Show more
Last updated: 3 days ago • Promoted
Remote Equity Research Analyst – AI Trainer ($50-$60 / hour)

Remote Equity Research Analyst – AI Trainer ($50-$60 / hour)

Data Annotation • Rancho Cucamonga, California
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Show more
Last updated: 11 days ago • Promoted
Remote Investment Analyst – AI Trainer ($50-$60 / hour)

Remote Investment Analyst – AI Trainer ($50-$60 / hour)

Data Annotation • Pomona, California
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Show more
Last updated: 11 days ago • Promoted
Senior UX Researcher - AI / ML

Senior UX Researcher - AI / ML

VirtualVocations • Mission Viejo, California, United States
Full-time
A company is looking for a Senior UX Researcher (AI / ML - Healthcare / SaaS).Key Responsibilities Drive AI-enhanced product insights through user behavior analysis and feedback Leverage continuous ...Show more
Last updated: 2 days ago • Promoted
Artificial Intelligence Engineer

Artificial Intelligence Engineer

VirtualVocations • North Hollywood, California, United States
Full-time
A company is looking for an Artificial Intelligence Engineer.Key Responsibilities Design and implement scalable agentic solutions for diverse organizational use cases Develop and maintain a cent...Show more
Last updated: 30+ days ago • Promoted
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocations • Whittier, California, United States
Full-time
A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...Show more
Last updated: 20 days ago • Promoted
Remote FinTech Product Analyst - AI Trainer ($50-$60 / hour)

Remote FinTech Product Analyst - AI Trainer ($50-$60 / hour)

Data Annotation • Cypress, California
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Show more
Last updated: 11 days ago • Promoted
Corporate M&A Associate Attorney

Corporate M&A Associate Attorney

Kaizen Stackup • Altadena, CA, US
Full-time
Corporate M&A Associate Attorney – Top-Tier Tech & Life Sciences Deals.Are you a strategic dealmaker with a passion for high-stakes M&A work? Ready to take your legal career to th...Show more
Last updated: 30+ days ago • Promoted
Applied ML Scientist

Applied ML Scientist

VirtualVocations • Long Beach, California, United States
Full-time
A company is looking for an Applied ML Scientist specializing in Model Calibration & Personalization.Key Responsibilities Fine-tune existing embeddings and learn weight calibration functions for ...Show more
Last updated: 11 hours ago • Promoted • New!
AI Multimedia Evaluator

AI Multimedia Evaluator

VirtualVocations • Norwalk, California, United States
Full-time
A company is looking for an AI Multimedia Generation Product Evaluator.Key Responsibilities Set up Halo tasks and run model inference Audit annotations from vendors and manage evaluation dataset...Show more
Last updated: 5 days ago • Promoted