Talent.com
AI Evaluation Analyst
AI Evaluation AnalystVirtualVocations • Charlotte, North Carolina, United States
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocations • Charlotte, North Carolina, United States
17 days ago
Job type
  • Full-time
Job description

A company is looking for an AI Evaluator / Annotator (Remote- freelance, 100+ openings).

Key Responsibilities

Evaluate outputs generated by large language models (LLMs) across multiple modalities

Assess quality against project-specific criteria such as correctness and cultural appropriateness

Provide detailed written feedback and collaborate with project managers to meet benchmarks

Required Qualifications

Bachelor's degree / diploma or equivalent educational qualification

1+ years of experience in data annotation, LLM evaluation, or related AI / ML domains

Experience with data annotation tools and software platforms

Strong understanding of language and multimodal communication

Ability to adapt quickly to changing project directions and fast-paced environments

Create a job alert for this search

Ai Analyst • Charlotte, North Carolina, United States

Related jobs
Market Research Analyst

Market Research Analyst

VirtualVocations • Charlotte, North Carolina, United States
Full-time
A company is looking for a Market Research Principal Analyst, AI.Key Responsibilities Serve as a subject matter expert on emerging AI technology and its impact on B2B software markets Engage wit...Show more
Last updated: 30+ days ago • Promoted
Research Analyst

Research Analyst

VirtualVocations • Charlotte, North Carolina, United States
Part-time
A company is looking for a Research Analyst to support data management and analytics in a remote, part-time role.Key Responsibilities Lead project writing, analysis, and coordination with other d...Show more
Last updated: 30+ days ago • Promoted
Travel Board Certified Behavioral Analyst - School (BCBA) in Hickory, NC

Travel Board Certified Behavioral Analyst - School (BCBA) in Hickory, NC

AlliedTravelCareers • Hickory, NC, US
Full-time
AlliedTravelCareers is working with Aequor to find a qualified BCBA - School in Hickory, North Carolina, 28601!.Aequor is now hiring a full-time Board Certified Behavior Analyst (BCBA) for the 2023...Show more
Last updated: 3 days ago • Promoted
Data Science Analyst

Data Science Analyst

VirtualVocations • Charlotte, North Carolina, United States
Full-time
A company is looking for an Analytic Science, Scientist I.Key Responsibilities Design and develop data-driven exploratory analysis and predictive models to address business challenges Build and ...Show more
Last updated: 30+ days ago • Promoted
Strategy Analyst

Strategy Analyst

VirtualVocations • Charlotte, North Carolina, United States
Full-time
A company is looking for a Strategy Analyst to support effective allocation of philanthropic resources.Key Responsibilities Conduct research and analysis to identify and evaluate potential grant ...Show more
Last updated: 30+ days ago • Promoted
Impact Evaluator

Impact Evaluator

VirtualVocations • Charlotte, North Carolina, United States
Full-time
A company is looking for an Impact Evaluator to design and implement systemic impact evaluation across the organization.Key Responsibilities Develop and refine the organization's evaluation frame...Show more
Last updated: 15 hours ago • Promoted • New!
AI Audit Specialist

AI Audit Specialist

VirtualVocations • Charlotte, North Carolina, United States
Full-time
A company is looking for an AI Audit Methodology Specialist.Key Responsibilities Design, test, and refine prompts and datasets to enhance AI accuracy in audit documentation Curate and contextual...Show more
Last updated: 2 days ago • Promoted
AI Data Specialist

AI Data Specialist

VirtualVocations • Charlotte, North Carolina, United States
Part-time
A company is looking for an AI Data Specialist to support the improvement of AI-generated content in English.Key Responsibilities Perform data collection, evaluation, and annotation Conduct pair...Show more
Last updated: 17 days ago • Promoted
Multimodal AI Evaluation Analyst

Multimodal AI Evaluation Analyst

VirtualVocations • Charlotte, North Carolina, United States
Full-time
A company is looking for a Multimodal AI Evaluation Analyst.Key Responsibilities Evaluate and score AI-generated outputs across various modalities Assess quality, correctness, coherence, style, ...Show more
Last updated: 9 hours ago • Promoted • New!
AI Solutions Analyst

AI Solutions Analyst

VirtualVocations • Charlotte, North Carolina, United States
Full-time
A company is looking for an AI Solutions Analyst to support the design and adoption of AI workstreams from an administrative perspective. Key Responsibilities Partner with teams to identify high-v...Show more
Last updated: 30+ days ago • Promoted
AI Data Project Manager

AI Data Project Manager

VirtualVocations • Charlotte, North Carolina, United States
Full-time
A company is looking for an Agent Evaluation Analyst.Key Responsibilities Take ownership of delivery team projects, ensuring data quality and timely delivery Lead a cross-functional team to keep...Show more
Last updated: 1 day ago • Promoted
Travel Board Certified Behavioral Analyst - School (BCBA) in Mooresville, NC

Travel Board Certified Behavioral Analyst - School (BCBA) in Mooresville, NC

AlliedTravelCareers • Mooresville, NC, US
Full-time
AlliedTravelCareers is working with Aequor to find a qualified BCBA - School in Mooresville, North Carolina, 28115!.Aequor is now hiring a full-time Board Certified Behavior Analyst (BCBA) for the ...Show more
Last updated: 3 days ago • Promoted
AI Multimedia Generation Evaluator

AI Multimedia Generation Evaluator

VirtualVocations • Charlotte, North Carolina, United States
Full-time
A company is looking for a Software Engineer II to evaluate AI multimedia generation products for images and videos.Key Responsibilities Set up Halo tasks and run model inference Audit annotatio...Show more
Last updated: 1 day ago • Promoted
Research & Knowledge Analyst

Research & Knowledge Analyst

VirtualVocations • Charlotte, North Carolina, United States
Full-time
A company is looking for a Research & Knowledge Analyst to join its Knowledge & Innovation team.Key Responsibilities Conducts legal and business research, providing concise summaries of findings ...Show more
Last updated: 1 day ago • Promoted
Research and Evaluation Coordinator

Research and Evaluation Coordinator

VirtualVocations • Charlotte, North Carolina, United States
Full-time
A company is looking for a Coordinator of Research and Evaluation.Key Responsibilities Organizes literature on scratch cooking in schools and summarizes key takeaways for program evaluation Mana...Show more
Last updated: 13 hours ago • Promoted • New!
AI Implementation Manager

AI Implementation Manager

VirtualVocations • Charlotte, North Carolina, United States
Full-time
A company is looking for an AI Implementation Manager to oversee the delivery of enterprise Voice AI programs from initiation to go-live. Key Responsibilities Manage project delivery, including ki...Show more
Last updated: 30+ days ago • Promoted
Senior UX Researcher - AI / ML

Senior UX Researcher - AI / ML

VirtualVocations • Charlotte, North Carolina, United States
Full-time
A company is looking for a Senior UX Researcher (AI / ML - Healthcare / SaaS).Key Responsibilities Drive AI-enhanced product insights through user behavior analysis and feedback Leverage continuous ...Show more
Last updated: 9 hours ago • Promoted • New!
AI Multimedia Evaluator

AI Multimedia Evaluator

VirtualVocations • Charlotte, North Carolina, United States
Full-time
A company is looking for an AI Multimedia Generation Product Evaluator.Key Responsibilities Set up Halo tasks and run model inference Audit annotations from vendors and manage evaluation dataset...Show more
Last updated: 3 days ago • Promoted