Talent.com
Gen AI Evaluation Analyst

Gen AI Evaluation Analyst

VirtualVocationsWorcester, Massachusetts, United States
21 hours ago
Job type
  • Full-time
Job description

A company is looking for an English Language / Gen AI Specialist.

Key Responsibilities :

Evaluate outputs generated by LLMs across multiple modalities

Assess quality against project-specific criteria such as correctness and coherence

Provide detailed written feedback and collaborate with Project Managers to meet benchmarks

Required Qualifications :

Bachelor's degree / diploma or equivalent educational qualification

1+ years of experience in data annotation, LLM evaluation, or related AI / ML domains

Experience with data annotation tools and software platforms

Strong understanding of language and multimodal communication

Ability to adapt quickly to changing project directions

Create a job alert for this search

Evaluation Analyst • Worcester, Massachusetts, United States

Related jobs
  • Promoted
  • New!
Gen AI Engineer

Gen AI Engineer

VirtualVocationsLowell, Massachusetts, United States
Full-time
A company is looking for a Gen AI Engineer to oversee the technical development of capabilities within the GenAI universe. Key Responsibilities Design and own Python-based features for the Unified...Show moreLast updated: 19 hours ago
  • Promoted
AI Solutions Engineer

AI Solutions Engineer

VirtualVocationsLowell, Massachusetts, United States
Full-time
A company is looking for an AI Solutions Engineer - Remote.Key Responsibilities : Manage the full technical lifecycle of AI-driven solutions from prototype to production Assess and implement AI p...Show moreLast updated: 30+ days ago
  • Promoted
Travel Rad Tech - $2245 / Week

Travel Rad Tech - $2245 / Week

LancesoftSouthbridge, MA, US
Full-time
Lancesoft is seeking an experienced Rad Tech for an exciting Travel Allied job in Southbridge, MA.Shift : 5x8 hr days Start Date : 12 / 22 / 2025 Duration : 26 weeks Pay : $2245 / Week.LanceSoft’s mission ...Show moreLast updated: 2 days ago
  • Promoted
Senior AI Research Engineer

Senior AI Research Engineer

VirtualVocationsWorcester, Massachusetts, United States
Full-time
A company is looking for a Senior AI Research Engineer.Key Responsibilities Architect, implement, and optimize large-scale post-training systems and data processing pipelines Lead the developmen...Show moreLast updated: 2 days ago
  • Promoted
Staff AI Research Scientist

Staff AI Research Scientist

VirtualVocationsLowell, Massachusetts, United States
Full-time
A company is looking for a Staff AI Research Scientist - Evaluation.Key Responsibilities Lead research teams to produce original methodologies for evaluating large language models (LLMs) Develop...Show moreLast updated: 2 days ago
  • Promoted
Lead AI / DevOps Engineer

Lead AI / DevOps Engineer

VirtualVocationsLowell, Massachusetts, United States
Full-time
A company is looking for a Lead AI / DevOps Engineer to drive customer experience strategy through innovation and problem-solving. Key Responsibilities Lead DevOps initiatives in on-prem environment...Show moreLast updated: 1 day ago
  • Promoted
Remote Financial Planner - AI Trainer

Remote Financial Planner - AI Trainer

Data AnnotationFitchburg, Massachusetts
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 27 days ago
  • Promoted
Decision Science Analyst

Decision Science Analyst

VirtualVocationsLowell, Massachusetts, United States
Full-time
A company is looking for a Decision Science Analyst II to drive data-driven decision-making within the organization.Key Responsibilities Apply scientific and quantitative methods to data for acti...Show moreLast updated: 30+ days ago
  • Promoted
Remote Senior Financial Analyst - AI Trainer

Remote Senior Financial Analyst - AI Trainer

Data AnnotationPawtucket, Rhode Island
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 27 days ago
  • Promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data AnnotationPawtucket, Rhode Island
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 27 days ago
  • Promoted
Clinical Testing Pediatric Neuropsychologist - Webster, MA

Clinical Testing Pediatric Neuropsychologist - Webster, MA

LifeStance HealthWebster, MA, US
Full-time
At LifeStance Health, we believe in a truly healthy society where mental and physical healthcare are unified to make lives better. Our mission is to help people lead healthier, more fulfilling lives...Show moreLast updated: 30+ days ago
  • Promoted
Travel MRI Tech - $1,817 per week in Southbridge, MA

Travel MRI Tech - $1,817 per week in Southbridge, MA

AlliedTravelCareersSouthbridge, MA, US
Full-time
AlliedTravelCareers is working with Nationwide Therapy Group to find a qualified MRI Tech in Southbridge, Massachusetts, 01550!. NTG is committed to matching you to the right position and we pride o...Show moreLast updated: 2 days ago
  • Promoted
  • New!
Gen AI Evaluation Analyst

Gen AI Evaluation Analyst

VirtualVocationsLowell, Massachusetts, United States
Full-time
A company is looking for an English Language / Gen AI Specialist.Key Responsibilities : Evaluate outputs generated by LLMs across multiple modalities Assess quality against project-specific criteri...Show moreLast updated: 21 hours ago
  • Promoted
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data AnnotationWoonsocket, Rhode Island
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 27 days ago
  • Promoted
Travel Board Certified Behavioral Analyst (BCBA) - School in Leominster, MA

Travel Board Certified Behavioral Analyst (BCBA) - School in Leominster, MA

AlliedTravelCareersLeominster, MA, US
Full-time
AlliedTravelCareers is working with Aequor to find a qualified BCBA - School in Leominster, Massachusetts, 01453!.Aequor is now hiring a full-time Board Certified Behavior Analyst (BCBA) for the 20...Show moreLast updated: 13 days ago
  • Promoted
Travel Board Certified Behavioral Analyst (BCBA) - School in Franklin Town, MA

Travel Board Certified Behavioral Analyst (BCBA) - School in Franklin Town, MA

AlliedTravelCareersFranklin Town, MA, US
Full-time
AlliedTravelCareers is working with Aequor to find a qualified BCBA - School in Franklin Town, Massachusetts, 02038!.Aequor is now hiring a full-time Board Certified Behavior Analyst (BCBA) for the...Show moreLast updated: 13 days ago
  • Promoted
  • New!
Contract Research Analyst

Contract Research Analyst

VirtualVocationsWorcester, Massachusetts, United States
Full-time
A company is looking for a Contract Research Analyst, Digital Assets to uncover high-potential cryptocurrencies and decentralized applications for long-term investors. Key Responsibilities Produce...Show moreLast updated: 17 hours ago
  • Promoted
Remote Finance Advisor - AI Trainer

Remote Finance Advisor - AI Trainer

Data AnnotationPawtucket, Rhode Island
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 27 days ago
  • Promoted
AI Enablement Engineer

AI Enablement Engineer

VirtualVocationsWorcester, Massachusetts, United States
Full-time
A company is looking for an AI Enablement Engineer.Key Responsibilities Identify and scope high-impact use cases for productivity improvement using advanced AI technologies Deploy and configure ...Show moreLast updated: 9 days ago
  • Promoted
AI Business Analyst

AI Business Analyst

VirtualVocationsWorcester, Massachusetts, United States
Full-time
A company is looking for a Business AI Analyst to join their AI&Automation team.Key Responsibilities Conduct use-case discovery and validation through workshops and root-cause analysis Create ra...Show moreLast updated: 30+ days ago