Talent.com
Gen AI Evaluation Analyst

Gen AI Evaluation Analyst

VirtualVocationsJackson Heights, New York, United States
17 hours ago
Job type
  • Full-time
Job description

A company is looking for an English Language / Gen AI Specialist.

Key Responsibilities :

Evaluate outputs generated by LLMs across multiple modalities

Assess quality against project-specific criteria such as correctness and coherence

Provide detailed written feedback and collaborate with Project Managers to meet benchmarks

Required Qualifications :

Bachelor's degree / diploma or equivalent educational qualification

1+ years of experience in data annotation, LLM evaluation, or related AI / ML domains

Experience with data annotation tools and software platforms

Strong understanding of language and multimodal communication

Ability to adapt quickly to changing project directions

Create a job alert for this search

Evaluation Analyst • Jackson Heights, New York, United States

Related jobs
  • Promoted
  • New!
English Writing and Content Reviewing Expertise Sought for AI Training

English Writing and Content Reviewing Expertise Sought for AI Training

OutlierStamford, CT, United States
Full-time
Earn up to $35 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...Show moreLast updated: 9 hours ago
  • Promoted
Senior AI Research Engineer

Senior AI Research Engineer

VirtualVocationsYonkers, New York, United States
Full-time
A company is looking for a Senior AI Research Engineer.Key Responsibilities Architect, implement, and optimize large-scale post-training systems and data processing pipelines Lead the developmen...Show moreLast updated: 20 days ago
  • Promoted
AI Business Analyst

AI Business Analyst

VirtualVocationsPaterson, New Jersey, United States
Full-time
A company is looking for a Business AI Analyst to join their AI&Automation team.Key Responsibilities Conduct use-case discovery and validation through workshops and root-cause analysis Create ra...Show moreLast updated: 30+ days ago
  • Promoted
Remote Senior Financial Analyst - AI Trainer

Remote Senior Financial Analyst - AI Trainer

Data AnnotationWhite Plains, New York
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 27 days ago
  • Promoted
  • New!
Remote AI Writing Evaluator

Remote AI Writing Evaluator

OutlierStamford, CT, United States
Remote
Full-time
Earn up to $35 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...Show moreLast updated: 9 hours ago
  • Promoted
AI Solutions Engineer

AI Solutions Engineer

VirtualVocationsElizabeth, New Jersey, United States
Full-time
A company is looking for an AI Solutions Engineer - Remote.Key Responsibilities : Manage the full technical lifecycle of AI-driven solutions from prototype to production Assess and implement AI p...Show moreLast updated: 30+ days ago
  • Promoted
Prompt Engineer and Data Analyst

Prompt Engineer and Data Analyst

VirtualVocationsYonkers, New York, United States
Full-time
A company is looking for a Prompt Engineer and Data Analyst.Key Responsibilities Design, test, and refine prompts to enhance AI model capabilities Create and review diverse datasets while perfor...Show moreLast updated: 2 days ago
  • Promoted
AI Engineer

AI Engineer

VirtualVocationsYonkers, New York, United States
Full-time
A company is looking for an AI Engineer to lead the development of scalable real-time applications utilizing AI / ML models. Key Responsibilities Understand customer challenges and integrate AI capa...Show moreLast updated: 30+ days ago
  • Promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data AnnotationWhite Plains, New York
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 27 days ago
  • Promoted
  • New!
Gen AI Engineer

Gen AI Engineer

VirtualVocationsFlushing, New York, United States
Full-time
A company is looking for a Gen AI Engineer to oversee the technical development of capabilities within the GenAI universe. Key Responsibilities Design and own Python-based features for the Unified...Show moreLast updated: 15 hours ago
  • Promoted
  • New!
Contract Research Analyst

Contract Research Analyst

VirtualVocationsYonkers, New York, United States
Full-time
A company is looking for a Contract Research Analyst, Digital Assets to uncover high-potential cryptocurrencies and decentralized applications for long-term investors. Key Responsibilities Produce...Show moreLast updated: 13 hours ago
  • Promoted
  • New!
Analytics Specialist, Engagement, Retention & Acquisition Analytics

Analytics Specialist, Engagement, Retention & Acquisition Analytics

Amazon.comNew Brunswick, NJ, USA
Full-time
At Audible, we believe stories have the power to transform lives.It’s why we work with some of the world’s leading creators to produce and share audio storytelling with our millions of global liste...Show moreLast updated: 5 hours ago
  • Promoted
Head of Engagement Management, Gen AI

Head of Engagement Management, Gen AI

Scale AI, Inc.New York, NY, United States
Full-time
Scale's customer base is growing exponentially, and you will be on the front lines of ensuring that these customers become passionate, lifelong Scale partners. As a member of our Engagement Manageme...Show moreLast updated: 30+ days ago
  • Promoted
Staff AI Research Scientist

Staff AI Research Scientist

VirtualVocationsJamaica, New York, United States
Full-time
A company is looking for a Staff AI Research Scientist - Evaluation.Key Responsibilities Lead research teams to produce original methodologies for evaluating large language models (LLMs) Develop...Show moreLast updated: 2 days ago
  • Promoted
Lead AI / DevOps Engineer

Lead AI / DevOps Engineer

VirtualVocationsJamaica, New York, United States
Full-time
A company is looking for a Lead AI / DevOps Engineer to drive customer experience strategy through innovation and problem-solving. Key Responsibilities Lead DevOps initiatives in on-prem environment...Show moreLast updated: 1 day ago
  • Promoted
  • New!
Gen AI Evaluation Analyst

Gen AI Evaluation Analyst

VirtualVocationsYonkers, New York, United States
Full-time
A company is looking for an English Language / Gen AI Specialist.Key Responsibilities : Evaluate outputs generated by LLMs across multiple modalities Assess quality against project-specific criteri...Show moreLast updated: 17 hours ago
  • Promoted
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data AnnotationSayreville, New Jersey
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 27 days ago
  • Promoted
Applied AI Engineer, Enterprise GenAI

Applied AI Engineer, Enterprise GenAI

Scale AI, Inc.New York, NY, United States
Full-time
AI is becoming vitally important in every function of our society.At Scale, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, ...Show moreLast updated: 30+ days ago
  • Promoted
AI Enablement Engineer

AI Enablement Engineer

VirtualVocationsPaterson, New Jersey, United States
Full-time
A company is looking for an AI Enablement Engineer.Key Responsibilities Identify and scope high-impact use cases for productivity improvement using advanced AI technologies Deploy and configure ...Show moreLast updated: 22 days ago
  • Promoted
Decision Science Analyst

Decision Science Analyst

VirtualVocationsFlushing, New York, United States
Full-time
A company is looking for a Decision Science Analyst II to drive data-driven decision-making within the organization.Key Responsibilities Apply scientific and quantitative methods to data for acti...Show moreLast updated: 1 day ago