Remote Generalist - English & Spanish - AI Trainer ($18.14-$18.14 per hour)Mercor • Colorado Springs, Colorado, US
No longer accepting applications
Remote Generalist - English & Spanish - AI Trainer ($18.14-$18.14 per hour)
Mercor • Colorado Springs, Colorado, US
23 days ago
Job type
- Full-time
- Part-time
- Remote
Job description
- Location : Geography restricted to Mexico, USA Type : Full-time or Part-time Contract Work
- Fluent Language Skills Required : English & Spanish Why This Role Exists Mercor partners with leading AI teams to improve the quality, usefulness, and reliability of general-purpose conversational AI systems. These systems are used across a wide range of everyday and professional scenarios, and their effectiveness depends on how clearly, accurately, and helpfully they respond to real user questions. This project focuses on evaluating and improving general chat behavior in large language models (LLMs). You will assess model-generated responses across diverse topics, provide high-quality human feedback, and help ensure AI systems communicate in ways that are accurate, well-reasoned, and aligned with human expectations. What You’ll Do - Evaluate LLM-generated responses on their ability to effectively answer user queries - Conduct fact-checking using trusted public sources and external tools - Generate high-quality human evaluation data by annotating response strengths, areas for improvement, and factual inaccuracies - Assess reasoning quality, clarity, tone, and completeness of responses - Ensure model responses align with expected conversational behavior and system guidelines - Apply consistent annotations by following clear taxonomies, benchmarks, and detailed evaluation guidelines Who You Are - You hold a Bachelor’s degree - You are a native speaker or have ILR 5 / primary fluency (C2 on the CEFR scale) in Spanish - You have significant experience using large language models (LLMs) and understand how and why people use them - You have excellent writing skills and can clearly articulate nuanced feedback - You have strong attention to detail and consistently notice subtle issues others may overlook - You are adaptable and comfortable moving across topics, domains, and customer requirements - You have a background or experience in domains requiring structured analytical thinking (e.g., research, policy, analytics, linguistics, engineering) - You have excellent college-level mathematics skills Nice-to-Have Specialties - Prior experience with RLHF, model evaluation, or data annotation work - Experience writing or editing high-quality written content - Experience comparing multiple outputs and making fine-grained qualitative judgments - Familiarity with evaluation rubrics , benchmarks, or quality scoring systems What Success Looks Like - You identify factual inaccuracies, reasoning errors, and communication gaps in model responses - You produce clear, consistent, and reproducible evaluation artifacts - Your feedback leads to measurable improvements in response quality and user experience - Mercor customers trust the quality of their AI systems because your evaluations surface issues before public release Why Join Mercor At Mercor, you’ll work at the frontier of human-in-the-loop AI development, directly shaping how advanced language models behave in the real world. This role offers flexible, remote contract work and the opportunity to contribute meaningfully to AI systems used by millions of people. Contract rates are competitive and aligned with the level of expertise required and scope of work.
Create a job alert for this search
Remote Generalist - English & Spanish - AI Trainer ($18.14-$18.14 per hour) • Colorado Springs, Colorado, US
Similar jobs
Superprof is the leading tutoring platform in the USA, connecting passionate individuals with eager learners.We operate in over 41 countries, making education accessible to everyone, everywhere.Sup...Show more
Animal Emergency & Specialty Center (AESC).We are a 24/7 Emergency Care Veterinary Hospital with 7 different Specialties.Team is growing, and we are seeking motivated, positive and compassionate in...Show more
Become a Surrogate with Legend Family Surrogacy and make a meaningful difference in the lives of families across the country.If you’ve had at least one healthy pregnancy and meet our basic health q...Show more
We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet...Show more
We're looking for candidates with great customer service skills to fill our Remote Customer Service role!.This role is entirely remote and offers full-time/Part time hours with flexibility.We are r...Show more
Compensated Surrogacy Opportunity - Make a Life Changing Impact and Earn $60,000+.Newborn Advantage Surrogacy is seeking qualified women to become gestational surrogates and help intended parents g...Show more
Do you want to become a surrogate? .We are now offering a sign on bonus to all qualified and matched surrogates that sign contracts.The first step is to fill out our surrogate application.A fertili...Show more
As an hourly paid, fully remote Go Engineer for AI Data Training, you will review AI-generated Go code and explanations or generate your own, evaluate the reasoning quality and step-by-step problem...Show more
Amelia Developer ( Voice & Chat ) Rate: $60/hr - $65/hr Key Skills & Experience to Highlight • Conversational AI Platform Experience: Direct experience with Amelia (formerly IPsoft) is pr...Show more Superprof is the leading tutoring platform in the USA, connecting passionate individuals with eager learners.We operate in over 41 countries, making education accessible to everyone, everywhere.Sup...Show more In this hourly, remote contractor role, you will review AI-generated English-language responses and/or generate expert language content, evaluating reasoning quality and step-by-step edits while pr...Show more 
AnnuallyLocation :Statewide, COJob Type :Full TimeJob Number :(EGB93665 (09 / 25)Department :Governor's Office of Information TechnologyOpening Date :09 / 26 / 2025Closing Date :10 / 7 / 2025 11 :5...Show more
AlliedTravelCareers is working with Aya Healthcare to find a qualified Speech Language Pathologist (SLP) in Elizabeth, Colorado, 80107!.Aya Education has an immediate opening for the following posi...Show more
Becoming a surrogate mother is one of the greatest gifts of life!.Ivy Surrogacy is a third-party reproductive agency for parents all over the world seeking.At Ivy Surrogacy, we genuinely believe we...Show more
Become a Surrogate with Capital Surrogacy.Capital Surrogacy is seeking women interested in becoming gestational surrogates (gestational carriers) to help another family grow through pregnancy and c...Show more Some locum assignments can be as short as a day, others, years.Some are far from home, others are local.Whatever it is you're looking for, we offer true opportunities, not just postings.CompHealth ...Show more 
Earn up to $90K as a Nodal surrogate.Many people choose surrogacy to not only help intended parents, but change their own lives, too.Surrogates have been able to use their compensation to buy a hou...Show more
English Private Tutoring Jobs Colorado Springs
Superprof • Colorado Springs, Colorado, US
Full-time +1
Last updated: 30+ days ago • Promoted
Veterinary Surgery Technician, AESC
Ethos Veterinary Health • Parker, Colorado, United States, 80134
Full-time
Quick Apply
Last updated: 16 days ago • Promoted
Have You Had a Healthy Pregnancy? Learn About a Paid Opportunity
Legend Family Surrogacy • The Pinery, CO, US
Full-time
Last updated: 7 days ago • Promoted
Online Survey Taker. Earn up to $25 per survey. - Remote
Earn Haus • Colorado Springs, CO, US
Remote
Full-time +1
Last updated: 30+ days ago • Promoted
Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands
OCPA • The Pinery, Colorado, us
Remote
Part-time +1
Last updated: 30+ days ago • Promoted
Remote Benefits Advisor (50k-90k per year)
Professional Careers • The Pinery, Colorado
Remote
Full-time +1
Last updated: 30+ days ago • Promoted
Compensated Surrogacy Opportunity - Make a Life Changing Impact and Earn $60,000+
Newborn Advantage Surrogacy • The Pinery, CO, US
Full-time
Last updated: 30+ days ago • Promoted
Women Under 40: Earn $35,000–$40,000 as a Surrogate
Prime Genetics • The Pinery, None, US
Full-time
Last updated: 26 days ago • Promoted
Remote Go Engineer - AI Trainer
SuperAnnotate • The Pinery, Colorado, US
Remote
Full-time
Last updated: 30+ days ago
Amelia Developer
Purple Drive • Colorado Springs, CO, Colorado, USA
Full-time
Last updated: 12 days ago
Spanish Private Tutoring Jobs Colorado Springs
Superprof • Colorado Springs, Colorado, US
Full-time +1
Last updated: 30+ days ago • Promoted
Remote English Language Expert - AI Trainer
SuperAnnotate • The Pinery, Colorado, US
Remote
Full-time
Last updated: 30+ days ago
AI Architect (Remote from anywhere in Colorado)
State of Colorado • Colorado Springs, CO, United States
Remote
Full-time
Last updated: 20 days ago • Promoted
Travel Speech Language Pathologist (SLP) - $2,359 to $2,509 per week in Elizabeth, CO
AlliedTravelCareers • Elizabeth, CO, US
Full-time +1
Last updated: 18 days ago • Promoted
Earn $50,000–$100,000 – Must Have Healthy Prior Delivery
Ivy Surrogacy • Elizabeth, CO, US
Full-time +1
Last updated: 13 days ago • Promoted
Surrogacy Opportunity with Competitive Surrogate Compensation
Capital Surrogacy • The Pinery, CO, US
Full-time +1
Last updated: 4 days ago • Promoted
Travel Physical Therapist (PT) - $1,749 to $3,413 per week in Fountain, CO
AlliedTravelCareers • Fountain, CO, US
Full-time
Last updated: 28 days ago • Promoted
How Much Do Surrogates Make?
Nodal Surrogacy • The Pinery, CO, US
Full-time
Last updated: 23 days ago • Promoted