Remote Generalist - English & Japanese - AI Trainer ($36.16-$36.16 per hour)Mercor • Fresno, California, US
No longer accepting applications
Remote Generalist - English & Japanese - AI Trainer ($36.16-$36.16 per hour)
Mercor • Fresno, California, US
22 days ago
Job type
- Full-time
- Part-time
- Remote
Job description
- Location : Geography restricted to Japan, USA Type : Full-time or Part-time Contract Work
- Fluent Language Skills Required : English & Japanese Why This Role Exists Mercor partners with leading AI teams to improve the quality, usefulness, and reliability of general-purpose conversational AI systems. These systems are used across a wide range of everyday and professional scenarios, and their effectiveness depends on how clearly, accurately, and helpfully they respond to real user questions. This project focuses on evaluating and improving general chat behavior in large language models (LLMs). You will assess model-generated responses across diverse topics, provide high-quality human feedback, and help ensure AI systems communicate in ways that are accurate, well-reasoned, and aligned with human expectations. What You’ll Do - Evaluate LLM-generated responses on their ability to effectively answer user queries - Conduct fact-checking using trusted public sources and external tools - Generate high-quality human evaluation data by annotating response strengths, areas for improvement, and factual inaccuracies - Assess reasoning quality, clarity, tone, and completeness of responses - Ensure model responses align with expected conversational behavior and system guidelines - Apply consistent annotations by following clear taxonomies, benchmarks, and detailed evaluation guidelines Who You Are - You hold a Bachelor’s degree - You are a native speaker or have ILR 5 / primary fluency (C2 on the CEFR scale) in Japanese - You have significant experience using large language models (LLMs) and understand how and why people use them - You have excellent writing skills and can clearly articulate nuanced feedback - You have strong attention to detail and consistently notice subtle issues others may overlook - You are adaptable and comfortable moving across topics, domains, and customer requirements - You have a background or experience in domains requiring structured analytical thinking (e.g., research, policy, analytics, linguistics, engineering) - You have excellent college-level mathematics skills Nice-to-Have Specialties - Prior experience with RLHF, model evaluation, or data annotation work - Experience writing or editing high-quality written content - Experience comparing multiple outputs and making fine-grained qualitative judgments - Familiarity with evaluation rubrics , benchmarks, or quality scoring systems What Success Looks Like - You identify factual inaccuracies, reasoning errors, and communication gaps in model responses - You produce clear, consistent, and reproducible evaluation artifacts - Your feedback leads to measurable improvements in response quality and user experience - Mercor customers trust the quality of their AI systems because your evaluations surface issues before public release Why Join Mercor At Mercor, you’ll work at the frontier of human-in-the-loop AI development, directly shaping how advanced language models behave in the real world. This role offers flexible, remote contract work and the opportunity to contribute meaningfully to AI systems used by millions of people. Contract rates are competitive and aligned with the level of expertise required and scope of work.
Create a job alert for this search
Remote Generalist - English & Japanese - AI Trainer ($36.16-$36.16 per hour) • Fresno, California, US
Similar jobs
Job Reference Id: ORD-196843-MD-CA.Dates Needed: November - Ongoing.Board Certification Required: Yes.A beautiful facility is seeking an anesthesiologist for locum tenens coverage.This is a beautif...Show more
We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...Show more Job Reference Id: ORD-196067-MD-CA.Dates Needed: October working ongoing.Shift Type: Day Shift; In-House Call.Board Certification Required: Yes.A beautiful children's hospital is seeking a pediatri...Show more Job Reference Id: ORD-209167-MD-CA.Dates Needed: Ongoing locum tenens coverage needed.Board Certification Required: Negotiable.This specialized outpatient center focuses on reproductive and procedu...Show more 
Superprof is the leading tutoring platform in the USA, connecting passionate individuals with eager learners.We operate in over 41 countries, making education accessible to everyone, everywhere.Sup...Show more Superprof is the leading tutoring platform in the USA, connecting passionate individuals with eager learners.We operate in over 41 countries, making education accessible to everyone, everywhere.Sup...Show more Superprof is the leading tutoring platform in the USA, connecting passionate individuals with eager learners.We operate in over 41 countries, making education accessible to everyone, everywhere.Sup...Show more Superprof is the leading tutoring platform in the USA, connecting passionate individuals with eager learners.We operate in over 41 countries, making education accessible to everyone, everywhere.Sup...Show more 
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet...Show more
Job Reference Id: ORD- -MD-CA.Dates Needed: March - ongoing.Shift Type: Day Shift; Night Shift; Call.Board Certification Required: Yes.A beautiful state-of-the-art facility is seeking a pediatric a...Show more
AlliedTravelCareers is working with Aya Healthcare to find a qualified Speech Language Pathologist (SLP) in Prather, California, 93651!.Aya Education has an immediate opening for the following posi...Show more AlliedTravelCareers is working with Aya Healthcare to find a qualified Speech Language Pathologist (SLP) in Prather, California, 93651!.Aya Education has an immediate opening for the following posi...Show more Job Reference Id: ORD-210092-MD-CA.Dates Needed: Ongoing locum tenens coverage needed.Board Certification Required: Yes.This large, well-established medical center offers a comprehensive spectrum o...Show more 
In this hourly, remote contractor role, you will review AI-generated English-language responses and/or generate expert language content, evaluating reasoning quality and step-by-step edits while pr...Show more As a Senior C Engineer, you will work remotely on an hourly paid basis to review AI-generated C code, low-level systems designs, and technical explanations, as well as generate high-quality referen...Show more Superprof is the leading tutoring platform in the USA, connecting passionate individuals with eager learners.We operate in over 41 countries, making education accessible to everyone, everywhere.Sup...Show more Job Reference Id: ORD-208025-MD-CA.Dates Needed: Weeks of: 2/16, 2/23, 3/2, 3/9, 3/16, 3/23, 3/30, 4/6, 4/13, 4/20, 4/27, 5/4, 5/11, 5/18, 5/26, 6/1, 6/15, 6/22, 6/29.Board Certification Required: ...Show more Superprof is the leading tutoring platform in the USA, connecting passionate individuals with eager learners.We operate in over 41 countries, making education accessible to everyone, everywhere.Sup...Show more
Anesthesiologist Needed for Locum Tenens Coverage at Facility Outside of San Francisco, California
HealthEcareers - Client • Friant, CA, USA
Full-time
Last updated: 30+ days ago • Promoted
Online Survey Taker. Earn up to $25 per survey. - Remote
Earn Haus • Friant, California, US
Remote
Full-time +1
Last updated: 12 days ago • Promoted
Pediatric Anesthesiologist Needed for Locum Tenens Coverage at Facility in Northern California
HealthEcareers - Client • Friant, CA, USA
Full-time
Last updated: 30+ days ago • Promoted
Anesthesiologist Needed for Locum Tenens Coverage at OR in California
HealthEcareers - Client • Friant, CA, USA
Full-time
Last updated: 30+ days ago • Promoted
Biology Private Tutoring Jobs Fresno
Superprof • Fresno, California, US
Full-time +1
Last updated: 30+ days ago • Promoted
Biology Private Tutoring Jobs Clovis
Superprof • Clovis, California, US
Full-time +1
Last updated: 30+ days ago • Promoted
English Private Tutoring Jobs Fresno
Superprof • Fresno, California, US
Full-time +1
Last updated: 30+ days ago • Promoted
Private Tutoring Jobs Fresno
Superprof • Fresno, California, US
Full-time +1
Last updated: 30+ days ago • Promoted
In-Home Product Tester – No Fees, No Experience, $25-$45/hr
OCPA • Laton, California, us
Part-time +1
Last updated: 30+ days ago • Promoted
Anesthesiologist Needed for Locum Tenens Coverage at Facility in San Diego, California
LocumTenens.com • Friant, None, US
Full-time
Last updated: 18 days ago • Promoted
Travel Speech Language Pathologist (SLP) - $1,897 to $2,079 per week in Prather, CA
AlliedTravelCareers • Prather, CA, US
Full-time +1
Last updated: 30+ days ago • Promoted
Travel Speech Language Pathologist (SLP) - $3,360 to $3,500 per week in Prather, CA
AlliedTravelCareers • Prather, CA, US
Full-time +1
Last updated: 2 days ago • Promoted
Anesthesiologist Needed for Locum Coverage at OR Facility in California
HealthEcareers - Client • Friant, CA, USA
Full-time
Last updated: 8 days ago • Promoted
Remote English Language Expert - AI Trainer
SuperAnnotate • Kingsburg, California, US
Remote
Full-time
Last updated: 30+ days ago
Remote Senior C Engineer - AI Trainer
SuperAnnotate • Kingsburg, California, US
Remote
Full-time
Last updated: 30+ days ago
English Private Tutoring Jobs Clovis
Superprof • Clovis, California, US
Full-time +1
Last updated: 30+ days ago • Promoted
Women's Imager Needed for Locum Tenens Coverage at Outpatient Center in California
HealthEcareers - Client • Friant, CA, USA
Full-time
Last updated: 30+ days ago • Promoted
Private Tutoring Jobs Clovis
Superprof • Clovis, California, US
Full-time +1
Last updated: 30+ days ago • Promoted