Talent.com
Mercor
Remote Korean Audio Generalist Evaluator Expert - AI Trainer ($50-$50 per hour)Mercor • Brockton, Massachusetts, US
No longer accepting applications
Remote Korean Audio Generalist Evaluator Expert - AI Trainer ($50-$50 per hour)

Remote Korean Audio Generalist Evaluator Expert - AI Trainer ($50-$50 per hour)

Mercor • Brockton, Massachusetts, US
30+ days ago
Job type
  • Full-time
  • Remote
Job description
Mercor is seeking a **Korean Audio Generalist Evaluator Expert** to contribute to a high-impact audio AI research project with a leading research lab. In this role, you will work on **transcription, annotation, and evaluation tasks** that help train and benchmark advanced language models. This is a **short-term, structured engagement** ideal for candidates with strong academic or analytical backgrounds who are fluent in **Korean and English** and enjoy translating complex audio and visual information into precise, well-structured text. * * * ## **Job Responsibilities** ### **Transcribe and Optimize Audio & Video** - Listen to, analyze, and transcribe audio and video content in **Korean**, following detailed constraints and instructions. - Produce high-quality written outputs, with supporting work in **English when required**. - Ensure clarity, accuracy, and strict adherence to formatting and stylistic guidelines. ### **Define and Document Evaluation Standards** - Establish clear expectations for correct and high-quality responses in general consumer audio contexts. - Develop detailed **evaluation rubrics and grading guidelines** in Korean and English. - Document standards to ensure consistency across reviewers and model evaluations. ### **Conduct Model Testing and Grading** - Run prompts through language models and assess generated outputs. - Evaluate responses against predefined criteria for **accuracy, completeness, and instructional clarity**. ### **Support Benchmarking and Quality Assurance** - Participate in QA and review cycles to ensure tasks, rubrics, and outputs meet **Mercor’s quality bar**. - Maintain consistency and reliability before datasets are integrated into official benchmarks. - Collaborate with project leads to resolve ambiguities and improve task design. * * * ## **Minimum Qualifications** - Strong writing, editing, and critical thinking skills. - Ability to work independently, manage time effectively, and meet deadlines. - **Fluency in Korean and English** (spoken and written). - Available to commit **10–20 hours per week**. * * * ## **Preferred Qualifications** - College students or recent graduates. - Background in linguistics, humanities, social sciences, or technical fields. - Prior experience with **transcription, annotation, evaluation, or research workflows**. - Interest in AI, language models, or applied research environments. * * * ## **Application & Onboarding Process** - Complete a short AI-led interview (approximately **15 minutes**). - If selected, you will be onboarded and invited to begin project work. * * * ## **Additional Role Details** - Work in a **structured, goal-oriented project environment** with clear tooling, guidelines, and support. - Gain hands-on exposure to **real-world AI research and evaluation workflows**.
Create a job alert for this search

Remote Korean Audio Generalist Evaluator Expert - AI Trainer ($50-$50 per hour) • Brockton, Massachusetts, US

Similar jobs

Biology Expert - Ai Research

YO IT ConsultingBoston, MA, United States
Full-time

Collaborating with a leading AI research lab on a project to advance frontier biology problem‑solving.We are looking for biology experts who hold a.International Biology Olympiad (IBO).The goal of ... Show more

 • Promoted • New!

Lead AI Observability & Evaluation Platform Engineer

LangChainBoston, MA, United States
Full-time

LangChain is seeking a Principal/Lead Software Engineer based in Boston to drive the technical direction of their core platform.You will lead architectural decisions, mentor engineers, and ensure s... Show more

 • Promoted

Audiologist

TradeJobsWorkForce02770 Rochester, MA, US
Full-time

Provides treatments by cleaning ear canal; fitting hearing aides and other assistive devices; conducting auditory training and instruction in speech and lip reading; fitting and tuning cochlear pla... Show more

 • Promoted

Korean Document Review Attorney

CGS Federal (Contact Government Services)Boston, MA, United States
Full-time

Familiarity with document review workflows (Privilege/Responsiveness Review, Redactions, Conceptual Searching, First and Second Review, etc.Experience with electronic document review technology (Re... Show more

 • Promoted

Biology AI Evaluator (Remote, Hourly Contractor)

CNTXT AIBoston, Massachusetts, US
Remote
Full-time

In this remote, hourly contractor role, you will evaluate AI-generated biology content to help improve accuracy, reliability, and clarity.Evaluating AI-generated responses for biological accuracy, ... Show more

Cryptologic Linguist - Army

U.S. ArmyBrockton, Massachusetts, United States
$15.00–$18.00 hourly
Full-time +1
Quick Apply

A Signals Intelligence (SIGINT) Voice Interceptor locates the enemy by identifying foreign language communications and provides the commander with real-time intelligence.Employ high-tech intercept ... Show more

Remote Corporate Development Associate - AI Trainer ($50-$60 per hour)

Data AnnotationQuincy, Massachusetts
$50.00 hourly
Remote
Full-time +1

DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own&nbsp... Show more

 • Promoted

Remote Remote AI Video Data Contributor (LATAM)

Micro1New Bedford, Massachusetts, US
Remote
Full-time

Remote AI Video Data Contributor (LATAM).Real-world expertise is turned into training data, evaluations, and feedback loops that improve how models perform.AI labs and enterprises use micro1 to tra... Show more

 • Promoted • New!

Remote Data-Video Generalist (US)

Micro1New Bedford, Massachusetts, US
$13.00 hourly
Remote
Full-time

IMU (Inertial Measurement Unit).Real-world expertise is turned into training data, evaluations, and feedback loops that improve how models perform.AI labs and enterprises use micro1 to train models... Show more

 • Promoted

Audiologist - Outpatient

Southcoast HealthFall River, Massachusetts, United States
Full-time

Join Southcoast Health, where your future is as promising as the care we provide.Our commitment to each other, our patients, and our community is more than a mission - it's our way of life, and you... Show more

 • Promoted

Remote Biologist for AI Research Projects | Flexible Hours

MercorRevere, MA, United States
Remote
Full-time

Join our Biologist Expert Network to connect with leading AI labs and companies seeking your expertise.This is an open application for future contract opportunities that match your background and i... Show more

 • Promoted • New!

Remote Manufacturing - Automotive (Mechanical Engineering) Expert - AI Trainer ($45-$65 per hour)

MercorBrockton, MA, United States
Remote
Full-time

Mercor is partnering with leading AI labs on Project Atlas — an initiative to build realistic enterprise environments that frontier AI agents are trained and evaluated in.We're seeking experienced ... Show more

 • Promoted • New!

Vision Room Group Lead

PrecixNew Bedford, MA, US
Full-time
Quick Apply

This position is responsible for operating the automated the vision inspection systems and directing their support staff while ensuring that procedures and Management direction are always followed.... Show more

Remote Biology Specialist for AI Model Evaluation

TuringBoston, MA, United States
Remote
Full-time

A leading AI company is seeking a Biology Specialist to help fine-tune large language models.Ideal candidates will be pursuing or hold a Ph.Biology or a related field and possess strong research sk... Show more

 • Promoted • New!

Senior Data Architect for AI Model Evaluation (Remote)

YO IT ConsultingBoston, MA, United States
Remote
Full-time

YO IT Consulting is looking for a Senior Data Architect to work remotely in Boston, Massachusetts.The role involves evaluating AI systems, challenging advanced language models, and translating busi... Show more

 • Promoted

Remote Canadian French Audio Description Writer Job at 3Play Media in Boston

3Play MediaBoston, MA, United States
Remote
Full-time

A media accessibility provider is seeking a Freelance Language Expert Audio Describer to create engaging audio descriptions for video content.This fully remote role requires fluency in Canadian Fre... Show more

 • Promoted

Remote Biology AI Evaluator & Accuracy Auditor

CNTXT AIBoston, MA, United States
Remote
Full-time

CNTXT AI is seeking a remote hourly contractor to evaluate AI-generated biology content.The role involves assessing accuracy, identifying errors in methodology, rating AI responses, and developing ... Show more

 • Promoted • New!

PEDIATRIC SPEECH LANGUAGE PATHOLOGIST

South Shore HealthCanton, Massachusetts, United States
Full-time

The Outpatient Pediatric Speech-Language Pathologist is responsible for the evaluation and treatment of pediatric patients with a variety of pediatric communication disorders within a hospital-base... Show more