Talent.com
Mercor
Conversational AI Analyst - Fully RemoteMercor • California, United States
Conversational AI Analyst - Fully Remote

Conversational AI Analyst - Fully Remote

Mercor • California, United States
30+ days ago
Salary
$23.00 hourly
Job type
  • Full-time
  • Part-time
  • Remote
Job description
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Language Model Evaluator Type: Full-time or Part-time Contract Work Compensation: $23/hour Location: Geography restricted to Egypt, Saudi Arabia, UAE, USA Role Responsibilities Evaluate LLM-generated responses on their ability to effectively answer user queries. Conduct fact-checking using trusted public sources and external tools . Generate high-quality human evaluation data by annotating response strengths, areas for improvement, and factual inaccuracies. Assess reasoning quality, clarity, tone, and completeness of responses. Ensure model responses align with expected conversational behavior and system guidelines. Apply consistent annotations by following clear taxonomies, benchmarks, and detailed evaluation guidelines. Qualifications Must-Have Bachelor’s degree Native speaker or ILR 5/primary fluency (C2 on the CEFR scale) in Arabic Significant experience using large language models (LLMs) Excellent writing skills Strong attention to detail Adaptable and comfortable moving across topics, domains, and customer requirements Background or experience in domains requiring structured analytical thinking Excellent college-level mathematics skills Preferred Prior experience with RLHF, model evaluation, or data annotation work Experience writing or editing high-quality written content Experience comparing multiple outputs and making fine-grained qualitative judgments Familiarity with evaluation rubrics , benchmarks, or quality scoring systems Application Process (Takes 20–30 mins to complete) Upload resume AI interview based on your resume Submit form Resources & Support For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome For any help or support, reach out to: support@mercor.com PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Create a job alert for this search

Conversational AI Analyst - Fully Remote • California, United States

Similar jobs

Consumer Insights Analyst

Earn HausFarmersville, California, United States
Full-time +1

We are urgently seeking people interested in taking market research studies for well known brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Ear... Show more

 • Promoted

Data Analyst (remote)

FinitePiedra, CA, United States
Remote
Full-time

Job briefWe are looking for a passionate certified Data Analyst.The successful candidate will turn data into information information into insight and insight into business decisions.Data analyst re... Show more

 • Promoted

Clinical Supervisor (Remote)

MindDivers LLCVisalia, CA, United States
Remote
Full-time

Were hiring a Clinical Supervisor to lead day-to-day clinical operations, keep care safe and compliant, and grow our clinicians.Youll balance people leadership with execution :timely notes, strong ... Show more

 • Promoted

Information Technology Professional

US NavyAuberry, CA, US
Full-time

Information Technology Professional (IT/CTN/IS).Information Systems Technicians, Cryptologic Technician Networks, and Intelligence Specialists keep the Fleet connected, informed, and secure by oper... Show more

 • Promoted

Oceanographer/Meteorologist

US NavyAuberry, CA, US
Full-time

Oceanography (OCEANO) Officers, also called METOC, are the Navy's geophysical experts who understand and apply all facets of meteorology, oceanography, hydrography, bathymetry, geophysics, and prec... Show more

 • Promoted

Remote Product Tester - Flexible Studies

BuzzTestersVisalia, CA
Remote
Full-time

Earn up to $400/week, depending on the number and type of studies you complete.Share honest feedback on products and services from independent brands.Assignments include short online surveys (10–20... Show more

 • Promoted

Super urgent position for AI Engineer with Observability tool (Langfuse):: Remote

E-Solutions IncTollhouse, CA, United States
Remote
Full-time

Job Type :ContractDuration :6M+Work type :Remote (US-based)Time Zone :CSTKey skill :Observability tool (Langfuse)About the Role :The ideal candidate will have strong software engineering fundamenta... Show more

 • Promoted

QA Analyst (AI Testing)

Signature ConsultantsUSA, California, CA: 100% Onsite
$55.00 hourly
Full-time
Quick Apply

Direct In-Person Interview Required!.Direct In-Person Interview Required!.Hiring a QA Contractor for modern AI testing workstreams.Manual + automation, Python/JS/SQL.Run manual and automated AI tes... Show more

Market Research Associate - No Experience

Clubshop | USFarmersville, California
Full-time

Discover The System Surveoo That’s Helping Newbies Earn Daily.Turn your free time into daily earnings by answering simple surveys.No product or tech skills needed.Join For Free And Start Earn... Show more

WORK AT HOME DATA ENTRY / PART TIME - ADMINISTRATIVE ASSISTANT - REMOTE

Remote Work From Home - Flexible Start DateTollhouse, CA, United States
Remote
Full-time +1

Remote Work From Home - Data Entry / Typing - Customer Service Representative Part Time - Entry Level - Start Now - 100% Fully Remote - Remote Data Entry Role / Data Entry ProcessesLooking for a wa... Show more

 • Promoted

Survey Taker: Earn up to $25 per survey (Remote)

Earn HausFarmersville, CA, US
Remote
Full-time +1

Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion.You will help influence brand decisions on se... Show more

 • Promoted

Online Survey Taker. Earn up to $25 per survey. - Remote

Earn HausTulare, CA, US
Remote
Full-time +1

We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up... Show more

 • Promoted

Remote Data Entry & Survey Job – Earn Extra Income Online, Up to $25 Per Survey

Earn HausVisalia, CA, US
Remote
Full-time +1

We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up... Show more

 • Promoted

Extra Income Online – Remote Survey Taker Job Up to $25 Per Survey

Earn HausVisalia, CA, US
Remote
Full-time +1

We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up... Show more

 • Promoted

Flexible remote AI work. Your schedule. Paid weekly, straight to your bank account.

Meridian.aiDinuba, CA, US
Remote
Full-time

Review and label digital content including text, images, and documents.Every task you complete helps improve how technology interprets information and performs in practical settings.Detail-oriented... Show more

 • Promoted

Border Patrol Agent (BPA) Entry Level - New Hire Sign-On and Retention Incentives

U.S. Customs and Border ProtectionAuberry, CA, US
Full-time

February 2026 Update GL-5/7 grade levels.Border Patrol Agent (BPA) – in the Federal Security and Public Safety Sector (Entry Level).If you’re looking for “just a job,” then stop reading right now.B... Show more

 • Promoted

Online Survey Participant: Work Remote and Earn Up To $25 Per Survey

Earn HausTulare, CA, US
Remote
Full-time +1

Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion.You will help influence brand decisions on se... Show more

 • Promoted

Remote Online Survey Taker – Earn Up to $25 Per Survey

Earn HausTulare, CA, US
Remote
Full-time +1

We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up... Show more

 • Promoted

Border Patrol Agent (BPA) Experienced - New Hire Sign-On and Retention Incentives

U.S. Customs and Border ProtectionAuberry, CA, US
Full-time

Border Patrol Agent (BPA) – in the Federal Security and Public Safety Sector Experienced (GL-9 GS-11).You love protecting your community and doing your part to keep our nation safe.But maybe you’re... Show more

 • Promoted

A Calling Like No Other

U.S. Marine CorpsAuberry, CA, US
Full-time

Those who put others before themselves.Who can rise up in the face of danger.This country we call home has been our haven of safety for 250 years.And it's up to us to keep it that way.There's a goo... Show more