Talent.com
Mercor is hiring : Audio Evaluation Expert - Fully Remote in California

Mercor is hiring : Audio Evaluation Expert - Fully Remote in California

MediabistroCalifornia, MO, United States
2 days ago
Job type
  • Full-time
  • Remote
Job description

1 day ago Be among the first 25 applicants

This range is provided by Mercor. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$35.00 / hr - $40.00 / hr

Mercor Overview

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D\'Angelo, Larry Summers, and Jack Dorsey.

Role Overview

  • Position : Writing Expert – Freelance, Remote
  • Commitment : 20 hours per week, Duration : 1 month
  • Contribute to a high-impact audio AI research project. Author prompt–golden answer pairs for training and evaluating language models.

Responsibilities

  • Design and Optimize Prompts : Create detailed audio prompts with multiple constraints and instructions.
  • Define and Document Evaluation Standards : Establish high-level expectations for correct responses in general audio consumer contexts, and develop a comprehensive rubric.
  • Conduct Model Testing and Grading : Run prompts through models and assess preliminary outputs against expectations.
  • Support Benchmarking and Quality Assurance : Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.
  • Requirements / Qualifications

  • Must-Have : BS or BA from a reputable institution, completed or in progress
  • Strong writing and critical thinking skills
  • Ability to work independently and meet deadlines
  • Significant familiarity with ChatGPT or similar tools for personal decision-making or hobbies
  • Preferred Qualifications

  • 2+ years of experience in teaching or research
  • Engagement Details

  • Remote and asynchronous role
  • 20 hours per week commitment
  • Duration : 1 month
  • Application Process

  • Complete an AI-led interview (about 15 minutes)
  • Complete a 45-minute written assessment to guide you through writing rubrics
  • If selected, you will be invited to work on the project
  • Resources & Support

  • For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome
  • For any help or support, reach out to : support@mercor.com
  • PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

    #J-18808-Ljbffr

    Create a job alert for this search

    Is Hiring Evaluation • California, MO, United States

    Related jobs
    • Promoted
    Flexible Schedule - Deliver with Uber Eats

    Flexible Schedule - Deliver with Uber Eats

    Uber eatsSmithton, MO, United States
    Full-time +1
    Delivering with Uber is an alternative to a part-time or full-time job and can get you earning cash quickly.Delivering with Uber allows you to earn quick cash while maintaining the flexibility your...Show moreLast updated: 3 days ago
    • Promoted
    Marine Interdiction Agent

    Marine Interdiction Agent

    U.S. Customs and Border ProtectionSaint Elizabeth, MO, United States
    Full-time
    Air and Marine Operations (AMO), a component of U.Customs and Border Protection (CBP) offers those with Merchant Mariner Credentials the exceptional opportunity of a career in law enforcement worki...Show moreLast updated: 2 days ago
    • Promoted
    Remote Finance Advisor - AI Trainer

    Remote Finance Advisor - AI Trainer

    Data AnnotationColumbia, Missouri
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 30+ days ago
    • Promoted
    Telemedicine Physician

    Telemedicine Physician

    QuickMDBoonville, MO, US
    Full-time
    QuickMD is a leading telemedicine provider, delivering high-quality virtual care across 44 states.Since our founding in 2019, we have helped more than 100,000 patients access essential medical trea...Show moreLast updated: 30+ days ago
    • Promoted
    Travel Physical Therapist (PT) - $2,058 per week in Boonville, MO

    Travel Physical Therapist (PT) - $2,058 per week in Boonville, MO

    AlliedTravelCareersBoonville, MO, US
    Full-time
    AlliedTravelCareers is working with Centra Healthcare Solutions to find a qualified Physical Therapist (PT) in Boonville, Missouri, 65233!. Centra Healthcare Solutions is seeking an experienced Phys...Show moreLast updated: 30+ days ago
    • Promoted
    Border Patrol Agent

    Border Patrol Agent

    U.S. Customs and Border ProtectionSmithton, MO, United States
    Full-time
    Customs and Border Protection (CBP) offers those interested in a career in law enforcement an exceptional opportunity to work with an elite team of highly trained professionals whose camaraderie, p...Show moreLast updated: 30+ days ago
    • Promoted
    Neurosurgeon Needed for Locum Tenens Coverage at Facility in Southern Missouri

    Neurosurgeon Needed for Locum Tenens Coverage at Facility in Southern Missouri

    HealthEcareers - ClientEugene, MO, USA
    Full-time
    Job Reference Id : ORD-202745-MD-MO.Dates Needed : 7-10 days / month - Ongoing.Assignment Type : Inpatient; OR; ER.Board Certification Required : Yes. A hospital is seeking a Neurosurgeon for locum te...Show moreLast updated: 3 days ago
    • Promoted
    Food Delivery with Uber Eats

    Food Delivery with Uber Eats

    Uber eatsSmithton, MO, United States
    Full-time +1
    Delivering with Uber is an alternative to a part-time or full-time job and can get you earning cash quickly.Delivering with Uber allows you to earn quick cash while maintaining the flexibility your...Show moreLast updated: 3 days ago
    • Promoted
    Remote Commercial Banking Analyst - AI Trainer

    Remote Commercial Banking Analyst - AI Trainer

    Data AnnotationColumbia, Missouri
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 30+ days ago
    • Promoted
    Travel Physical Therapist (PT) in Boonville, MO

    Travel Physical Therapist (PT) in Boonville, MO

    AlliedTravelCareersBoonville, MO, US
    Full-time
    AlliedTravelCareers is working with Core Medical Group to find a qualified Physical Therapist (PT) in Boonville, Missouri, 65233!. Client in MO seeking Physical Therapist.We are looking for a health...Show moreLast updated: 30+ days ago
    • Promoted
    Air Interdiction Agent

    Air Interdiction Agent

    U.S. Customs and Border ProtectionPilot Grove, MO, United States
    Full-time
    Pilot CBP Air Interdiction Agent.Air and Marine Operations (AMO), a component of U.Customs and Border Protection (CBP), offers skilled Pilots interested in law enforcement an opportunity to work wi...Show moreLast updated: 2 days ago
    Appen is hiring : Audio Quality Evaluation (French - US) in California

    Appen is hiring : Audio Quality Evaluation (French - US) in California

    MediabistroCalifornia, MO, United States
    Full-time
    Audio Quality Evaluation (French - US).Be the Voice of the Future – Join Project Lotus Today.Are you a native French speaker living in the U. Help shape the future of wearable tech by evaluating sma...Show moreLast updated: 2 days ago
    Audio Engineer | Upto $20 / hr Remote Job at Mercor in California

    Audio Engineer | Upto $20 / hr Remote Job at Mercor in California

    MediabistroCalifornia, MO, United States
    Remote
    Full-time
    Audio Engineer | Upto $20 / hr Remote.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Headquartered in San Franci...Show moreLast updated: 2 days ago
    • Promoted
    Travel Physical Therapist (PT) - $1,896 per week in Boonville, MO

    Travel Physical Therapist (PT) - $1,896 per week in Boonville, MO

    AlliedTravelCareersBoonville, MO, US
    Full-time
    AlliedTravelCareers is working with Skyline Med Staff to find a qualified Physical Therapist (PT) in Boonville, Missouri, 65233!. Join the Top- Rated Travel Healthcare Team!\n\nSkyline Med Staff was...Show moreLast updated: 12 days ago
    • Promoted
    Make money your way. Deliver with Uber!

    Make money your way. Deliver with Uber!

    Uber eatsSmithton, MO, United States
    Full-time +1
    Delivering with Uber is an alternative to a part-time or full-time job and can get you earning cash quickly.Delivering with Uber allows you to earn quick cash while maintaining the flexibility your...Show moreLast updated: 3 days ago
    • Promoted
    Customs and Border Protection Officer

    Customs and Border Protection Officer

    U.S. Customs and Border ProtectionPilot Grove, MO, United States
    Full-time
    Customs and Border Protection (CBP) offers those interested in a career in law enforcement an exceptional opportunity to work with an elite team of highly trained professionals whose camaraderie, p...Show moreLast updated: 30+ days ago
    • Promoted
    Travel Physical Therapist

    Travel Physical Therapist

    Centra Healthcare AlliedBoonville, MO, US
    Full-time
    Centra Healthcare Allied is seeking a travel Physical Therapist for a travel job in Boonville, Missouri.Job Description & Requirements. Centra Healthcare Solutions is seeking an experienced.Phys...Show moreLast updated: 30+ days ago
    • Promoted
    Nurse Practitioner - Jefferson City MO

    Nurse Practitioner - Jefferson City MO

    MRG ExamsEugene, MO, United States
    Full-time
    We are looking for the right Nurse Practitioner to perform medical assessments on United States Veterans as part of the VA's disability benefits process. In performing Disability Assessments, you wi...Show moreLast updated: 2 days ago