Talent.com
Audio Evaluation Expert - Fully Remote Job at Mercor in Kansas City

Audio Evaluation Expert - Fully Remote Job at Mercor in Kansas City

MediabistroKansas City, MO, United States
9 hours ago
Job type
  • Full-time
  • Remote
Job description

1 day ago Be among the first 25 applicants

This range is provided by Mercor. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$35.00 / hr - $40.00 / hr

Mercor Overview

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D\'Angelo, Larry Summers, and Jack Dorsey.

Role Overview

  • Position : Writing Expert – Freelance, Remote
  • Commitment : 20 hours per week, Duration : 1 month
  • Contribute to a high-impact audio AI research project. Author prompt–golden answer pairs for training and evaluating language models.

Responsibilities

  • Design and Optimize Prompts : Create detailed audio prompts with multiple constraints and instructions.
  • Define and Document Evaluation Standards : Establish high-level expectations for correct responses in general audio consumer contexts, and develop a comprehensive rubric.
  • Conduct Model Testing and Grading : Run prompts through models and assess preliminary outputs against expectations.
  • Support Benchmarking and Quality Assurance : Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.

    • Requirements / Qualifications

  • Must-Have : BS or BA from a reputable institution, completed or in progress
  • Strong writing and critical thinking skills
  • Ability to work independently and meet deadlines
  • Significant familiarity with ChatGPT or similar tools for personal decision-making or hobbies

    • Preferred Qualifications

  • 2+ years of experience in teaching or research

    • Engagement Details

  • Remote and asynchronous role
  • 20 hours per week commitment
  • Duration : 1 month

    • Application Process

  • Complete an AI-led interview (about 15 minutes)
  • Complete a 45-minute written assessment to guide you through writing rubrics
  • If selected, you will be invited to work on the project

    • Resources & Support

  • For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome
  • For any help or support, reach out to : support@mercor.com

    • PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

    #J-18808-Ljbffr

    Create a job alert for this search

    Audio Evaluation Job • Kansas City, MO, United States

    Related jobs
    • New!
    Turing is hiring : Remote Audio Annotation Specialist (AI Training) - 33328 in Ka

    Turing is hiring : Remote Audio Annotation Specialist (AI Training) - 33328 in Ka

    MediabistroKansas City, MO, United States
    Remote
    Full-time
    Be among the first 25 applicants.Turing is an AI-powered tech services company with a mission to accelerate AGI advancement and deployment by bridging the gap between global talent from 100+ countr...Show moreLast updated: 9 hours ago
    • Promoted
    Travel CT Tech - $2,205 to $2,405 per week in Liberty, MO

    Travel CT Tech - $2,205 to $2,405 per week in Liberty, MO

    AlliedTravelCareersLiberty, MO, US
    Full-time
    AlliedTravelCareers is working with Ventura MedStaff to find a qualified CT Tech in Liberty, Missouri, 64068!.Are you ready to take your Travel career to the next level? See places you have not se...Show moreLast updated: 20 days ago
    • Promoted
    Online Program Evaluation Instructor

    Online Program Evaluation Instructor

    VirtualVocationsIndependence, Missouri, United States
    Part-time
    A company is looking for a Part-Time Faculty member to teach SWK 775 (M700) Program Evaluation for Spring 2026.Key Responsibilities Developing and / or updating a class syllabus Preparing lectures...Show moreLast updated: 1 day ago
    • Promoted
    Threat Intelligence Specialist

    Threat Intelligence Specialist

    VirtualVocationsIndependence, Missouri, United States
    Full-time
    A company is looking for a Threat Intelligence Specialist to manage critical global law enforcement inquiries.Key Responsibilities Respond to high-priority, time-sensitive requests from law enfor...Show moreLast updated: 2 days ago
    • Promoted
    Content Integrity Auditor

    Content Integrity Auditor

    VirtualVocationsIndependence, Missouri, United States
    Full-time
    A company is looking for a Content Integrity Auditor.Key Responsibilities Review and evaluate task submissions for non-original patterns, including templated responses and plagiarized material D...Show moreLast updated: 1 day ago
    • Promoted
    Travel CT Technologist

    Travel CT Technologist

    Favorite Healthcare StaffingLiberty, MO, US
    Permanent
    Favorite Healthcare Staffing is seeking a travel CT Technologist for a travel job in Liberty, Missouri.Job Description & Requirements. At Favorite Healthcare Staffing, we’re dedicated to d...Show moreLast updated: 30+ days ago
    • Promoted
    Travel CT Technologist - $2,559 per week

    Travel CT Technologist - $2,559 per week

    Care CareerLiberty, MO, United States
    Full-time
    Care Career is seeking a travel CT Technologist for a travel job in Liberty, Missouri.Job Description & Requirements.Pay package is based on 12 hour shifts and 34. Posted job title : Radiology / Imagin...Show moreLast updated: 20 days ago
    • Promoted
    Senior Observability Engineer

    Senior Observability Engineer

    VirtualVocationsIndependence, Missouri, United States
    Full-time
    A company is looking for a Senior Observability Engineer.Key Responsibilities Build and maintain comprehensive observability systems at massive scale Instrument Kubernetes clusters, applications...Show moreLast updated: 30+ days ago
    • New!
    Mercor is hiring : Audio Engineer - Fully Remote in Kansas City

    Mercor is hiring : Audio Engineer - Fully Remote in Kansas City

    MediabistroKansas City, MO, United States
    Remote
    Full-time
    This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Headquartered in San Francisco, our investors include.Audio, Mu...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Mixed-Method UX Researcher

    Mixed-Method UX Researcher

    VirtualVocationsIndependence, Missouri, United States
    Full-time
    A company is looking for a Mixed-Method UX Researcher.Key Responsibilities : Develop and share detailed research plans with stakeholders Select appropriate research methods for projects, includin...Show moreLast updated: 16 hours ago
    • Promoted
    IVDR Assessor

    IVDR Assessor

    VirtualVocationsIndependence, Missouri, United States
    Full-time
    A company is looking for an IVDR Experienced Assessor.Key Responsibilities Conduct audits of manufacturers' quality management systems and suppliers / subcontractors Perform surveillance audits an...Show moreLast updated: 30+ days ago
    • Promoted
    Travel CT Technologist

    Travel CT Technologist

    Triage StaffingLiberty, MO, US
    Full-time
    Triage Staffing is seeking a travel CT Technologist for a travel job in Liberty, Missouri.Job Description & Requirements. Travel Radiology : CT Tech Liberty, MO.Location : &...Show moreLast updated: 30+ days ago
    • New!
    Audio Engineer | Upto $20 / hr Remote Job at Mercor in Kansas City

    Audio Engineer | Upto $20 / hr Remote Job at Mercor in Kansas City

    MediabistroKansas City, MO, United States
    Remote
    Full-time
    Audio Engineer | Upto $20 / hr Remote.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Headquartered in San Franci...Show moreLast updated: 9 hours ago
    • Promoted
    Remote Finance Advisor - AI Trainer

    Remote Finance Advisor - AI Trainer

    Data AnnotationIndependence, Missouri
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 28 days ago
    • Promoted
    Transcription Quality Evaluator

    Transcription Quality Evaluator

    VirtualVocationsKansas City, Kansas, United States
    Full-time
    A company is looking for a transcription project evaluator.Key Responsibilities Evaluate the quality and accuracy of voiceovers, transcriptions, and translations in advertisement videos Assess a...Show moreLast updated: 2 days ago
    • Promoted
    Gen AI Evaluation Analyst

    Gen AI Evaluation Analyst

    VirtualVocationsKansas City, Missouri, United States
    Full-time
    A company is looking for an English Language / Gen AI Specialist.Key Responsibilities : Evaluate outputs generated by LLMs across multiple modalities Assess quality against project-specific criteri...Show moreLast updated: 1 day ago
    • Promoted
    Research Specialist

    Research Specialist

    VirtualVocationsIndependence, Missouri, United States
    Full-time
    A company is looking for a Research Specialist (MX).Key Responsibilities Research healthcare continuing education and licensing requirements to maintain an accurate training library Track change...Show moreLast updated: 30+ days ago
    • Promoted
    AI Enablement Engineer

    AI Enablement Engineer

    VirtualVocationsIndependence, Missouri, United States
    Full-time
    A company is looking for an AI Enablement Engineer.Key Responsibilities Identify and scope high-impact use cases for productivity improvement using advanced AI technologies Deploy and configure ...Show moreLast updated: 30+ days ago