Talent.com
Audio Evaluation Expert - Fully Remote Job at Mercor in Columbus

Audio Evaluation Expert - Fully Remote Job at Mercor in Columbus

MediabistroColumbus, OH, United States
2 days ago
Job type
  • Full-time
  • Remote
Job description

1 day ago Be among the first 25 applicants

This range is provided by Mercor. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$35.00 / hr - $40.00 / hr

Mercor Overview

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D\'Angelo, Larry Summers, and Jack Dorsey.

Role Overview

  • Position : Writing Expert – Freelance, Remote
  • Commitment : 20 hours per week, Duration : 1 month
  • Contribute to a high-impact audio AI research project. Author prompt–golden answer pairs for training and evaluating language models.

Responsibilities

  • Design and Optimize Prompts : Create detailed audio prompts with multiple constraints and instructions.
  • Define and Document Evaluation Standards : Establish high-level expectations for correct responses in general audio consumer contexts, and develop a comprehensive rubric.
  • Conduct Model Testing and Grading : Run prompts through models and assess preliminary outputs against expectations.
  • Support Benchmarking and Quality Assurance : Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.

    • Requirements / Qualifications

  • Must-Have : BS or BA from a reputable institution, completed or in progress
  • Strong writing and critical thinking skills
  • Ability to work independently and meet deadlines
  • Significant familiarity with ChatGPT or similar tools for personal decision-making or hobbies

    • Preferred Qualifications

  • 2+ years of experience in teaching or research

    • Engagement Details

  • Remote and asynchronous role
  • 20 hours per week commitment
  • Duration : 1 month

    • Application Process

  • Complete an AI-led interview (about 15 minutes)
  • Complete a 45-minute written assessment to guide you through writing rubrics
  • If selected, you will be invited to work on the project

    • Resources & Support

  • For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome
  • For any help or support, reach out to : support@mercor.com

    • PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

    #J-18808-Ljbffr

    Create a job alert for this search

    Audio Evaluation Job • Columbus, OH, United States

    Related jobs
    Turing is hiring : Remote Audio Annotation Specialist (AI Training) - 33328 in Co

    Turing is hiring : Remote Audio Annotation Specialist (AI Training) - 33328 in Co

    MediabistroColumbus, OH, United States
    Remote
    Full-time
    Be among the first 25 applicants.Turing is an AI-powered tech services company with a mission to accelerate AGI advancement and deployment by bridging the gap between global talent from 100+ countr...Show moreLast updated: 2 days ago
    • Promoted
    Remote Financial Analyst - AI Trainer

    Remote Financial Analyst - AI Trainer

    Data AnnotationLancaster, Ohio
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 30+ days ago
    • Promoted
    Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands

    Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands

    OCPAMarysville, Ohio, us
    Remote
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show moreLast updated: 30+ days ago
    • Promoted
    Remote Product Tester – $45 / hr + Free Products – Start Now!

    Remote Product Tester – $45 / hr + Free Products – Start Now!

    OCPAPickerington, Ohio, us
    Remote
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show moreLast updated: 30+ days ago
    • Promoted
    Work From Home Product Tester – $25-$45 / hr – No Experience Needed

    Work From Home Product Tester – $25-$45 / hr – No Experience Needed

    OCPAFredericktown, Ohio, us
    Remote
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show moreLast updated: 30+ days ago
    • Promoted
    Intervention Specialist

    Intervention Specialist

    FullBloomLancaster, OH, United States
    Full-time +1
    At Catapult Learning, we provide educational solutions that generate academic achievement and better life outcomes for students. Join Catapult Learning and become a part of a national organization w...Show moreLast updated: 30+ days ago
    Crossing Hurdles is hiring : Audio Engineer | $20 / hr Remote in Columbus

    Crossing Hurdles is hiring : Audio Engineer | $20 / hr Remote in Columbus

    MediabistroColumbus, OH, United States
    Remote
    Full-time
    Audio Engineer | $20 / hr Remote.Position : Audio & Sound Specialist.Duration : 2–3 months (with potential extensions).Identify and describe soundscapes of audio–visual content for AI training datasets...Show moreLast updated: 2 days ago
    • Promoted
    Remote AI Writing Evaluator

    Remote AI Writing Evaluator

    OutlierColumbus, OH, United States
    Remote
    Full-time
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...Show moreLast updated: 3 days ago
    • Promoted
    Survey Taker : Earn up to $25 per survey (Remote)

    Survey Taker : Earn up to $25 per survey (Remote)

    Earn HausReynoldsburg, OH, United States
    Remote
    Full-time +1
    Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion. You will help influence brand decisions on se...Show moreLast updated: 30+ days ago
    Audio Model Trainer - English Expert | Upto $20 / hr Remote Job at Mercor in Colum

    Audio Model Trainer - English Expert | Upto $20 / hr Remote Job at Mercor in Colum

    MediabistroColumbus, OH, United States
    Remote
    Full-time
    Audio Model Trainer - English Expert | Upto $20 / hr Remote.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Merco...Show moreLast updated: 2 days ago
    • Promoted
    Remote Finance Advisor - AI Trainer

    Remote Finance Advisor - AI Trainer

    Data AnnotationLancaster, Ohio
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 30+ days ago
    • Promoted
    Development Research Principal Engineer

    Development Research Principal Engineer

    Honda Dev. and Mfg. of Am.,LLCRaymond, OH, US
    Full-time
    What Makes a Honda, is Who makes a Honda.Honda has a clear vision for the future, and it’s a joyful one.We are looking for individuals with the skills, courage, persistence, and dreams that w...Show moreLast updated: 30+ days ago
    • Promoted
    Health Information Specialist I - Onsite (Washington Court House, OH)

    Health Information Specialist I - Onsite (Washington Court House, OH)

    DatavantWashington Court House, OH, US
    Full-time
    Datavant is a data platform company and the world's leader in health data exchange.Our vision is that every healthcare decision is powered by the right data, at the right time, in the right for...Show moreLast updated: 1 day ago
    • Promoted
    Online Program Evaluation Instructor

    Online Program Evaluation Instructor

    VirtualVocationsColumbus, Ohio, United States
    Part-time
    A company is looking for a Part-Time Faculty member to teach SWK 775 (M700) Program Evaluation for Spring 2026.Key Responsibilities Developing and / or updating a class syllabus Preparing lectures...Show moreLast updated: 2 days ago
    • Promoted
    AI Trainer Analyst

    AI Trainer Analyst

    VirtualVocationsColumbus, Ohio, United States
    Full-time
    A company is looking for an Agent Evaluation Analyst - AI Trainer.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missin...Show moreLast updated: 1 day ago
    Mercor is hiring : Audio Engineer | Upto $20 / hr Remote in Columbus

    Mercor is hiring : Audio Engineer | Upto $20 / hr Remote in Columbus

    MediabistroColumbus, OH, United States
    Remote
    Full-time
    Audio Engineer | Upto $20 / hr Remote.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Headquartered in San Franci...Show moreLast updated: 2 days ago
    Audio & Sound Specialist | $20 / hr Remote Job at Crossing Hurdles in Columbus

    Audio & Sound Specialist | $20 / hr Remote Job at Crossing Hurdles in Columbus

    MediabistroColumbus, OH, United States
    Remote
    Full-time
    Audio & Sound Specialist | $20 / hr Remote.Join Crossing Hurdles as an Audio & Sound Specialist.Crossing Hurdles is a recruitment firm that refers top candidates to partners working with the world’s ...Show moreLast updated: 2 days ago
    Crossing Hurdles is hiring : Audio Specialist | $20 / hr Remote in Columbus

    Crossing Hurdles is hiring : Audio Specialist | $20 / hr Remote in Columbus

    MediabistroColumbus, OH, United States
    Remote
    Full-time
    Audio Specialist | $20 / hr Remote.This range is provided by Crossing Hurdles.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Crossing Hurdles is ...Show moreLast updated: 2 days ago