Talent.com
Audio Evaluation Expert - Fully Remote Job at Mercor in Minneapolis

Audio Evaluation Expert - Fully Remote Job at Mercor in Minneapolis

MediabistroMinneapolis, MN, United States
3 days ago
Job type
  • Full-time
  • Remote
Job description

1 day ago Be among the first 25 applicants

This range is provided by Mercor. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$35.00 / hr - $40.00 / hr

Mercor Overview

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D\'Angelo, Larry Summers, and Jack Dorsey.

Role Overview

  • Position : Writing Expert – Freelance, Remote
  • Commitment : 20 hours per week, Duration : 1 month
  • Contribute to a high-impact audio AI research project. Author prompt–golden answer pairs for training and evaluating language models.

Responsibilities

  • Design and Optimize Prompts : Create detailed audio prompts with multiple constraints and instructions.
  • Define and Document Evaluation Standards : Establish high-level expectations for correct responses in general audio consumer contexts, and develop a comprehensive rubric.
  • Conduct Model Testing and Grading : Run prompts through models and assess preliminary outputs against expectations.
  • Support Benchmarking and Quality Assurance : Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.

    • Requirements / Qualifications

  • Must-Have : BS or BA from a reputable institution, completed or in progress
  • Strong writing and critical thinking skills
  • Ability to work independently and meet deadlines
  • Significant familiarity with ChatGPT or similar tools for personal decision-making or hobbies

    • Preferred Qualifications

  • 2+ years of experience in teaching or research

    • Engagement Details

  • Remote and asynchronous role
  • 20 hours per week commitment
  • Duration : 1 month

    • Application Process

  • Complete an AI-led interview (about 15 minutes)
  • Complete a 45-minute written assessment to guide you through writing rubrics
  • If selected, you will be invited to work on the project

    • Resources & Support

  • For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome
  • For any help or support, reach out to : support@mercor.com

    • PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

    #J-18808-Ljbffr

    Create a job alert for this search

    Audio Evaluation Job • Minneapolis, MN, United States

    Related jobs
    Mercor is hiring : Audio Engineer | Upto $20 / hr Remote in Minneapolis

    Mercor is hiring : Audio Engineer | Upto $20 / hr Remote in Minneapolis

    MediabistroMinneapolis, MN, United States
    Remote
    Full-time
    Audio Engineer | Upto $20 / hr Remote.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Headquartered in San Franci...Show moreLast updated: 3 days ago
    • Promoted
    Remote Senior Financial Analyst - AI Trainer

    Remote Senior Financial Analyst - AI Trainer

    Data AnnotationCoon Rapids, Minnesota
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 30+ days ago
    • Promoted
    Remote AI Writing Evaluator

    Remote AI Writing Evaluator

    OutlierSaint Paul, MN, United States
    Remote
    Full-time
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...Show moreLast updated: 4 days ago
    • Promoted
    Continuous Improvement Co-Op - Spring 2026

    Continuous Improvement Co-Op - Spring 2026

    EntegrisChaska, MN, United States
    Full-time
    Continuous Improvement Co-Op - Spring 2026.Continuous Improvement Co-Op - Spring 2026 Here at Entegris, we use advanced science to enable technologies that transform the world, and we are seeking e...Show moreLast updated: 27 days ago
    • Promoted
    Sales Representative (Remote)

    Sales Representative (Remote)

    American Income LifeForest Lake, MN, US
    Remote
    Full-time
    American Income Life is growing! We are seeking ambitious individuals who are driven to build their own business while also leaving a positive impact within the community they serve.American Income...Show moreLast updated: 30+ days ago
    • Promoted
    Work From Home Product Tester – $25-$45 / hr – No Experience Needed

    Work From Home Product Tester – $25-$45 / hr – No Experience Needed

    OCPAAlbertville, Minnesota, us
    Remote
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show moreLast updated: 30+ days ago
    • Promoted
    Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands

    Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands

    OCPABurnsville, Minnesota, us
    Remote
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Product Compliance Engineer

    Senior Product Compliance Engineer

    EntegrisChaska, MN, United States
    Full-time
    Senior Product Compliance Engineer.Not everyone who works for a global company shares the same background, experiences and perspectives. We leverage the differences of our employees to bring new ide...Show moreLast updated: 30+ days ago
    • Promoted
    Remote Product Tester – $45 / hr + Free Products – Start Now!

    Remote Product Tester – $45 / hr + Free Products – Start Now!

    OCPAHampton, Minnesota, us
    Remote
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show moreLast updated: 30+ days ago
    • Promoted
    Continuous Improvement and Six Sigma Co-Op - Spring 2026

    Continuous Improvement and Six Sigma Co-Op - Spring 2026

    EntegrisChaska, MN, United States
    Full-time
    Continuous Improvement and Six Sigma Co-Op - Spring 2026.Continuous Improvement and Six Sigma Co-Op - Spring 2026 Here at Entegris, we use advanced science to enable technologies that transform the...Show moreLast updated: 27 days ago
    • Promoted
    Share Your Thoughts, Pocket Some Cash : Join Opinion Outpost's Survey Opportunities!

    Share Your Thoughts, Pocket Some Cash : Join Opinion Outpost's Survey Opportunities!

    DynataOtsego, MN, United States
    Full-time
    Ready to turn your opinions into cash? Explore the world of remote paid online survey gigs with Opinion Outpost!.It's as simple as sharing your thoughts from the comfort of your own home and watchi...Show moreLast updated: 4 days ago
    • Promoted
    Implementation Consultant

    Implementation Consultant

    Maxwell TECShoreview, MN, US
    Full-time
    At Maxwell TEC, we design technology that adapts to the real world of care at home—streamlining workflows, supporting clinicians, and keeping patients at the center.Our team boasts unparallel...Show moreLast updated: 9 days ago
    • Promoted
    English Writing and Content Reviewing Expertise Sought for AI Training

    English Writing and Content Reviewing Expertise Sought for AI Training

    OutlierSaint Paul, MN, United States
    Full-time
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...Show moreLast updated: 4 days ago
    • Promoted
    Remote Finance Advisor - AI Trainer

    Remote Finance Advisor - AI Trainer

    Data AnnotationWoodbury, Minnesota
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 30+ days ago
    • Promoted
    Remote Financial Analyst - AI Trainer

    Remote Financial Analyst - AI Trainer

    Data AnnotationCoon Rapids, Minnesota
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 30+ days ago
    • Promoted
    Remote Commercial Banking Analyst - AI Trainer

    Remote Commercial Banking Analyst - AI Trainer

    Data AnnotationShakopee, Minnesota
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 30+ days ago
    • Promoted
    Remote Financial Planner - AI Trainer

    Remote Financial Planner - AI Trainer

    Data AnnotationShakopee, Minnesota
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 30+ days ago
    • Promoted
    Survey Taker : Earn up to $25 per survey (Remote)

    Survey Taker : Earn up to $25 per survey (Remote)

    Earn HausChamplin, MN, United States
    Remote
    Full-time +1
    Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion. You will help influence brand decisions on se...Show moreLast updated: 30+ days ago