Talent.com
Mercor is hiring : Audio Evaluation Expert - Fully Remote in Atlanta

Mercor is hiring : Audio Evaluation Expert - Fully Remote in Atlanta

MediabistroAtlanta, GA, United States
2 days ago
Job type
  • Full-time
  • Remote
Job description

1 day ago Be among the first 25 applicants

This range is provided by Mercor. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$35.00 / hr - $40.00 / hr

Mercor Overview

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D\'Angelo, Larry Summers, and Jack Dorsey.

Role Overview

  • Position : Writing Expert – Freelance, Remote
  • Commitment : 20 hours per week, Duration : 1 month
  • Contribute to a high-impact audio AI research project. Author prompt–golden answer pairs for training and evaluating language models.

Responsibilities

  • Design and Optimize Prompts : Create detailed audio prompts with multiple constraints and instructions.
  • Define and Document Evaluation Standards : Establish high-level expectations for correct responses in general audio consumer contexts, and develop a comprehensive rubric.
  • Conduct Model Testing and Grading : Run prompts through models and assess preliminary outputs against expectations.
  • Support Benchmarking and Quality Assurance : Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.

    • Requirements / Qualifications

  • Must-Have : BS or BA from a reputable institution, completed or in progress
  • Strong writing and critical thinking skills
  • Ability to work independently and meet deadlines
  • Significant familiarity with ChatGPT or similar tools for personal decision-making or hobbies

    • Preferred Qualifications

  • 2+ years of experience in teaching or research

    • Engagement Details

  • Remote and asynchronous role
  • 20 hours per week commitment
  • Duration : 1 month

    • Application Process

  • Complete an AI-led interview (about 15 minutes)
  • Complete a 45-minute written assessment to guide you through writing rubrics
  • If selected, you will be invited to work on the project

    • Resources & Support

  • For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome
  • For any help or support, reach out to : support@mercor.com

    • PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

    #J-18808-Ljbffr

    Create a job alert for this search

    Is Hiring Evaluation • Atlanta, GA, United States

    Related jobs
    • Promoted
    Remote AI Writing Evaluator

    Remote AI Writing Evaluator

    OutlierAtlanta, GA, United States
    Remote
    Full-time
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...Show moreLast updated: 3 days ago
    • Promoted
    Travel MRI Tech - $2175.52 / Week

    Travel MRI Tech - $2175.52 / Week

    Atlas MedStaffFayetteville, GA, US
    Full-time
    Atlas MedStaff is seeking an experienced MRI Tech for an exciting Travel Allied job in Fayetteville, GA.Shift : 5x8 hr PMs Start Date : 11 / 10 / 2025 Duration : 14 weeks Pay : $2175.Atlas Medstaff is curr...Show moreLast updated: 2 days ago
    • Promoted
    Research Specialist

    Research Specialist

    VirtualVocationsLawrenceville, Georgia, United States
    Full-time
    A company is looking for a Research Specialist (MX).Key Responsibilities Research healthcare continuing education and licensing requirements to maintain an accurate training library Track change...Show moreLast updated: 30+ days ago
    • Promoted
    Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands

    Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands

    OCPAKennesaw, Georgia, us
    Remote
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show moreLast updated: 30+ days ago
    • Promoted
    Work From Home Product Tester – $25-$45 / hr – No Experience Needed

    Work From Home Product Tester – $25-$45 / hr – No Experience Needed

    OCPASouth Fulton, Georgia, us
    Remote
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show moreLast updated: 30+ days ago
    Audio Engineer | Upto $20 / hr Remote Job at Mercor in Atlanta

    Audio Engineer | Upto $20 / hr Remote Job at Mercor in Atlanta

    MediabistroAtlanta, GA, United States
    Remote
    Full-time
    Audio Engineer | Upto $20 / hr Remote.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Headquartered in San Franci...Show moreLast updated: 2 days ago
    • Promoted
    AI Trainer Analyst

    AI Trainer Analyst

    VirtualVocationsAtlanta, Georgia, United States
    Full-time
    A company is looking for an Agent Evaluation Analyst - AI Trainer.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missin...Show moreLast updated: 1 day ago
    • Promoted
    Mixed-Method UX Researcher

    Mixed-Method UX Researcher

    VirtualVocationsAlpharetta, Georgia, United States
    Full-time
    A company is looking for a Mixed-Method UX Researcher.Key Responsibilities : Develop and share detailed research plans with stakeholders Select appropriate research methods for projects, includin...Show moreLast updated: 2 days ago
    • Promoted
    Senior Threat Research Engineer

    Senior Threat Research Engineer

    VirtualVocationsAlpharetta, Georgia, United States
    Full-time
    A company is looking for a Senior Threat Research Engineer.Key Responsibilities Research novel cloud-based cyber attacks and report findings Develop threat intelligence based on malware analysis...Show moreLast updated: 2 days ago
    • Promoted
    Survey Taker : Earn up to $25 per survey (Remote)

    Survey Taker : Earn up to $25 per survey (Remote)

    Earn HausMilton, GA, United States
    Remote
    Full-time +1
    Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion. You will help influence brand decisions on se...Show moreLast updated: 30+ days ago
    • Promoted
    Share Your Thoughts, Pocket Some Cash : Join Opinion Outpost's Survey Opportunities!

    Share Your Thoughts, Pocket Some Cash : Join Opinion Outpost's Survey Opportunities!

    DynataGriffin, GA, United States
    Full-time
    Ready to turn your opinions into cash? Explore the world of remote paid online survey gigs with Opinion Outpost!.It's as simple as sharing your thoughts from the comfort of your own home and watchi...Show moreLast updated: 3 days ago
    • Promoted
    Remote Product Tester – $45 / hr + Free Products – Start Now!

    Remote Product Tester – $45 / hr + Free Products – Start Now!

    OCPALocust Grove, Georgia, us
    Remote
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show moreLast updated: 30+ days ago
    • Promoted
    Test Products from Home – $25-$45 / hr + Freebies

    Test Products from Home – $25-$45 / hr + Freebies

    OCPANewnan, Georgia, us
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show moreLast updated: 30+ days ago
    • Promoted
    B2B Growth Strategist

    B2B Growth Strategist

    VirtualVocationsLawrenceville, Georgia, United States
    Full-time
    A company is looking for a B2B Growth Strategist for the Duolingo English Test.Key Responsibilities Map and document the full agent referral funnel from lead registration to student referrals Id...Show moreLast updated: 1 day ago
    • Promoted
    California Licensed UX Researcher

    California Licensed UX Researcher

    VirtualVocationsNorcross, Georgia, United States
    Full-time
    A company is looking for a UX Researcher to join their team of technology consultants.Key Responsibilities Support the product design team in an iterative, user-centered design process Lead rese...Show moreLast updated: 2 days ago
    • Promoted
    CT Technologist Reg PRN - Varies

    CT Technologist Reg PRN - Varies

    Wellstar Health Systems, Inc.Griffin, GA, United States
    Full-time
    How would you like to work in a place where your contributions and ideas are valued? A place where you can serve with compassion, pursue excellence and honor every voice? At Wellstar, our mission i...Show moreLast updated: 16 days ago
    • Promoted
    Product Tester (Work From Home) – Keep Free Products + Weekly Pay

    Product Tester (Work From Home) – Keep Free Products + Weekly Pay

    OCPAGriffin, Georgia, us
    Remote
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show moreLast updated: 30+ days ago
    • Promoted
    CT Tech Reg, FT Various

    CT Tech Reg, FT Various

    Wellstar Health Systems, Inc.Marietta, GA, US
    Full-time
    How would you like to work in a place where your contributions and ideas are valued? A place where you can serve with compassion, pursue excellence and honor every voice? At Wellstar, our mission i...Show moreLast updated: 30+ days ago