Talent.com
Mercor is hiring : Audio Evaluation Expert - Fully Remote in Fort Worth

Mercor is hiring : Audio Evaluation Expert - Fully Remote in Fort Worth

MediabistroFort Worth, TX, United States
1 day ago
Job type
  • Full-time
  • Remote
Job description

1 day ago Be among the first 25 applicants

This range is provided by Mercor. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$35.00 / hr - $40.00 / hr

Mercor Overview

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D\'Angelo, Larry Summers, and Jack Dorsey.

Role Overview

  • Position : Writing Expert – Freelance, Remote
  • Commitment : 20 hours per week, Duration : 1 month
  • Contribute to a high-impact audio AI research project. Author prompt–golden answer pairs for training and evaluating language models.

Responsibilities

  • Design and Optimize Prompts : Create detailed audio prompts with multiple constraints and instructions.
  • Define and Document Evaluation Standards : Establish high-level expectations for correct responses in general audio consumer contexts, and develop a comprehensive rubric.
  • Conduct Model Testing and Grading : Run prompts through models and assess preliminary outputs against expectations.
  • Support Benchmarking and Quality Assurance : Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.

    • Requirements / Qualifications

  • Must-Have : BS or BA from a reputable institution, completed or in progress
  • Strong writing and critical thinking skills
  • Ability to work independently and meet deadlines
  • Significant familiarity with ChatGPT or similar tools for personal decision-making or hobbies

    • Preferred Qualifications

  • 2+ years of experience in teaching or research

    • Engagement Details

  • Remote and asynchronous role
  • 20 hours per week commitment
  • Duration : 1 month

    • Application Process

  • Complete an AI-led interview (about 15 minutes)
  • Complete a 45-minute written assessment to guide you through writing rubrics
  • If selected, you will be invited to work on the project

    • Resources & Support

  • For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome
  • For any help or support, reach out to : support@mercor.com

    • PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

    #J-18808-Ljbffr

    Create a job alert for this search

    Is Hiring Evaluation • Fort Worth, TX, United States

    Related jobs
    Audio Engineer | Upto $20 / hr Remote Job at Mercor in Fort Worth

    Audio Engineer | Upto $20 / hr Remote Job at Mercor in Fort Worth

    MediabistroFort Worth, TX, United States
    Remote
    Full-time
    Audio Engineer | Upto $20 / hr Remote.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Headquartered in San Franci...Show moreLast updated: 1 day ago
    • Promoted
    Test Products from Home – $25-$45 / hr + Freebies

    Test Products from Home – $25-$45 / hr + Freebies

    OCPAGlen Rose, Texas, us
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show moreLast updated: 30+ days ago
    • Promoted
    Part Time - Work from Home - Online Product Tester - No experience ($25-$45 per hour)

    Part Time - Work from Home - Online Product Tester - No experience ($25-$45 per hour)

    OCPAWaxahachie, Texas, us
    Remote
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show moreLast updated: 30+ days ago
    • Promoted
    Sales Representative (Remote)

    Sales Representative (Remote)

    American Income LifeWaxahachie, TX, US
    Remote
    Full-time
    American Income Life is growing! We are seeking ambitious individuals who are driven to build their own business while also leaving a positive impact within the community they serve.American Income...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    AI Trainer Analyst

    AI Trainer Analyst

    VirtualVocationsCarrollton, Texas, United States
    Full-time
    A company is looking for an Agent Evaluation Analyst - AI Trainer.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missin...Show moreLast updated: 17 hours ago
    • Promoted
    Survey Taker : Earn up to $25 per survey (Remote)

    Survey Taker : Earn up to $25 per survey (Remote)

    Earn HausWatauga, TX, United States
    Remote
    Full-time +1
    Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion. You will help influence brand decisions on se...Show moreLast updated: 30+ days ago
    • Promoted
    Remote Product Tester – $45 / hr + Free Products – Start Now!

    Remote Product Tester – $45 / hr + Free Products – Start Now!

    OCPARoanoke, Texas, us
    Remote
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show moreLast updated: 30+ days ago
    • Promoted
    Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands

    Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands

    OCPACleburne, Texas, us
    Remote
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show moreLast updated: 30+ days ago
    • Promoted
    Work From Home Product Tester – $25-$45 / hr – No Experience Needed

    Work From Home Product Tester – $25-$45 / hr – No Experience Needed

    OCPAGodley, Texas, us
    Remote
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show moreLast updated: 30+ days ago
    • Promoted
    Remote Finance Advisor - AI Trainer

    Remote Finance Advisor - AI Trainer

    Data AnnotationMansfield, Texas
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 29 days ago
    • Promoted
    Audio Visual Technician

    Audio Visual Technician

    CornerStone Technology Talent ServicesFort Worth, TX, US
    Full-time
    Job Title : AV Technician (Contract).Worksite Requirement : 100% Onsite.We are seeking a contract AV Engineer to support conference room upgrades and handle daily break / fix AV support in a profession...Show moreLast updated: 7 days ago
    • Promoted
    Remote AI Writing Evaluator

    Remote AI Writing Evaluator

    OutlierFort Worth, TX, United States
    Remote
    Full-time
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...Show moreLast updated: 2 days ago
    • Promoted
    -Product Development Specialist-

    -Product Development Specialist-

    GritR SportsNorth Richland Hills, TX, US
    Full-time
    Join Our Team : Product Development Specialist.Organization | Communication | Hands-On Innovation.Location : GRITR – North Richland Hills, TX. F0; Schedule : Full-Time, Monday–Friday (8-hou...Show moreLast updated: 19 days ago
    • Promoted
    B2B Growth Strategist

    B2B Growth Strategist

    VirtualVocationsCarrollton, Texas, United States
    Full-time
    A company is looking for a B2B Growth Strategist for the Duolingo English Test.Key Responsibilities Map and document the full agent referral funnel from lead registration to student referrals Id...Show moreLast updated: 30+ days ago
    • Promoted
    Online Program Evaluation Instructor

    Online Program Evaluation Instructor

    VirtualVocationsArlington, Texas, United States
    Part-time
    A company is looking for a Part-Time Faculty member to teach SWK 775 (M700) Program Evaluation for Spring 2026.Key Responsibilities Developing and / or updating a class syllabus Preparing lectures...Show moreLast updated: 1 day ago
    • Promoted
    Research Specialist

    Research Specialist

    VirtualVocationsCarrollton, Texas, United States
    Full-time
    A company is looking for a Research Specialist (MX).Key Responsibilities Research healthcare continuing education and licensing requirements to maintain an accurate training library Track change...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Vehicle Market Research Guide

    Vehicle Market Research Guide

    CornerStone StaffingCoppell, TX, US
    Full-time
    Wed 10 / 16 (4 : 00pm–6 : 00pm training); Fri–Sun 10 / 18–10 / 20 (8 : 30am–8 : 00pm).Join a short-term, high-energy market research project supporting a nationally recognized team visiting from California.You'l...Show moreLast updated: 11 hours ago
    • Promoted
    Product Tester (Work From Home) – Keep Free Products + Weekly Pay

    Product Tester (Work From Home) – Keep Free Products + Weekly Pay

    OCPAParadise, Texas, us
    Remote
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show moreLast updated: 30+ days ago