Talent.com
Mercor is hiring : Audio Evaluation Expert - Fully Remote in Boston

Mercor is hiring : Audio Evaluation Expert - Fully Remote in Boston

MediabistroBoston, MA, United States
4 days ago
Job type
  • Full-time
  • Remote
Job description

1 day ago Be among the first 25 applicants

This range is provided by Mercor. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$35.00 / hr - $40.00 / hr

Mercor Overview

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D\'Angelo, Larry Summers, and Jack Dorsey.

Role Overview

  • Position : Writing Expert – Freelance, Remote
  • Commitment : 20 hours per week, Duration : 1 month
  • Contribute to a high-impact audio AI research project. Author prompt–golden answer pairs for training and evaluating language models.

Responsibilities

  • Design and Optimize Prompts : Create detailed audio prompts with multiple constraints and instructions.
  • Define and Document Evaluation Standards : Establish high-level expectations for correct responses in general audio consumer contexts, and develop a comprehensive rubric.
  • Conduct Model Testing and Grading : Run prompts through models and assess preliminary outputs against expectations.
  • Support Benchmarking and Quality Assurance : Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.

    • Requirements / Qualifications

  • Must-Have : BS or BA from a reputable institution, completed or in progress
  • Strong writing and critical thinking skills
  • Ability to work independently and meet deadlines
  • Significant familiarity with ChatGPT or similar tools for personal decision-making or hobbies

    • Preferred Qualifications

  • 2+ years of experience in teaching or research

    • Engagement Details

  • Remote and asynchronous role
  • 20 hours per week commitment
  • Duration : 1 month

    • Application Process

  • Complete an AI-led interview (about 15 minutes)
  • Complete a 45-minute written assessment to guide you through writing rubrics
  • If selected, you will be invited to work on the project

    • Resources & Support

  • For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome
  • For any help or support, reach out to : support@mercor.com

    • PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

    #J-18808-Ljbffr

    Create a job alert for this search

    Is Hiring Evaluation • Boston, MA, United States

    Related jobs
    • Promoted
    Remote Finance Advisor - AI Trainer

    Remote Finance Advisor - AI Trainer

    Data AnnotationWaltham, Massachusetts
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 30+ days ago
    • Promoted
    Remote AI Writing Evaluator

    Remote AI Writing Evaluator

    OutlierLowell, MA, United States
    Remote
    Full-time
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...Show moreLast updated: 5 days ago
    • Promoted
    Sales Representative (Remote)

    Sales Representative (Remote)

    American Income LifeScituate, MA, US
    Remote
    Full-time
    A Sales Career That Grows With You.Are you looking for a career path that gives you the freedom and flexibility to control your schedule, but also has the security and stability of a large company?...Show moreLast updated: 30+ days ago
    • New!
    Audio Engineer | $20 / hr Remote Job at Crossing Hurdles in Boston

    Audio Engineer | $20 / hr Remote Job at Crossing Hurdles in Boston

    MediabistroBoston, MA, United States
    Remote
    Full-time
    Audio Engineer | $20 / hr Remote.This range is provided by Crossing Hurdles.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Direct message the job...Show moreLast updated: 17 hours ago
    • Promoted
    Travel Physical Therapist

    Travel Physical Therapist

    Medical Solutions AlliedScituate, MA, US
    Full-time
    Medical Solutions Allied is seeking a travel Physical Therapist for a travel job in Scituate, Massachusetts.Job Description & Requirements. We’re seeking talented healthcare professionals ...Show moreLast updated: 30+ days ago
    • Promoted
    Travel Physical Therapist (PT) - $2,239 per week in Scituate, MA

    Travel Physical Therapist (PT) - $2,239 per week in Scituate, MA

    AlliedTravelCareersScituate, MA, US
    Full-time
    AlliedTravelCareers is working with Medical Solutions to find a qualified Physical Therapist (PT) in Scituate, Massachusetts, 02066!. A facility in Scituate, MA is seeking its next amazing PT (Physi...Show moreLast updated: 30+ days ago
    • Promoted
    Travel Physical Therapist

    Travel Physical Therapist

    CompHealth Inc.Scituate, MA, US
    Permanent
    Physical Therapist for a travel job in Scituate, Massachusetts.Job Description & Requirements.CompHealth services are always free to you. Let us do the heavy lifting and handle the headache of c...Show moreLast updated: 30+ days ago
    • Promoted
    Travel Physical Therapist - $2,700 per week

    Travel Physical Therapist - $2,700 per week

    CompHealth Inc.Scituate, MA, United States
    Permanent
    Physical Therapist for a travel job in Scituate, Massachusetts.Job Description & Requirements.CompHealth services are always free to you. Let us do the heavy lifting and handle the headache of crede...Show moreLast updated: 30+ days ago
    • Promoted
    English Writing and Content Reviewing Expertise Sought for AI Training

    English Writing and Content Reviewing Expertise Sought for AI Training

    OutlierPawtucket, RI, United States
    Full-time
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...Show moreLast updated: 5 days ago
    • Promoted
    Traveling Retail Merchandiser

    Traveling Retail Merchandiser

    SAS Retail ServicesScituate, MA, US
    Full-time
    We want you to help us shape the future of shopping experiences and deliver on our purpose of connecting people with the products and experiences that enrich their lives. Joining SAS Retail Services...Show moreLast updated: 30+ days ago
    • Promoted
    Clinical Application Specialist

    Clinical Application Specialist

    SentecLincoln, RI, US
    Full-time
    Clinical Application Specialist (CAS).In this position, you’ll provide hands-on and virtual education to clinicians in Rhode Island, working in close partnership with our.Continuing Education...Show moreLast updated: 4 days ago
    • Promoted
    Travel Physical Therapist - $2,141 per week

    Travel Physical Therapist - $2,141 per week

    Uniti MedScituate, MA, United States
    Full-time
    Uniti Med is seeking a travel Physical Therapist for a travel job in Scituate, Massachusetts.Job Description & Requirements. Uniti Med is looking for a Travel Physical Therapist (PT) in Scituate, MA...Show moreLast updated: 30+ days ago
    • Promoted
    Travel Physical Therapist - $2,142 per week

    Travel Physical Therapist - $2,142 per week

    The Good Life MedStaffScituate, MA, United States
    Full-time
    The Good Life MedStaff is seeking a travel Physical Therapist for a travel job in Scituate, Massachusetts.Job Description & Requirements. The Good Life MedStaff Job ID #33803051.Pay package is based...Show moreLast updated: 30+ days ago
    Audio Engineer | Upto $20 / hr Remote Job at Mercor in Boston

    Audio Engineer | Upto $20 / hr Remote Job at Mercor in Boston

    MediabistroBoston, MA, United States
    Remote
    Full-time
    Audio Engineer | Upto $20 / hr Remote.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Headquartered in San Franci...Show moreLast updated: 4 days ago
    Crossing Hurdles is hiring : Audio & Sound Specialist | $20 / hr Remote in Boston

    Crossing Hurdles is hiring : Audio & Sound Specialist | $20 / hr Remote in Boston

    MediabistroBoston, MA, United States
    Remote
    Full-time
    Audio & Sound Specialist | $20 / hr Remote.Audio & Sound Specialist | $20 / hr Remote.Crossing Hurdles is a recruitment firm. We refer top candidates to our partners working with the world’s leading AI ...Show moreLast updated: 4 days ago
    Audio Engineer - Fully Remote Job at Mercor in Boston

    Audio Engineer - Fully Remote Job at Mercor in Boston

    MediabistroBoston, MA, United States
    Remote
    Full-time
    This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Headquartered in San Francisco, our investors include.Audio, Mu...Show moreLast updated: 4 days ago
    • New!
    AI Multimedia Generation Product Evaluator Job at ICONMA in Boston

    AI Multimedia Generation Product Evaluator Job at ICONMA in Boston

    MediabistroBoston, MA, United States
    Full-time
    Our Client, a Internet Content & Information company, is looking for an AI Multimedia Generation Product Evaluator for their Remote location. The Multimedia Generation team focuses on fine tuning an...Show moreLast updated: 17 hours ago
    • Promoted
    Remote Product Tester – $45 / hr + Free Products – Start Now!

    Remote Product Tester – $45 / hr + Free Products – Start Now!

    OCPANorth Providence, Rhode Island, us
    Remote
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show moreLast updated: 30+ days ago