Talent.com
Audio Evaluation Expert - Fully Remote Job at Mercor in Los Angeles

Audio Evaluation Expert - Fully Remote Job at Mercor in Los Angeles

MediabistroLos Angeles, CA, United States
4 days ago
Job type
  • Full-time
  • Remote
Job description

1 day ago Be among the first 25 applicants

This range is provided by Mercor. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$35.00 / hr - $40.00 / hr

Mercor Overview

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D\'Angelo, Larry Summers, and Jack Dorsey.

Role Overview

  • Position : Writing Expert – Freelance, Remote
  • Commitment : 20 hours per week, Duration : 1 month
  • Contribute to a high-impact audio AI research project. Author prompt–golden answer pairs for training and evaluating language models.

Responsibilities

  • Design and Optimize Prompts : Create detailed audio prompts with multiple constraints and instructions.
  • Define and Document Evaluation Standards : Establish high-level expectations for correct responses in general audio consumer contexts, and develop a comprehensive rubric.
  • Conduct Model Testing and Grading : Run prompts through models and assess preliminary outputs against expectations.
  • Support Benchmarking and Quality Assurance : Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.

    • Requirements / Qualifications

  • Must-Have : BS or BA from a reputable institution, completed or in progress
  • Strong writing and critical thinking skills
  • Ability to work independently and meet deadlines
  • Significant familiarity with ChatGPT or similar tools for personal decision-making or hobbies

    • Preferred Qualifications

  • 2+ years of experience in teaching or research

    • Engagement Details

  • Remote and asynchronous role
  • 20 hours per week commitment
  • Duration : 1 month

    • Application Process

  • Complete an AI-led interview (about 15 minutes)
  • Complete a 45-minute written assessment to guide you through writing rubrics
  • If selected, you will be invited to work on the project

    • Resources & Support

  • For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome
  • For any help or support, reach out to : support@mercor.com

    • PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

    #J-18808-Ljbffr

    Create a job alert for this search

    Audio Evaluation Job • Los Angeles, CA, United States

    Related jobs
    • Promoted
    • New!
    AI Evaluation Analyst

    AI Evaluation Analyst

    VirtualVocationsGlendale, California, United States
    Full-time
    A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...Show moreLast updated: 15 hours ago
    • Promoted
    Research Lead - AI Cyber Testing & Evaluation

    Research Lead - AI Cyber Testing & Evaluation

    RAND CorporationSanta Monica, CA, United States
    Temporary
    Global and Emerging Risks (GER) division.As Research Lead - AI Cyber Testing & Evaluation, you'll direct a comprehensive research portfolio focused on assessing the offensive cyber capabilities of ...Show moreLast updated: 30+ days ago
    • Promoted
    Product Manager, AI Messaging

    Product Manager, AI Messaging

    VirtualVocationsGarden Grove, California, United States
    Full-time
    A company is looking for a Product Manager, AI Powered Messaging.Key Responsibilities Collaborate with Product, Engineering, and Data Science teams to enhance AI interactions Analyze data to ide...Show moreLast updated: 13 days ago
    • New!
    AI Multimedia Generation Product Evaluator Job at ICONMA in Los Angeles

    AI Multimedia Generation Product Evaluator Job at ICONMA in Los Angeles

    MediabistroLos Angeles, CA, United States
    Full-time
    Our Client, a Internet Content & Information company, is looking for an AI Multimedia Generation Product Evaluator for their Remote location. The Multimedia Generation team focuses on fine tuning an...Show moreLast updated: 5 hours ago
    Crossing Hurdles is hiring : Audio Specialist | $20 / hr Remote in Los Angeles

    Crossing Hurdles is hiring : Audio Specialist | $20 / hr Remote in Los Angeles

    MediabistroLos Angeles, CA, United States
    Remote
    Full-time
    Audio Specialist | $20 / hr Remote.This range is provided by Crossing Hurdles.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Crossing Hurdles is ...Show moreLast updated: 4 days ago
    • Promoted
    Audit Senior

    Audit Senior

    JobotBurbank, CA, US
    Full-time
    Highly Reputable CPA firm in LA seeking a Sr.This Jobot Job is hosted by : Ron Calhoun.Are you a fit? Easy Apply now by clicking the "Apply Now" buttonand sending us your resume.Salary : $1...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Advanced Analytics Expert

    Advanced Analytics Expert

    VirtualVocationsGarden Grove, California, United States
    Full-time
    A company is looking for an Advanced Analytics Expert to collaborate with teams and utilize advanced analytics for data-driven decision-making. Key Responsibilities Builds advanced analytics solut...Show moreLast updated: 13 hours ago
    • Promoted
    Strategic Advisor

    Strategic Advisor

    VirtualVocationsLong Beach, California, United States
    Full-time
    A company is looking for a Strategic Advisor to support the sales process and client engagement remotely from anywhere in the U. Key Responsibilities Partner with sales consultants to present and ...Show moreLast updated: 30+ days ago
    Turing is hiring : Remote Audio Annotation Specialist (AI Training) - 33328 in Lo

    Turing is hiring : Remote Audio Annotation Specialist (AI Training) - 33328 in Lo

    MediabistroLos Angeles, CA, United States
    Remote
    Full-time
    Be among the first 25 applicants.Turing is an AI-powered tech services company with a mission to accelerate AGI advancement and deployment by bridging the gap between global talent from 100+ countr...Show moreLast updated: 4 days ago
    • Promoted
    Remote Finance Advisor - AI Trainer

    Remote Finance Advisor - AI Trainer

    Data AnnotationLong Beach, California
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show moreLast updated: 30+ days ago
    Crossing Hurdles is hiring : Audio Engineer | $20 / hr Remote in Los Angeles

    Crossing Hurdles is hiring : Audio Engineer | $20 / hr Remote in Los Angeles

    MediabistroLos Angeles, CA, United States
    Remote
    Full-time
    Audio Engineer | $20 / hr Remote.This range is provided by Crossing Hurdles.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Direct message the job...Show moreLast updated: 4 days ago
    • Promoted
    • New!
    UX Researcher for Training

    UX Researcher for Training

    VirtualVocationsOrange, California, United States
    Full-time
    A company is looking for a UX Researcher (Training & Education) to design and refine training courses related to prevention of sexual assault and other harmful behaviors in the military.Key Respons...Show moreLast updated: 9 hours ago
    Mercor is hiring : Audio Engineer | Upto $20 / hr Remote in Los Angeles

    Mercor is hiring : Audio Engineer | Upto $20 / hr Remote in Los Angeles

    MediabistroLos Angeles, CA, United States
    Remote
    Full-time
    Audio Engineer | Upto $20 / hr Remote.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Headquartered in San Franci...Show moreLast updated: 4 days ago
    • Promoted
    • New!
    AI Agent Evaluation Analyst

    AI Agent Evaluation Analyst

    VirtualVocationsGlendale, California, United States
    Full-time
    A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    AI Prototype Specialist

    AI Prototype Specialist

    VirtualVocationsCarson, California, United States
    Full-time
    A company is looking for an AI Prototype Specialist (Vibe Coder).Key Responsibilities Collaborate with strategy and sales teams to understand client needs and challenges Design and build functio...Show moreLast updated: 9 hours ago
    Crossing Hurdles is hiring : Audio & Sound Specialist | $20 / hr Remote in Los Ange

    Crossing Hurdles is hiring : Audio & Sound Specialist | $20 / hr Remote in Los Ange

    MediabistroLos Angeles, CA, United States
    Remote
    Full-time
    Audio & Sound Specialist | $20 / hr Remote.Audio & Sound Specialist | $20 / hr Remote.This range is provided by Crossing Hurdles. Your actual pay will be based on your skills and experience — talk with ...Show moreLast updated: 4 days ago
    Audio Quality Evaluation (French - US) Job at Appen in Los Angeles

    Audio Quality Evaluation (French - US) Job at Appen in Los Angeles

    MediabistroLos Angeles, CA, United States
    Full-time
    Audio Quality Evaluation (French - US).Be the Voice of the Future – Join Project Lotus Today.Are you a native French speaker living in the U. Help shape the future of wearable tech by evaluating sma...Show moreLast updated: 4 days ago
    Audio Engineer - Fully Remote Job at Mercor in Los Angeles

    Audio Engineer - Fully Remote Job at Mercor in Los Angeles

    MediabistroLos Angeles, CA, United States
    Remote
    Full-time
    This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Headquartered in San Francisco, our investors include.Audio, Mu...Show moreLast updated: 4 days ago