Audio Evaluation Expert - Fully Remote Job at Mercor in Albuquerque

MediabistroAlbuquerque, NM, United States

2 days ago

Job type

Full-time

Remote

Job description

1 day ago Be among the first 25 applicants

This range is provided by Mercor. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$35.00 / hr - $40.00 / hr

Mercor Overview

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D\'Angelo, Larry Summers, and Jack Dorsey.

Role Overview

Position : Writing Expert – Freelance, Remote
Commitment : 20 hours per week, Duration : 1 month
Contribute to a high-impact audio AI research project. Author prompt–golden answer pairs for training and evaluating language models.

Responsibilities

Design and Optimize Prompts : Create detailed audio prompts with multiple constraints and instructions.

Define and Document Evaluation Standards : Establish high-level expectations for correct responses in general audio consumer contexts, and develop a comprehensive rubric.

Conduct Model Testing and Grading : Run prompts through models and assess preliminary outputs against expectations.

Support Benchmarking and Quality Assurance : Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.

Requirements / Qualifications

Must-Have : BS or BA from a reputable institution, completed or in progress

Strong writing and critical thinking skills

Ability to work independently and meet deadlines

Significant familiarity with ChatGPT or similar tools for personal decision-making or hobbies

Preferred Qualifications

2+ years of experience in teaching or research

Engagement Details

Remote and asynchronous role

20 hours per week commitment

Duration : 1 month

Application Process

Complete an AI-led interview (about 15 minutes)

Complete a 45-minute written assessment to guide you through writing rubrics

If selected, you will be invited to work on the project

Resources & Support

For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome

For any help or support, reach out to : support@mercor.com

PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#J-18808-Ljbffr

Create a job alert for this search

Audio Evaluation Job • Albuquerque, NM, United States

Related jobs

Promoted

Licensed Autism Evaluation Consultant

Behavior Change Institute, LLCAlbuquerque, NM, US

Part-time

Licensed Autism Evaluation Consultant.Location : New Mexico : Virtual / Optional In-State Travel Assignments .Employment Type : Contract / Part-Time. Pay Rate : $100 per hour (negotiable based on exp...Show moreLast updated: 2 days ago

Become a Luxury Brand Evaluator in San Juan, PR- Apply Now Job at CXG in Albuque

MediabistroAlbuquerque, NM, United States

Full-time

Become a Luxury Brand Evaluator in San Juan, PR - Apply Now.Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, ...Show moreLast updated: 2 days ago

Associate Technical Audio Designer | North America | Europe | Fully Remote Job a

MediabistroAlbuquerque, NM, United States

Remote

Full-time

We are looking for a Associate Tech Audio Designer to join, this role will be reporting into our Audio Director.Working with audio designers and other disciplines to design, prototype, and implemen...Show moreLast updated: 2 days ago

Audio Prompt Design Specialist Job at Mercor in Albuquerque

MediabistroAlbuquerque, NM, United States

Full-time

This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Mercor connects elite creative and technical talent with leadin...Show moreLast updated: 2 days ago

Promoted

AI Trainer Analyst

VirtualVocationsAlbuquerque, New Mexico, United States

Full-time

A company is looking for an Agent Evaluation Analyst - AI Trainer.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missin...Show moreLast updated: 1 day ago

Remote Audio Annotation Specialist (AI Training) - 33328 Job at Turing in Albuqu

MediabistroAlbuquerque, NM, United States

Remote

Full-time

Be among the first 25 applicants.Turing is an AI-powered tech services company with a mission to accelerate AGI advancement and deployment by bridging the gap between global talent from 100+ countr...Show moreLast updated: 2 days ago

Sound Designer Job at Mercor in Albuquerque

MediabistroAlbuquerque, NM, United States

Full-time

This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Headquartered in San Francisco, our investors include.Position : ...Show moreLast updated: 2 days ago

Promoted

Audiologist - Albuquerque NM

MRG ExamsCorrales, NM, United States

Full-time +1

Are you a Licensed Audiologist looking to take on an assessment role?.Would you find it rewarding to serve the Veteran community?. We are looking for an Audiologist to perform medical assessments on...Show moreLast updated: 30+ days ago

Mission.org is hiring : Senior Podcast Producer (Remote) in Albuquerque

MediabistroAlbuquerque, NM, United States

Remote

Full-time

C-Suite and VP-level audiences across business and technology.Our shows set the conversation for industries — and we partner with some of the most innovative companies in the world to make that hap...Show moreLast updated: 2 days ago

Crossing Hurdles is hiring : Audio Engineer | $20 / hr Remote in Albuquerque

MediabistroAlbuquerque, NM, United States

Remote

Full-time

Audio Engineer | $20 / hr Remote.Position : Audio & Sound Specialist.Duration : 2–3 months (with potential extensions).Identify and describe soundscapes of audio–visual content for AI training datasets...Show moreLast updated: 2 days ago

Crossing Hurdles is hiring : Audio Specialist | $20 / hr Remote in Albuquerque

MediabistroAlbuquerque, NM, United States

Remote

Full-time

Audio Specialist | $20 / hr Remote.This range is provided by Crossing Hurdles.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Crossing Hurdles is ...Show moreLast updated: 2 days ago

Audio Engineer - Sound Design Expert Job at Mercor in Albuquerque

MediabistroAlbuquerque, NM, United States

Full-time

Audio Engineer - Sound Design Expert.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Headquartered in San Franc...Show moreLast updated: 2 days ago

Audio Quality Evaluation (French - US) Job at Appen in Albuquerque

MediabistroAlbuquerque, NM, United States

Full-time

Audio Quality Evaluation (French - US).Be the Voice of the Future – Join Project Lotus Today.Are you a native French speaker living in the U. Help shape the future of wearable tech by evaluating sma...Show moreLast updated: 2 days ago

Video Teleconferencing (VTC) Engineer Job at Zachary Piper Solutions in Albuquer

MediabistroAlbuquerque, NM, United States

Full-time

Video Teleconferencing (VTC) Engineer.Be among the first 25 applicants.Video Teleconferencing (VTC) Engineer.Get AI-powered advice on this job and more exclusive features.Zachary Piper Solutions is...Show moreLast updated: 30+ days ago

Audio Model Trainer - English Expert | Upto $20 / hr Remote Job at Mercor in Albuq

MediabistroAlbuquerque, NM, United States

Remote

Full-time

Audio Model Trainer - English Expert | Upto $20 / hr Remote.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Merco...Show moreLast updated: 2 days ago

Turing is hiring : Remote Audio Annotation Specialist (AI Training) - 33328 in Al

MediabistroAlbuquerque, NM, United States

Remote

Full-time

Audio Recording Project - French (France) Job at Welocalize in Albuquerque

MediabistroAlbuquerque, NM, United States

Full-time

We are looking for fluent French speakers to participate in a scripted audio data collection project.This is a remote, freelance opportunity that's simple, flexible, and a great way to earn extra m...Show moreLast updated: 2 days ago

Appen is hiring : Audio Recording Project – Help Shape the Future of AI! in Albuq

MediabistroAlbuquerque, NM, United States

Full-time

Audio Recording Project – Help Shape the Future of AI!.Be among the first 25 applicants.Do you live in one of the states listed below, speak English as your second language, and fall within the age...Show moreLast updated: 2 days ago

Sound Designer | $20 / hr Remote Job at Crossing Hurdles in Albuquerque

MediabistroAlbuquerque, NM, United States

Remote

Full-time

Sound Designer | $20 / hr Remote.This range is provided by Crossing Hurdles.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Direct message the job...Show moreLast updated: 2 days ago

Welo Data is hiring : French (Canada) Scripted Audio Project in Albuquerque

MediabistroAlbuquerque, NM, United States

Full-time

French (Canada) Scripted Audio Project.Equipment : Laptop / desktop + mobile phone.Record short, conversational audio clips in French (Canada). Simulate natural environments (car, café, office).Follow ...Show moreLast updated: 2 days ago