Mercor is hiring: Audio Evaluation Expert - Fully Remote in IndianapolisMediabistro • Indianapolis, IN, United States

No longer accepting applications

Mercor is hiring : Audio Evaluation Expert - Fully Remote in Indianapolis

Mediabistro • Indianapolis, IN, United States

23 days ago

Job type

Full-time

Remote

Job description

1 day ago Be among the first 25 applicants

This range is provided by Mercor. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$35.00 / hr - $40.00 / hr

Mercor Overview

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D\'Angelo, Larry Summers, and Jack Dorsey.

Role Overview

Position : Writing Expert – Freelance, Remote
Commitment : 20 hours per week, Duration : 1 month
Contribute to a high-impact audio AI research project. Author prompt–golden answer pairs for training and evaluating language models.

Responsibilities

Design and Optimize Prompts : Create detailed audio prompts with multiple constraints and instructions.

Define and Document Evaluation Standards : Establish high-level expectations for correct responses in general audio consumer contexts, and develop a comprehensive rubric.

Conduct Model Testing and Grading : Run prompts through models and assess preliminary outputs against expectations.

Support Benchmarking and Quality Assurance : Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.

Requirements / Qualifications

Must-Have : BS or BA from a reputable institution, completed or in progress

Strong writing and critical thinking skills

Ability to work independently and meet deadlines

Significant familiarity with ChatGPT or similar tools for personal decision-making or hobbies

Preferred Qualifications

2+ years of experience in teaching or research

Engagement Details

Remote and asynchronous role

20 hours per week commitment

Duration : 1 month

Application Process

Complete an AI-led interview (about 15 minutes)

Complete a 45-minute written assessment to guide you through writing rubrics

If selected, you will be invited to work on the project

Resources & Support

For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome

For any help or support, reach out to : support@mercor.com

PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#J-18808-Ljbffr

Create a job alert for this search

Is Hiring Evaluation • Indianapolis, IN, United States

Related jobs

Travel MRI Technologist - $2,001 per week

Fusion Medical Staffing-Radiology • West Indianapolis, IN, US

Full-time

Fusion Medical Staffing-Radiology is seeking a travel MRI Technologist for a travel job in Indianapolis, Indiana.Job Description & Requirements Specialty : MRI Technologist Discipline : Allied Health...Show more

Last updated: 18 days ago • Promoted

Premium Auditor

Davies Risk Services • Plainfield, IN, US

Full-time

Join Davies Risk Services as a Premium Auditor — No Experience Required!.Are you a self-starter who thrives on independence, loves working with numbers, and enjoys meeting new people? Do you ...Show more

Last updated: 30+ days ago • Promoted

Technical and Customer Experience Advisor - Work From Home - US

Transcom • Indianapolis, IN, United States

Remote

Full-time

Do you love exploring the ways technology helps you do all your favorite things?.Do you love helping people and sharing your knowledge?. Do you want to grow your career with a company that rewards y...Show more

Last updated: 30+ days ago • Promoted

Survey Taker : Earn up to $25 per survey (Remote)

Earn Haus • Whitestown, IN, US

Remote

Full-time +1

Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion. You will help influence brand decisions on se...Show more

Last updated: 4 days ago • Promoted

Sr Sales Engineer

RENK • Camby, IN, United States

Full-time

RENK Systems Corporation, located in Camby, IN, is the US hub for Test Systems and other special machinery, domestically and abroad. RENK is the world leader in the design and manufacture of helicop...Show more

Last updated: 14 days ago • Promoted

Inventory Auditor

Costco Wholesale Corporation • Avon, IN, US

Full-time

Position Summary : Maintains accurate count of all merchandise on the floor, steel and receiving.Identifies, investigates and corrects inventory discrepancies. For additional information about pay ra...Show more

Last updated: 30+ days ago • Promoted

Remote Online Survey Taker – Earn Up to $25 Per Survey

Earn Haus • Lawrence, IN, US

Remote

Full-time +1

We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...Show more

Last updated: 1 day ago • Promoted

Extra Income Online – Remote Survey Taker Job Up to $25 Per Survey

Earn Haus • Knightstown, IN, US

Remote

Full-time +1

Last updated: 1 day ago • Promoted

Online Survey Taker. Earn up to $25 per survey. - Remote

Earn Haus • Brownsburg, IN, US

Remote

Full-time +1

Last updated: 1 day ago • Promoted

Director of Measurement and Evaluation

Medical College of Wisconsin • Indianapolis, IN, United States

Full-time

The Kern National Network for Flourishing in Medicine (KNN) is seeking a.Director of Measurement and Evaluation.This senior leadership role requires strategic thinking, advanced analytical skills, ...Show more

Last updated: 30+ days ago • Promoted

Advisor - LEM

Eli Lilly • Indianapolis, IN, US

Full-time

At Lilly, we unite caring with discovery to make life better for people around the world.We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work...Show more

Last updated: 30+ days ago

Travel CT Tech - $2,114 to $2,344 per week in Columbus, IN

AlliedTravelCareers • Columbus, IN, US

Full-time

AlliedTravelCareers is working with LRS Healthcare to find a qualified CT Tech in Columbus, Indiana, 47201!.Ready to start your next travel adventure? LRS Healthcare offers a full benefits package,...Show more

Last updated: 9 days ago • Promoted

Remote Market Research Participant (Hiring Immediately)

Earn Haus • Indianapolis, IN, United States

Remote

Full-time +1

Last updated: 30+ days ago • Promoted

Strategy Advancement Advisor - LTSS

Humana • Indianapolis, IN, US

Full-time

Strategy Advancement Advisor Ltss Program Manager.The Strategy Advancement Advisor Ltss Program Manager provides data-based strategic direction to identify and address business issues and opportuni...Show more

Last updated: 11 days ago • Promoted

Active Audiologist

United States Army • Westfield, IN, US

Full-time

THE ARMY HEALTH CARE ADVANTAGE As a member of the Army health care team, you’ll receive benefits that you won’t be able to get in a civilian career. Challenging Work Feel inspired with great case di...Show more

Last updated: 13 days ago • Promoted

Senior Advisor Statistics

SOMERSET STAFFING • Indianapolis, IN, United States

Full-time

Quick Apply

Job Description : Industry : Pharmaceutical / Biotech Job Category : Research & Development At ou...Show more

Last updated: 6 days ago

Senior Advisor Statistics

VIR Consultants Inc • Indianapolis, IN, United States

Full-time

Quick Apply

Job Description : Industry : Pharmaceutical / Biotech Job Category : Research & Development At ou...Show more

Last updated: 6 days ago

Advisor / Sr. Advisor – BioTDR Lead Optimization Mass Spectrometry

Eli Lilly • Indianapolis, IN, US

Full-time

Last updated: 30+ days ago