Mercor is hiring : Audio Evaluation Expert - Fully Remote in Portland

MediabistroPortland, OR, United States

1 day ago

Job type

Full-time

Remote

Job description

1 day ago Be among the first 25 applicants

This range is provided by Mercor. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$35.00 / hr - $40.00 / hr

Mercor Overview

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D\'Angelo, Larry Summers, and Jack Dorsey.

Role Overview

Position : Writing Expert – Freelance, Remote
Commitment : 20 hours per week, Duration : 1 month
Contribute to a high-impact audio AI research project. Author prompt–golden answer pairs for training and evaluating language models.

Responsibilities

Design and Optimize Prompts : Create detailed audio prompts with multiple constraints and instructions.

Define and Document Evaluation Standards : Establish high-level expectations for correct responses in general audio consumer contexts, and develop a comprehensive rubric.

Conduct Model Testing and Grading : Run prompts through models and assess preliminary outputs against expectations.

Support Benchmarking and Quality Assurance : Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.

Requirements / Qualifications

Must-Have : BS or BA from a reputable institution, completed or in progress

Strong writing and critical thinking skills

Ability to work independently and meet deadlines

Significant familiarity with ChatGPT or similar tools for personal decision-making or hobbies

Preferred Qualifications

2+ years of experience in teaching or research

Engagement Details

Remote and asynchronous role

20 hours per week commitment

Duration : 1 month

Application Process

Complete an AI-led interview (about 15 minutes)

Complete a 45-minute written assessment to guide you through writing rubrics

If selected, you will be invited to work on the project

Resources & Support

For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome

For any help or support, reach out to : support@mercor.com

PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#J-18808-Ljbffr

Create a job alert for this search

Is Hiring Evaluation • Portland, OR, United States

Related jobs

Mercor is hiring : Audio Model Trainer - English Expert | Upto $20 / hr Remote in P

MediabistroPortland, OR, United States

Remote

Full-time

Audio Model Trainer - English Expert | Upto $20 / hr Remote.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Merco...Show moreLast updated: 1 day ago

Freelance Luxury Brand Evaluator - Portland, OR

CXGGresham, OR, US

Full-time

Quick Apply

Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in custo...Show moreLast updated: 10 days ago

Audio Prompt Design Specialist Job at Mercor in Portland

MediabistroPortland, OR, United States

Full-time

This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Mercor connects elite creative and technical talent with leadin...Show moreLast updated: 1 day ago

Become a Luxury Brand Evaluator in Oregon - Apply Now

CXGBeaverton, OR, US

Full-time

Quick Apply

As a luxury brand evaluator, you will step into the world of luxury to discreetly assess customer experiences, providing critical feedback that helps brands refine their services.Whether visiting b...Show moreLast updated: 10 days ago

Escape Velocity is hiring : Associate Technical Audio Designer | North America |

MediabistroPortland, OR, United States

Full-time

We are looking for a Associate Tech Audio Designer to join, this role will be reporting into our Audio Director.Working with audio designers and other disciplines to design, prototype, and implemen...Show moreLast updated: 1 day ago

Welocalize is hiring : Audio Recording Project - French (France) in Portland

MediabistroPortland, OR, United States

Full-time

We are looking for fluent French speakers to participate in a scripted audio data collection project.This is a remote, freelance opportunity that's simple, flexible, and a great way to earn extra m...Show moreLast updated: 1 day ago

Audio Recording Project - French (Canada) Job at Welocalize in Portland

MediabistroPortland, OR, United States

Full-time

We are looking for fluent French (Canada) speakers to participate in a scripted audio data collection project.This is a remote, freelance opportunity that's simple, flexible, and a great way to ear...Show moreLast updated: 1 day ago

Wachter, Inc. is hiring : Audio Visual Field Engineer in Portland

MediabistroPortland, OR, United States

Full-time

At Wachter, we specialize in delivering innovative, state-of-the-art audiovisual systems for a wide range of industries.We design, install, and maintain systems that enhance collaboration, communic...Show moreLast updated: 1 day ago

Audio Specialist | $20 / hr Remote Job at Crossing Hurdles in Portland

MediabistroPortland, OR, United States

Remote

Full-time

Audio Specialist | $20 / hr Remote.This range is provided by Crossing Hurdles.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Crossing Hurdles is ...Show moreLast updated: 1 day ago

Video Filtering Expert

MediabistroPortland, OR, United States

Full-time

Role Overview Mercor is partnering with a frontier AI lab to support the evaluation of AI-generated videos.We are seeking detail-oriented video rating experts to assess whether visual outputs f...Show moreLast updated: 1 day ago

Promoted

Remote Market Research Participant (Hiring Immediately)

Earn HausSaint Helens, Oregon, US

Remote

Full-time +2

We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...Show moreLast updated: 2 days ago

Escape Velocity Entertainment is hiring : Associate Technical Audio Designer | No

MediabistroPortland, OR, United States

Full-time

Associate Technical Audio Designer to join, this role will be reporting into our Audio Director.Working with audio designers and other disciplines to design, prototype, and implement audio systems....Show moreLast updated: 1 day ago

Mercor is hiring : Sound Designer in Portland

MediabistroPortland, OR, United States

Full-time

This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Headquartered in San Francisco, our investors include.Position : ...Show moreLast updated: 1 day ago

Associate Technical Audio Designer | North America | Europe | Fully Remote Job a

MediabistroPortland, OR, United States

Remote

Full-time

Associate Technical Audio Designer | North America | Europe | Fully Remote.We are looking for an Associate Technical Audio Designer to join our team. This role reports to the Audio Director and coll...Show moreLast updated: 1 day ago

Promoted

Online Program Evaluation Instructor

VirtualVocationsAloha, Oregon, United States

Part-time

A company is looking for a Part-Time Faculty member to teach SWK 775 (M700) Program Evaluation for Spring 2026.Key Responsibilities Developing and / or updating a class syllabus Preparing lectures...Show moreLast updated: 1 day ago

Promoted

Remote AI Writing Evaluator

OutlierVancouver, WA, United States

Remote

Full-time

Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...Show moreLast updated: 2 days ago

Audio Engineer & Project Manager Job at Stryker Corporation in Portland

MediabistroPortland, OR, United States

Full-time

Craft Sound That Inspires, Lead Projects That Deliver.Advertising isn't just seen-it's heard.In performance marketing, audio has the power to cut through the noise, shape emotions, and drive result...Show moreLast updated: 2 days ago

Video Interpreter Remote Job at Convo Communications in Portland

MediabistroPortland, OR, United States

Remote

Full-time

About Convo Communications LLC.Convo Communications is a Deaf-owned, Deaf-operated, and FCC-certified company that strives to connect humans through universal communication solutions shaped by cult...Show moreLast updated: 1 day ago

Sound Designer | $20 / hr Remote Job at Crossing Hurdles in Portland

MediabistroPortland, OR, United States

Remote

Full-time

Sound Designer | $20 / hr Remote.This range is provided by Crossing Hurdles.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Direct message the job...Show moreLast updated: 1 day ago

Convo Communications, LLC is hiring : Video Interpreter Remote in Portland

MediabistroPortland, OR, United States

Remote

Full-time

Convo Communications is a Deaf-owned, Deaf-operated, and FCC-certified company that strives to connect humans through universal communication solutions shaped by cultural experiences.We are seeking...Show moreLast updated: 2 days ago