Evaluation Scenario Writer - QA

Overview

At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI. The Mindrift platform, launched and powered by Toloka, connects domain experts with cutting-edge AI projects from innovative tech clients. Our mission is to unlock the potential of GenAI by tapping into real-world expertise from across the globe.

Who we\'re looking for : We\'re looking for curious and intellectually proactive contributors who never miss an error and can think outside of the box when brainstorming solutions. Are you comfortable with ambiguity and complexity? Does an async, remote, flexible opportunity sound exciting? Would you like to learn how modern AI systems are tested and evaluated?

This is a flexible, project-based opportunity well-suited for :

• Analysts, researchers, or consultants with strong critical thinking skills
• Students (senior undergrads / grad students) looking for an intellectually interesting gig
• People open to a part-time and non-permanent opportunity

About the project

We\'re on the hunt for an Evaluation Scenario Writer - QA for a new project focused on ensuring the quality and correctness of evaluation scenarios created for LLM agents. This project opportunity blends manual scenario validation, automated test thinking, and collaboration with writers and engineers. You will verify test logic, flag inconsistencies, and help maintain a high bar for evaluation coverage and clarity.

What you\'ll be doing

Although we\'re only looking for experts for this current project, contributors with consistent high-quality submissions may receive an invitation for ongoing collaboration across future projects.

How to Get Started

Apply to this post, qualify, and get the chance to contribute to a project aligned with your skills, on your own schedule. Shape the future of AI while building tools that benefit everyone.

Requirements

The ideal contributor will have :

We also value applicants who have :

Benefits

Job metadata

Referrals increase your chances of interviewing at Mindrift by 2x

Get notified about new Writer jobs in Austin, TX

Austin, TX $70,000.00-$80,000.00 3 days ago

Austin, TX $69,144.00-$90,000.00 3 weeks ago

Austin, TX $70,000.00-$90,000.00 2 weeks ago

J-18808-Ljbffr