Remote Text Quality Evaluator

Earn up to $16 USD/hourly and work fully remotely and flexibly.

Outlier, a platform owned and operated by Scale AI, is looking for English speakers to contribute their expertise toward training and refining cutting-edge AI systems. If you're passionate about improving models and excited by the future of AI, this is your opportunity to make a real impact.

What You’ll Do

• Work from a real user perspective to create natural, high quality data that reflects how people actually use AI in practice.
• Review, compare, and rank responses generated by large language models, focusing on usefulness, clarity, and reasoning quality.
• Contribute across a range of projects based on your skills, interests, and experience.

What We’re Looking For

• Analytical and Problem-Solving Skills: Ability to craft thoughtful prompts and evaluate nuanced AI responses with sound judgment.
• Strong Written Communication: Clear, structured writing to explain decisions, provide feedback, and articulate why one response is stronger than another.
• Care and Precision in Execution: A consistent ability to follow guidelines, notice subtle differences, and ensure outputs meet defined quality standards.

Nice to Have

• Background in fields such as literature, creative writing, history, philosophy, theology, or similar disciplines.
• Prior experience in writing or editorial roles, such as content strategy, technical writing, or editing.
• Curiosity about AI systems, machine learning, or creative technology tools.

Pay & Logistics

• Base Rate: depending on location: US $16.07, GB £ 13.30 GBP, CA $20.50 CAD, AU $26.25 AUD, IE €14.60 EUR, NZ $26.00 NZD
• Bonuses: Additional pay available based on project performance.
• Type: Freelance/1099 contract — not an internship.
• Location: 100% remote
• Schedule: Flexible hours — you choose when and how much to work.
• Payouts: Weekly via our secure platform.

This is a freelance position that is paid on a per-hour basis. We don’t offer internships as this is a freelance role. You also must be authorized to work in your country of residence, and we will not be providing sponsorship since this is a 1099 contract opportunity. However, if you are an international student, you may be able to sign up if you are on a visa. You should contact your tax/immigration advisor with specific questions regarding your circumstances. We are unable to provide any documentation supporting employment at this time. Please be advised that compensation rates may differ for non-US locations.