AI Quality Rater

A company is looking for a Generalist AI Quality Rater (US-Remote).

Key Responsibilities

Design prompts tailored to tasks, contexts, and audiences

Generate creative and informative texts such as stories, articles, and summaries

Evaluate and compare LLM responses for fluency, coherence, and factuality

Required Qualifications

Bachelor's degree in English, Creative Writing, Linguistics, Computer Science, or a related field

3+ years of experience in content writing, copywriting, or a related field

Strong understanding of LLM capabilities and limitations

Familiarity with data annotation tools and basic statistics or data analysis

Preferred experience in video generation, NLP knowledge, and research methods