Junior LLM Quality Analyst

A company is looking for a Junior LLM Quality Analyst.

Key Responsibilities

Manage LLM feedback intake, triage, and prioritize user feedback on LLM outputs

Develop and maintain evaluation test suites for LLM performance and evaluator rubrics

Support evaluator and judge development, including drafting prompts and scoring rubrics

Required Qualifications

1-3 years of professional experience or relevant internship experience

Education background in education or related field

Experience with LLMs or AI products is preferred

Passionate about solving education problems with technology

Comfortable working in a fast-paced or startup environment