Senior LLM Quality Analyst

A company is looking for a Senior LLM Quality Analyst.

Key Responsibilities

Design and execute prompt engineering experiments to test strategies and evaluate model performance

Maintain response quality reporting and dashboards for performance metrics

Evaluate and improve AI outputs to ensure they meet educational needs

Required Qualifications

5+ years of professional experience in data analysis

Experience working with LLMs or AI products

Strong analytical skills and proficiency in SQL

Basic knowledge of statistics and experience with BI tools

K-12 teaching experience or EdTech industry experience is strongly preferred