Evaluation Engineer

A company is looking for an Evaluation Engineer to own the technical foundation of their auto-evaluation systems.

Key Responsibilities

Build and optimize a fast, user-friendly core auto-eval platform

Ensure evaluations are accurate and reliable, particularly in the context of pharma decision-making

Collaborate with the evals team to improve specific evaluations and mentor interns

Required Qualifications

At least 3 years of experience as a professional software engineer with complex backend systems

Aptitude and interest in evaluating decision-making processes in pharma

Knowledge of statistics for evaluating results

Experience with advanced Python and front-end development

Familiarity with AI infrastructure and evaluating ML systems