Research Scientist

About the Company

We are a seed-stage AI company building the industry standard for evaluating and benchmarking large language models on real enterprise tasks.

About the Role

As a Research Scientist, you will develop new benchmarks, methodologies, and evaluation pipelines that shape how cutting-edge models are assessed, compared, and deployed in production environments. Your work will directly influence model selection and safety decisions across foundation model labs, high-growth AI product companies, and Fortune-scale enterprises.

Responsibilities

Benchmarking & Model Analysis

• Evaluate newly released models as they launch (e.g., Gemini, DeepSeek, etc.)
• Run large-scale assessment workflows using internal evaluation infrastructure
• Compare model performance across enterprise-grade task categories

Design New Benchmarks from Scratch

Advance Automated Evaluation Methodologies

Cross-functional Collaboration

Qualifications

Required Skills

Preferred Skills

Pay range and compensation package

Equal Opportunity Statement

Visa sponsorship available. Relocation support. Health & dental coverage. Lunch + dinner provided, snacks & coffee. Unlimited PTO. Weekly happy hours with community guests. Team events (bowling, hiking, rock climbing, etc.). Swag program (hats, etc.).

Work Environment & Culture

In-person, San Francisco HQ (required). Core hours : 9–5, some teammates extend voluntarily. Most team members work 1 weekend day per week (flexible). High-ownership, low-ego, collaborative. Live demos Mondays, team lunch Thursdays, community Fridays. Early-stage pace, applied focus—not academic publishing.

Tech Environment

(while research-focused, exposure beneficial) Backend : Python / Django. Frontend : React + TypeScript. Infra : AWS. Evaluation frameworks + internal tooling.

Why This Role Is Unique

The company already collaborates with foundation model labs, high-growth AI vertical product companies, and Fortune 500 enterprises (not publicly facing). ChatGPT Vals AI $5M seed raised, runway of 2+ years at current burn. Only one research scientist is being hired—true founding impact. Opportunity to define industry standards for model trust, reliability, and certification. Positioned to become the rating agency for generative AI.