A company is looking for a Staff AI Research Scientist - Evaluation.
Key Responsibilities
Lead research teams to produce original methodologies for evaluating large language models (LLMs)
Develop frameworks and assessment techniques to gain insights into model capabilities and limitations
Collaborate with engineers to create scalable benchmarks and evaluation systems
Required Qualifications
PhD or equivalent research experience in machine learning, computer science, or related fields
6+ years of post-doctoral experience in a research-focused environment
Strong background in LLM research and evaluation methodologies
Proficiency in Python and PyTorch for model analysis and evaluation
Strong publication record in AI evaluation or interpretability
Research Scientist • Sacramento, California, United States