Senior Research Engineer (Sonoma)

A fast-growing, deeply technical AI company is looking for a Research Engineer to join a small, high-performing team building the next generation of agentic LLM systems for software development. This is an opportunity to work at the frontier of AI, helping design and evaluate models that can understand, write, and reason about complex codebases.

We are looking for someone who is passionate about AI for code , obsessed with understanding how LLMs behave, and excited to help push the boundaries of autonomous software engineering.

What Youll Work On

• Design and run large-scale LLM evaluations , benchmarks, and experiments - particularly for code understanding and generation tasks.
• Build tools, datasets, and research frameworks that measure LLM reasoning, reliability, grounding, and hallucination reduction.
• Collaborate closely with product and engineering teams to improve model performance across real-world developer workflows.
• Work with frontier LLMs (across multiple providers) to analyze behavior, provide structured feedback, and drive improvements in accuracy, reliability, and autonomy.
• Prototype new capabilities for long-horizon agentic systems, including retrieval, planning, debugging, and automated coding workflows.
• Contribute to model fine-tuning and alignment work, including SFT, LoRA, DPO, or RLHF pipelines.
• Build production-quality research tools and evaluation pipelines that scale to real engineering environments.

What Were Looking For

Bonus Points

Why This Role Is Exciting

If youre passionate about AI for software engineering , love solving deep technical problems, and want to work at the frontier of LLM research, wed love to hear from you.