Talent.com
Anthropic
Product Manager, Claude Code Model PerformanceAnthropic • San Francisco, CA, United States
Product Manager, Claude Code Model Performance

Product Manager, Claude Code Model Performance

Anthropic • San Francisco, CA, United States
2 days ago
Job type
  • Full-time
Job description

Product Manager, Claude Code Model Performance

San Francisco, CA | Seattle, WA

About the Role

As a Product Manager on Claude Code's model performance team, you will drive model launches end-to-end, build evals that measure what matters, and partner directly with researchers and product engineers to translate model improvements into developer-facing outcomes.

Claude Code is the most capable coding agent in the world but there's much more we can do to extract the maximum performance from our models. We're looking for a PM who has personally built agentic evals, thinks in systems, uses Claude Code every day, and has refined model taste. You should be as comfortable influencing our research team as you are getting in the weeds of transcripts. You will be the connective tissue between frontier research and the millions of developers who depend on Claude Code to do their best work.

Responsibilities

  • Own model launch planning and execution for Claude Code: define readiness criteria, coordinate across research and product engineering, and ensure launches land cleanly with developers
  • Design and implement agentic evals that measure real-world coding performance
  • Drive the engineering team's eval roadmap
  • Partner with researchers working on coding capabilities to define target behaviors and influence model development with evidence from real usage
  • Talk with users and analyze transcripts to understand capability gaps and turn research progress into shipped improvements
  • Synthesize signal from internal users, external developers, and competitive benchmarks into clear priorities

You Might Be a Good Fit If You

  • Have personally built agentic evals (e.g. SWE-bench-style task suites)
  • Are a daily Claude Code user and can articulate what behaviors you'd want to change or add to the model
  • Have an engineering background and 2+ years in product management, or equivalent experience driving product direction as an engineer
  • Have a deep grasp of AI concepts and are comfortable going deep on model behavior, prompt engineering, and evaluation methodology
  • Are a systems thinker: when you find a problem, you build the infrastructure that prevents its whole class
  • Have launched products or capabilities in ambiguous, research-adjacent environments
  • Have a creative, hacker spirit and love solving puzzles

San Francisco and Seattle only

The annual compensation range for this role is listed below. For sales roles, the range provided is the role's On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.

Annual Salary:

$305,000 - $460,000 USD

Logistics

Minimum education: Bachelor's degree or an equivalent combination of education, training, and/or experience

Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience

Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position

Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.

Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.

We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team. Your safety matters to us. To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any linksvisit anthropic.com/careers directly for confirmed position openings.

How We're Different

We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact advancing our long-term goals of steerable, trustworthy AI rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.

The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.

Come Work With Us!

Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues. Guidance on Candidates' AI Usage: Learn about our policy for using AI in our application process.

Create a job alert for this search

Product Manager, Claude Code Model Performance • San Francisco, CA, United States

Similar jobs

Senior Technical Product Manager - Product Software

UrsusSan Mateo, CA, United States
Full-time

Senior Technical Product Manager - Product Software.This is an exciting time as we expand our live service and fleet of robots to new customers and geographies.To do this efficiently while maintain... Show more

 • Promoted

Product Manager, Claude Code Model Performance

AnthropicSan Francisco, CA, United States
Full-time

Product Manager, Claude Code Model Performance.San Francisco, CA | Seattle, WA.As a Product Manager on Claude Code's model performance team, you will drive model launches end-to-end, build evals th... Show more

 • Promoted

Product Manager, Growth, Scientific AI Models

BenchlingSan Francisco, CA, United States
Full-time

The Model Hub team is building a computational platform that provides access to cutting-edge scientific AI models to help scientists design better drugs.AlphaFold or Boltz2) predict structures, pre... Show more

 • Promoted

Senior Product Manager, Compute Platform

RobloxSan Mateo, CA, United States
Full-time

For roles that are based at our headquarters in San Mateo, CA: The starting base pay for this position is as shown below.The actual base pay is dependent upon a variety of job-related factors such ... Show more

 • Promoted

Lead Product Manager

LlamaIndexSan Francisco, CA, United States
Full-time

Join us and help shape the future of AI by defining the narrative around document understanding.LlamaIndex is on a mission to revolutionize how organizations utilize their knowledge by building cut... Show more

 • Promoted

Technical Product Manager (Construction Technology)

MetriX Talent SolutionsSan Francisco, CA, United States
Full-time

Technical Product Manager (Construction Technology).We're modernizing construction, a $12T global industry run by siloed software built 20-40 years ago (on-prem, no APIs, no mobile access, etc.We c... Show more

 • Promoted

Technical Manager, Software Platform

The Voleon GroupBerkeley, CA, United States
Full-time

Technical Manager, Software Platform Engineering.Voleon is a technology company that applies state-of-the-art AI and machine learning techniques to real-world problems in finance.For nearly two dec... Show more

 • Promoted

Lead Product Manager

DocuSignSan Francisco, CA, United States
Full-time +1

As a Lead Product Manager on the Applications Product Management team, you own high-impact internal application capabilities that power Docusign's go-to-market, customer success, and operations tea... Show more

 • Promoted

Product Manager

DatologyAIRedwood City, CA, United States
Full-time

At DatologyAI, we've built a state of the art data curation suite to automatically curate and optimize petabytes of data to create the best possible training data for your models.Training on curate... Show more

 • Promoted

Product Manager, Revenue Cycle

Heidi HealthSan Francisco, CA, United States
Full-time

Revenue cycle is where the economics of healthcare get decided.Their notes sit in a coding queue.A coder maps that documentation to ICD-10 codes.Those codes determine hospital funding.A single miss... Show more

 • Promoted

Product Manager

WorkstreamMenlo Park, CA, United States
Full-time

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce.Workstream has been purpose-built for the hourly workforce from day... Show more

 • Promoted

Technical Product Manager

BobyardSan Francisco, CA, United States
Full-time

Bobyard Construction is a $2T industry running on PDFs, rulers, and 1990s software.The biggest choke point is the cost estimate.Takeoffs are manual, slow, and one mistake blows millions.We use comp... Show more

 • Promoted

Senior Director, Software Product Management and Product Engineering

BillionToOneMenlo Park, CA, United States
Full-time

Senior Director, Software Product Management and Product Engineering.A Rare Opportunity to Shape the Future of Genomics.Join a team of brilliant, passionate innovators determined to transform healt... Show more

 • Promoted

Technical Product Manager

Amadeus SearchSan Francisco, CA, United States
Full-time

Our client is an early-stage technology company building next-generation AI infrastructure designed to remove the limitations of scale, hardware dependency, and cost.Their platform enables develope... Show more

 • Promoted

Product Manager - Lidar

OusterSan Francisco, CA, United States
Full-time

At Ouster, we're building a safer, smarter, and more sustainable future by bringing vision to the machines that shape our world.As a leading global provider of high-resolution digital lidar sensors... Show more

 • Promoted

Product Manager

AmpcusSan Francisco, CA, United States
Full-time

Technology and Business consulting services.We are in search of a highly motivated candidate to join our talented team.Location(s): San Francisco, CA.Minimum of 15 years of experience in a data ste... Show more

 • Promoted

Staff Product Manager, Core Rider

LyftSan Francisco, CA, United States
Full-time

Staff Product Manager, Core Rider.At Lyft, our purpose is to serve and connect.We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thr... Show more

 • Promoted

Product Manager

unitQSan Francisco, CA, United States
Full-time

At unitQ, we leverage AI and advanced analytics to enable businesses to proactively monitor and improve product quality based on real-time user feedback from both public and private channels.We're ... Show more

 • Promoted

Product Manager, Hive Models

HiveSan Francisco, CA, United States
Full-time

Product Manager, Hive Models Role.As a Product Manager on our Hive Models team, you will work cross-functionally with all stakeholders to define product requirements and see the implementation thro... Show more

 • Promoted

Technical Accounting Manager, New Product

RobinhoodMenlo Park, CA, United States
Full-time

Technical Accounting Manager, New Product.Join us in building the future of finance.Our mission is to democratize finance for all.An estimated $124 trillion of assets will be inherited by younger g... Show more