Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. The Product Manager on Claude Code’s model performance team will drive model launches end‑to‑end, build evals that measure what matters, and partner directly with researchers and product engineers to translate model improvements into developer‑facing outcomes. The role requires a blend of product, engineering, and AI expertise, with a focus on building infrastructure to support research and delivering tangible performance gains to users.
Product Manager, Claude Code Model Performance at Anthropic
Hybrid - San Francisco, CA, USA; Seattle, WA, USA
More jobs at AnthropicSalary
USD 305,000 - 460,000
Requirements
Skills
- 2+ years in product management or equivalent engineering experience
- Experience building agentic evals (e.g., SWE-bench-style task suites)
- Daily Claude Code user with ability to articulate desired behaviors
- Engineering background
- Deep grasp of AI concepts, model behavior, prompt engineering, and evaluation methodology
- Systems thinker
- Experience launching products or capabilities in ambiguous, research‑adjacent environments
- Creative, hacker spirit and love solving puzzles
- Bachelor’s degree in a relevant field
Responsibilities
- Own model launch planning and execution for Claude Code
- Design and implement agentic evals that measure real‑world coding performance
- Drive the engineering team’s eval roadmap
- Partner with researchers to define target behaviors and influence model development
- Talk with users and analyze transcripts to understand capability gaps and drive shipped improvements
- Synthesize signal from internal users, external developers, and competitive benchmarks into clear priorities
Technologies
Claude CodeAgentic evalsSWE-bench
See if your resume is ready for this job
See how our AI can optimize your resume and improve your chances for this role.