Join Anthropic as a Technical Program Manager for Inference to drive strategic initiatives, coordinate cross‑functional teams, optimize performance, and ensure reliable deployments across hardware platforms.
Technical Program Manager, Inference Performance na Anthropic
Híbrido - San Francisco, CA
Ver mais vagas na AnthropicSalary
USD 290,000 - 365,000
Requirements
Skills
- Several years of experience in technical program management with proven success delivering complex infrastructure programs, preferably in ML/AI systems or large‑scale distributed systems
- Deep technical understanding of inference systems, compilers, or hardware accelerators
- Ability to create structure and processes in ambiguous environments, bringing clarity to complex cross‑team initiatives
- Strong stakeholder management skills and ability to build trust with both technical and non‑technical partners
- Comfortable navigating competing priorities and using data to drive technical decisions
- Experience with infrastructure scaling initiatives, hardware integrations, or deployment governance
- Passion for AI infrastructure and understanding of challenges in deploying and scaling large language models
- Bachelor’s degree or an equivalent combination of education, training, and/or experience
Responsibilities
- Lead cross‑functional initiatives for new infrastructure integration, establishing clear ownership, timelines, and communication channels between teams
- Drive end‑to‑end planning for major infrastructure transitions including platform modernization and new tech adoption
- Partner with engineering teams to identify optimization opportunities, track performance metrics, and prioritize work that unlocks capacity gains
- Coordinate across runtime and accelerator layers to ensure efficiency wins ship without compromising reliability
- Drive end‑to‑end readiness for model and feature launches across multiple hardware platforms
- Establish processes for cross‑platform validation, manage launch timelines, and ensure smooth handoffs between runtime, accelerator, and downstream teams
- Own and prioritize the inference deployment roadmap, working closely with engineering leadership to prioritize initiatives and manage dependencies
- Provide visibility into upcoming changes and their organizational impact
- Build strong relationships across research, engineering, and product teams to understand requirements and constraints
- Translate technical complexities into clear updates for leadership and ensure alignment on priorities and timelines
- Identify inefficiencies in current workflows and drive systematic improvements
- Establish metrics and dashboards to track infrastructure health, capacity utilization, and deployment success rates
Technologies
Inference systemsCompilersHardware acceleratorsML/AI systemsLarge‑scale distributed systemsInference runtimeAccelerator performance
Descubra se seu currículo está pronto para esta vaga
Veja como nossa IA pode otimizar seu currículo e aumentar suas chances de conseguir esta posição.