This role is part of Anthropic's AI Reliability Engineering team, focusing on improving reliability across serving paths for Claude. The Staff Software Engineer will develop service level objectives, design monitoring and observability systems, build high‑availability serving infrastructure, lead incident response, and support safeguard model serving, while collaborating across the organization to ensure robust, safe AI services.
Staff Software Engineer, AI Reliability at Anthropic
Hybrid - San Francisco, CA; New York City, NY; Seattle, WA
More jobs at AnthropicSalary
USD 325,000 - 485,000
Responsibilities
- Develop appropriate Service Level Objectives for large language model serving systems, balancing availability and latency with development velocity
- Design and implement monitoring and observability systems across the token path
- Assist in the design and implementation of high-availability serving infrastructure across multiple regions and cloud provider
- Lead incident response for critical AI services, ensuring rapid recovery, thorough incident reviews, and systematic improvements
- Support the reliability of safeguard model serving – critical for both site reliability and Anthropic's safety commitments
Technologies
SDKAPI layersServing infrastructureAcceleratorsMonitoring and observability toolsHigh-availability serving infrastructureCloud provider servicesGPU/TPU/Trainium hardware
See if your resume is ready for this job
See how our AI can optimize your resume and improve your chances for this role.