AIRE (AI Reliability Engineering) partners with teams across Anthropic to improve reliability across our most critical serving paths—from the SDK through our network, API layers, serving infrastructure, and accelerators. The role involves working closely with partner teams to build robust systems, respond to incidents, and collaborate on projects to ensure Claude remains reliable, all within a hybrid work environment located in London.
Staff Software Engineer, AI Reliability Engineering at Anthropic
Hybrid - London, UK
More jobs at AnthropicSalary
GBP 325,000 - 390,000
Requirements
Skills
- Strong distributed systems, infrastructure, or reliability backgrounds
- SRE, Production Engineer, or similar reliability-focused roles on large scale systems
- Experience operating large-scale model serving or training infrastructure (>1000 GPUs)
- Experience with ML hardware accelerators (GPUs, TPUs, Trainium)
- Understanding of ML-specific networking optimizations like RDMA and InfiniBand
- Experience with AI-specific observability tools and frameworks
- Experience with chaos engineering and systematic resilience testing
- Contributions to open-source infrastructure or ML tooling
- Bachelor’s degree or equivalent combination of education, training, and/or experience
- Relevant field of study for the role
Responsibilities
- Develop appropriate Service Level Objectives for large language model serving systems, balancing availability and latency with development velocity.
- Design and implement monitoring and observability systems across the token path.
- Assist in the design and implementation of high-availability serving infrastructure across multiple regions and cloud providers.
- Lead incident response for critical AI services, ensuring rapid recovery, thorough incident reviews, and systematic improvements.
- Support the reliability of safeguard model serving – critical for both site reliability and Anthropic's safety commitments.
Technologies
GPUsTPUsTrainiumRDMAInfiniBandlarge language model serving systemstoken path monitoringcloud providers
See if your resume is ready for this job
See how our AI can optimize your resume and improve your chances for this role.