The Performance Engineer role at Anthropic involves solving large-scale machine learning systems problems, developing high-performance solutions to optimize throughput and robustness of distributed models, collaborating closely with research and engineering teams, and contributing to the advancement of AI technology.
Performance Engineer at Anthropic
Hybrid - San Francisco, CA; New York City, NY; Seattle, WA
More jobs at AnthropicSalary
USD 280,000 - 850,000
Requirements
Skills
- significant software engineering or machine learning experience, particularly at supercomputing scale
- results-oriented, with a bias towards flexibility and impact
- pick up slack, even if it goes outside your job description
- enjoy pair programming (we love to pair!)
- want to learn more about machine learning research
- care about the societal impacts of your work
- high performance, large-scale ML systems
- GPU/Accelerator programming
- ML framework internals
- OS internals
- language modeling with transformers
- Bachelor’s degree or equivalent combination of education, training, and/or experience
Responsibilities
- identify large-scale systems problems and develop systems that optimize throughput and robustness of distributed ML systems
- implement low-latency high-throughput sampling for large language models
- implement GPU kernels to adapt models to low-precision inference
- write a custom load-balancing algorithm to optimize serving efficiency
- build quantitative models of system performance
- design and implement a fault-tolerant distributed system running with a complex network topology
- debug kernel-level network latency spikes in a containerized environment
Technologies
Machine LearningGPU/Accelerator programmingDistributed SystemsContainerized environmentTransformer modelsOS internals
See if your resume is ready for this job
See how our AI can optimize your resume and improve your chances for this role.