SpaceXAI is a small, highly motivated engineering team focused on building AI systems that understand the universe. The RL infrastructure team seeks an engineer to develop and maintain large-scale evaluation infrastructure, collaborating closely with modeling and evaluation teams to improve evaluation quality and support model training.
Member of Technical Staff - Evaluation Infrastructure at xAI
On-site - Palo Alto, CA
More jobs at xAISalary
USD 180,000 - 440,000
Requirements
Skills
- Experience in building, debugging, and optimizing efficiency of large-scale distributed systems
- Willingness to dive deep and solve hard problems at all levels of the stack
- Experience in LLM inference
- Experience in GPU compute management, workload scheduling, and dynamic resource optimization
- Experience in developing interfaces for comparing models and evals
Responsibilities
- Build highly reliable, efficient, and easy to use infrastructure that runs all our evaluations at scale
- Collaborate closely with modeling & evaluation teams on developing new evals, maintaining evaluation signal quality, and building internal tooling to support training our next-generation of models
- Identify and resolve performance bottlenecks in all layers of the eval infrastructure stack, including inference, capacity fleet management, asynchronous eval orchestration, and more
Technologies
LLM inferenceGPU compute managementDistributed systems
See if your resume is ready for this job
See how our AI can optimize your resume and improve your chances for this role.