SpaceXAI is a small, highly motivated engineering team focused on building AI systems that understand the universe. The RL infrastructure team seeks an engineer to develop and maintain large-scale evaluation infrastructure, collaborating closely with modeling and evaluation teams to improve evaluation quality and support model training.
Member of Technical Staff - Evaluation Infrastructure na xAI
Presencial - Palo Alto, CA
Ver mais vagas na xAISalary
USD 180,000 - 440,000
Requirements
Skills
- Experience in building, debugging, and optimizing efficiency of large-scale distributed systems
- Willingness to dive deep and solve hard problems at all levels of the stack
- Experience in LLM inference
- Experience in GPU compute management, workload scheduling, and dynamic resource optimization
- Experience in developing interfaces for comparing models and evals
Responsibilities
- Build highly reliable, efficient, and easy to use infrastructure that runs all our evaluations at scale
- Collaborate closely with modeling & evaluation teams on developing new evals, maintaining evaluation signal quality, and building internal tooling to support training our next-generation of models
- Identify and resolve performance bottlenecks in all layers of the eval infrastructure stack, including inference, capacity fleet management, asynchronous eval orchestration, and more
Technologies
LLM inferenceGPU compute managementDistributed systems
Descubra se seu currículo está pronto para esta vaga
Veja como nossa IA pode otimizar seu currículo e aumentar suas chances de conseguir esta posição.