SpaceXAI’s Data Platform team builds and operates the infrastructure responsible for large-scale data transport and processing across the company. As a software engineer on this team, you will design, build, and operate distributed systems that power real‑time ML pipelines, feed ranking, experimentation, analytics, and observability at petabyte scale, ensuring high availability, performance, and reliability.
Member of Technical Staff - Data Platform en xAI
Presencial - Palo Alto, CA
Más vacantes en xAISalary
USD 180,000 - 440,000
Requirements
Skills
- Proven expertise in distributed systems, stream processing, or large-scale data platforms
- Proficiency in Rust, Go, Scala or similar systems languages
- Hands‑on experience with Kafka, Flink, Spark, Trino, or Hadoop in production
- Strong debugging, profiling, and performance optimization skills
- Track record of shipping and maintaining critical infrastructure
- Comfortable working in fast-moving, high‑stakes environments with minimal guardrails
Responsibilities
- Design and implement high-throughput, low-latency data ingestion and transport systems
- Scale and optimize multi-tenant Kafka infrastructure supporting real-time workloads
- Extend and tune Spark, Flink, and Trino for demanding production pipelines
- Build interfaces, APIs, and pipelines enabling teams to query, process, and move data at petabyte scale
- Debug and optimize distributed systems, with a focus on reliability and performance under load
- Collaborate with ML, product, and infrastructure teams to unblock critical data workflows
Technologies
Apache KafkaHDFSSparkFlinkTrinoRustGoScalaHadoop
Descubre si tu currículum está listo para esta vacante
Mira cómo nuestra IA puede optimizar tu currículum y aumentar tus chances en este puesto.