SpaceXAI’s Data Platform team builds and operates the infrastructure responsible for large-scale data transport and processing across the company. As a software engineer on this team, you will design, build, and operate distributed systems that power real‑time ML pipelines, feed ranking, experimentation, analytics, and observability at petabyte scale, ensuring high availability, performance, and reliability.
Member of Technical Staff - Data Platform at xAI
On-site - Palo Alto, CA
More jobs at xAISalary
USD 180,000 - 440,000
Requirements
Skills
- Proven expertise in distributed systems, stream processing, or large-scale data platforms
- Proficiency in Rust, Go, Scala or similar systems languages
- Hands‑on experience with Kafka, Flink, Spark, Trino, or Hadoop in production
- Strong debugging, profiling, and performance optimization skills
- Track record of shipping and maintaining critical infrastructure
- Comfortable working in fast-moving, high‑stakes environments with minimal guardrails
Responsibilities
- Design and implement high-throughput, low-latency data ingestion and transport systems
- Scale and optimize multi-tenant Kafka infrastructure supporting real-time workloads
- Extend and tune Spark, Flink, and Trino for demanding production pipelines
- Build interfaces, APIs, and pipelines enabling teams to query, process, and move data at petabyte scale
- Debug and optimize distributed systems, with a focus on reliability and performance under load
- Collaborate with ML, product, and infrastructure teams to unblock critical data workflows
Technologies
Apache KafkaHDFSSparkFlinkTrinoRustGoScalaHadoop
See if your resume is ready for this job
See how our AI can optimize your resume and improve your chances for this role.