The Data Platform team builds and operates infrastructure responsible for large‑scale data transport and processing across the company. As a software engineer on the team, you will design, build, and operate distributed systems powering X’s data movement and compute, taking ownership of components that process trillions of events daily, driving scalability, performance, and reliability for product and ML workloads.
Member of Technical Staff - Data Platform at xAI
On-site - Palo Alto, CA
More jobs at xAISalary
USD 180,000 - 440,000
Requirements
Skills
- Proven expertise in distributed systems, stream processing, or large-scale data platforms
- Proficiency in Rust, Go, Scala or similar systems languages
- Hands‑on experience with Kafka, Flink, Spark, Trino, or Hadoop in production
- Strong debugging, profiling, and performance optimization skills
- Track record of shipping and maintaining critical infrastructure
- Comfortable working in fast‑moving, high‑stakes environments with minimal guardrails
Responsibilities
- Design and implement high‑throughput, low‑latency data ingestion and transport systems
- Scale and optimize multi‑tenant Kafka infrastructure supporting real‑time workloads
- Extend and tune Spark, Flink, and Trino for demanding production pipelines
- Build interfaces, APIs, and pipelines enabling teams to query, process, and move data at petabyte scale
- Debug and optimize distributed systems, with a focus on reliability and performance under load
- Collaborate with ML, product, and infrastructure teams to unblock critical data workflows
Technologies
RustGoScalaKafkaFlinkSparkTrinoHadoopHDFSApache KafkaApache FlinkApache Spark
See if your resume is ready for this job
See how our AI can optimize your resume and improve your chances for this role.