Talent.com
Software Engineer - Data Platform

Software Engineer - Data Platform

xAIPalo Alto, CA, US
30+ days ago
Job type
  • Full-time
Job description

Job Description

Job Description

About xAI

xAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company's mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All engineers are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

About the Team

The Data Platform team at X builds and operates the infrastructure responsible for all large-scale data transport and processing across the company. We own and manage core systems including Apache Kafka, HDFS, Spark, Flink, and Trino, enabling real-time ML pipelines, feed ranking, experimentation, analytics, and observability at petabyte scale. Our team deals with latency-critical workloads, high-throughput streaming, and distributed compute systems that require fault tolerance, performance, and absolute reliability.

About the Role

As a software engineer on the Data Platform team, you will design, build, and operate the distributed systems powering X's data movement and compute. You will take ownership of infrastructure components that process trillions of events daily, driving the scalability, performance, and reliability of the systems that power product and ML workloads across the company.

What You Will Do

  • Design and implement high-throughput, low-latency data ingestion and transport systems.
  • Scale and optimize multi-tenant Kafka infrastructure supporting real-time workloads.
  • Extend and tune Spark, Flink, and Trino for demanding production pipelines.
  • Build interfaces, APIs, and pipelines enabling teams to query, process, and move data at petabyte scale.
  • Debug and optimize distributed systems, with a focus on reliability and performance under load.
  • Collaborate with ML, product, and infrastructure teams to unblock critical data workflows.

Ideal Candidate

  • Proven expertise in distributed systems, stream processing, or large-scale data platforms.
  • Proficiency in Rust, Go, Scala or similar systems languages.
  • Hands-on experience with Kafka, Flink, Spark, Trino, or Hadoop
  • in production.
  • Strong debugging, profiling, and performance optimization skills.
  • Track record of shipping and maintaining critical infrastructure.
  • Comfortable working in fast-moving, high-stakes environments with minimal guardrails.
  • Locations

  • We hire engineers in Palo Alto, and San Francisco. Our team usually works from the office 5 days a week but allow work-from-home days when required. Candidates who join in San Francisco must make it to Palo Alto at least twice a week.
  • Interview Process

    After submitting your application, the team reviews your CV and statement of exceptional work. If your application passes this stage, you will be invited to a 15 minute interview ("phone interview") during which a member of our team will ask some basic questions. If you clear the initial phone interview, you will enter the main process, which consists of 2 technical interviews and 1 project deep-dive interview :

  • Practical coding assessment in a language of your choice.
  • Systems design hands-on : Demonstrate practical skills in a live problem-solving session.
  • Project deep-dive : Present and answer questions about exceptional work that you've done.
  • Meet and greet with the wider team.
  • Our goal is to finish the main process within one week. Final interviews will be conducted in person.

    Annual Salary Range

    $180,000 - $440,000 USD

    Benefits

    Base salary is just one part of our total rewards package at X, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

    xAI is an equal opportunity employer.

    California Consumer Privacy Act (CCPA) Notice

    Create a job alert for this search

    Software Engineer Platform • Palo Alto, CA, US

    Related jobs
    • Promoted
    Senior Software Engineer, Big Data

    Senior Software Engineer, Big Data

    ZipRecruiterPalo Alto, CA, US
    Full-time
    We offer a hybrid work environment.Most US-based positions can also.To actively connect people to their next great opportunity. ZipRecruiter is a leading online employment marketplace.Powered by AI-...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Platform Engineer

    Cloud Platform Engineer

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Cloud Platform Engineer.Key Responsibilities Write, debug, and optimize code for the platform infrastructure Collaborate with software engineers through various progra...Show moreLast updated: 30+ days ago
    • Promoted
    Hadoop Platform Engineer

    Hadoop Platform Engineer

    RAMPS International Inc.San Jose, CA, US
    Full-time
    The Data and Analytics Platform team resides within Adobe's Information and Data Services team and we are looking for a Hadoop Platform Engineer who will be responsible for the implementation a...Show moreLast updated: 30+ days ago
    • Promoted
    Sr. / Staff Software Engineer, Big Data

    Sr. / Staff Software Engineer, Big Data

    PredactivPalo Alto, CA, US
    Full-time
    ShareThis, a Predactiv Company is a big data company that owns online behavior data of 1b+ users globally.We are developing an audience intelligence platform with cutting edge big data technologies...Show moreLast updated: 28 days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    VirtualVocationsSan Jose, California, United States
    Full-time
    A company is looking for a Principal Platform Data Engineer (Databricks Platform).Key Responsibilities Collaborate with stakeholders to translate business requirements into technical specificatio...Show moreLast updated: 30+ days ago
    • Promoted
    Platform Software Engineer

    Platform Software Engineer

    RainesDevSan Francisco, CA, US
    Full-time
    We’re not chasing the next app.We’re engineering the unseen layer — the low-level, rock-solid systems that allow sensitive data to move, sync, and stay secure across devices, dist...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Software Engineer - Distributed Data Systems

    Software Engineer - Distributed Data Systems

    xAIPalo Alto, CA, US
    Full-time
    AI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering exc...Show moreLast updated: 18 hours ago
    • Promoted
    Software Engineer, Data Application

    Software Engineer, Data Application

    NewsBreakMountain View, CA, US
    Full-time
    Founded in 2015, NewsBreak is the Content Intelligence platform shaping the future content economy.With over 40 million monthly active users, our flagship platform delivers highly personalized loca...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Software Engineer

    Senior Data Software Engineer

    PsiQuantumPalo Alto, CA, United States
    Full-time
    Quantum computing holds the promise of humanity's mastery over the natural world, but only if we can build a.PsiQuantum is on a mission to build the first real, useful quantum computers, capable of...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer, Enterprise AI

    Software Engineer, Enterprise AI

    Scale AI, Inc.San Francisco, CA, United States
    Full-time
    Scale GP (Scale Generative AI Platform) is an enterprise-grade Generative AI platform that provides APIs for knowledge retrieval, inference, evaluation, and more. We are looking for a strong enginee...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer

    Software Engineer

    SupermicroSan Jose, CA, United States
    Full-time
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Show moreLast updated: 30+ days ago
    • Promoted
    Platform Data Engineer

    Platform Data Engineer

    OhaloSan Francisco, CA, US
    Full-time
    Ohalo is seeking an experienced.This role involves building and maintaining data pipelines to support our machine learning engineering activities and managing data related to plant phenotypes and g...Show moreLast updated: 30+ days ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    VirtualVocationsSanta Clara, California, United States
    Full-time
    A company is looking for a Data Platform Engineer, Data Capture.Key Responsibilities Expand developer tools for capturing business events and operational data into the Lakehouse Enhance self-ser...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    ForhyreSunnyvale, CA, US
    Full-time
    We are looking for a passionate certified Data Engineer.The successful candidate will turn data into information, information into insight and insight into business decisions.Data analyst responsib...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer - Data Streaming

    Software Engineer - Data Streaming

    TigerGraphRedwood City, CA, US
    Full-time
    TigerGraph is a platform for advanced analytics and machine learning on connected data.TigerGraph's core technology is the only scalable graph database for the enterprise.Its proven technology ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer - Data Replication

    Senior Software Engineer - Data Replication

    TiDBSunnyvale, CA, US
    Full-time
    Join us as we scale our business by building on our tremendous success around the world.The massive database market is going to double over the next few years (the IDC estimates it to be $119B+ by ...Show moreLast updated: 30+ days ago
    • Promoted
    Solution Engineer

    Solution Engineer

    SupermicroSan Jose, CA, United States
    Full-time
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer II

    Data Engineer II

    VirtualVocationsSanta Clara, California, United States
    Full-time
    A company is looking for a Data Engineer II.Key Responsibilities Produce high-quality data models and maintain data integrity for analytics products Develop scalable ELT pipelines and business i...Show moreLast updated: 30+ days ago