Talent.com
Software Engineer - Data Platform
Software Engineer - Data PlatformXai • Palo Alto, CA, United States
Software Engineer - Data Platform

Software Engineer - Data Platform

Xai • Palo Alto, CA, United States
30+ days ago
Job type
  • Full-time
Job description

About xAI

xAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company's mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All engineers are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

About the Team

The Data Platform team at X builds and operates the infrastructure responsible for all large-scale data transport and processing across the company. We own and manage core systems including Apache Kafka, HDFS, Spark, Flink, and Trino, enabling real-time ML pipelines, feed ranking, experimentation, analytics, and observability at petabyte scale. Our team deals with latency-critical workloads, high-throughput streaming, and distributed compute systems that require fault tolerance, performance, and absolute reliability.

About the Role

As a software engineer on the Data Platform team, you will design, build, and operate the distributed systems powering X's data movement and compute. You will take ownership of infrastructure components that process trillions of events daily, driving the scalability, performance, and reliability of the systems that power product and ML workloads across the company.

What You Will Do

  • Design and implement high-throughput, low-latency data ingestion and transport systems.
  • Scale and optimize multi-tenant Kafka infrastructure supporting real-time workloads.
  • Extend and tune Spark, Flink, and Trino for demanding production pipelines.
  • Build interfaces, APIs, and pipelines enabling teams to query, process, and move data at petabyte scale.
  • Debug and optimize distributed systems, with a focus on reliability and performance under load.
  • Collaborate with ML, product, and infrastructure teams to unblock critical data workflows.

Ideal Candidate

  • Proven expertise in distributed systems, stream processing, or large-scale data platforms.
  • Proficiency in Rust, Go, Scala or similar systems languages.
  • Hands-on experience with Kafka, Flink, Spark, Trino, or Hadoop
  • in production.
  • Strong debugging, profiling, and performance optimization skills.
  • Track record of shipping and maintaining critical infrastructure.
  • Comfortable working in fast-moving, high-stakes environments with minimal guardrails.
  • Locations

  • We hire engineers in Palo Alto, and San Francisco. Our team usually works from the office 5 days a week but allow work-from-home days when required. Candidates who join in San Francisco must make it to Palo Alto at least twice a week.
  • Interview Process

    After submitting your application, the team reviews your CV and statement of exceptional work. If your application passes this stage, you will be invited to a 15 minute interview ("phone interview") during which a member of our team will ask some basic questions. If you clear the initial phone interview, you will enter the main process, which consists of 2 technical interviews and 1 project deep-dive interview :

  • Practical coding assessment in a language of your choice.
  • Systems design hands-on : Demonstrate practical skills in a live problem-solving session.
  • Project deep-dive : Present and answer questions about exceptional work that you've done.
  • Meet and greet with the wider team.
  • Our goal is to finish the main process within one week. Final interviews will be conducted in person.

    Annual Salary Range

    $180,000 - $440,000 USD

    Benefits

    Base salary is just one part of our total rewards package at X, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

    xAI is an equal opportunity employer.

    California Consumer Privacy Act (CCPA) Notice

    Create a job alert for this search

    Software Engineer Platform • Palo Alto, CA, United States

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    Shopmonkey • Morgan Hill, California, United States
    Full-time
    We are seeking a highly skilled and motivated Senior Data Engineer to join our team at Shopmonkey.This role is critical to building, maintaining and improving our data infrastructure, ensuring that...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer - Data Transparency

    Senior Software Engineer - Data Transparency

    The Trade Desk • San Jose, CA, United States
    Full-time
    The Trade Desk is a global technology company with a mission to create a better, more open internet for everyone through principled, intelligent advertising. Handling over 1 trillion queries per day...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer - Data

    Software Engineer - Data

    Eight Sleep • San Francisco, California, United States
    Full-time
    Join the Sleep Fitness Movement.At Eight Sleep, we’re on a mission to fuel human potential through optimal sleep.As the world’s first sleep fitness company, we’re redefining what it means to be wel...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer, Platform

    Software Engineer, Platform

    Attain • Redwood City, California, United States
    Full-time
    Built for consumers and companies, alike.In a world driven by data, we believe consumers and businesses can coexist.Our founders had a vision to empower consumers to leverage their greatest asset—t...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer

    Software Engineer

    Confidential • Redwood City, California, United States
    Full-time
    C3 Energy is looking for data engineers to develop and implement the next generation of analytics for the smart grid.We are building a platform able to handle the extremely large amount of data gen...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer

    Software Engineer

    Supermicro • San Jose, CA, United States
    Full-time
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Show more
    Last updated: 30+ days ago • Promoted
    Principal Database Engineer

    Principal Database Engineer

    Informatica LLC • Redwood City, CA, United States
    Full-time
    Build Your Career at Informatica.We seek innovative thinkers who believe in the power of data to drive meaningful change. At Informatica, we welcome adventurous minds eager to solve the world's most...Show more
    Last updated: 22 days ago • Promoted
    Software Engineer, Data

    Software Engineer, Data

    Airtable • San Francisco, California, United States
    Full-time
    Airtable is the no-code app platform that empowers people closest to the work to accelerate their most critical business processes. More than 500,000 organizations, including 80% of the Fortune 100,...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer - Machine Learning Platform

    Senior Software Engineer - Machine Learning Platform

    Snowflake • Menlo Park, California, United States
    Full-time
    The Snowflake Machine Learning Platform team’s mission is to enable customers to bring their machine learning and deep learning workloads to Snowflake. Our customers want to build powerful models wi...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Balbix • San Jose, California, United States
    Full-time
    The Balbix Security Cloud uses AI and automation to reinvent how the World's leading organizations reduce their cyber risk. With Balbix, security teams can accurately inventory their cloud and on-pr...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer, Deployments

    Software Engineer, Deployments

    Airbyte • San Francisco, California, United States
    Full-time
    We enable data teams to move data from applications, APIs, unstructured sources, and databases to data warehouses, lakes, AI applications and LLMs. With our approach we are finally solving the need ...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer, Machine Learning Infrastructure

    Software Engineer, Machine Learning Infrastructure

    Datologyai • Redwood City, California, United States
    Full-time
    Companies want to train their own large models on their own data.The current industry standard is to train on a random sample of your data, which is inefficient at best and actively harmful to mode...Show more
    Last updated: 30+ days ago • Promoted
    Platform Software Engineer

    Platform Software Engineer

    Rainesdev • San Francisco, California, United States
    Full-time
    We’re not chasing the next app.We’re engineering the unseen layer — the low-level, rock-solid systems that allow sensitive data to move, sync, and stay secure across devices, distances, and domains...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer - Machine Learning Platform

    Software Engineer - Machine Learning Platform

    Snowflake • Menlo Park, California, United States
    Full-time
    The Snowflake Machine Learning Platform team’s mission is to enable customers to bring their ML / AI workload to Snowflake. Our customers want to leverage ML / AI to extract business values from ever in...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer, Data

    Software Engineer, Data

    Grammarly • San Francisco, California, United States
    Full-time
    Grammarly offers a dynamic hybrid working model for this role.This flexible approach gives team members the best of both worlds : plenty of focus time along with in-person collaboration that helps f...Show more
    Last updated: 30+ days ago • Promoted
    Principal Software Engineer

    Principal Software Engineer

    Informatica LLC • Redwood City, CA, United States
    Full-time
    Build Your Career at Informatica.We seek innovative thinkers who believe in the power of data to drive meaningful change. At Informatica, we welcome adventurous, work-from-anywhere minds eager to so...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer (Onsite, US)

    Data Engineer (Onsite, US)

    Wipro Technologies • Fremont, California, United States
    Full-time
    Location : Fully Onsite in either Fremont, CA or Austin, TX.This position is a fully onsite position and not eligible for relocation. Salary : Up to $90,000 + 10% performance bonus (DOE & Geographic L...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer - Data Engine

    Software Engineer - Data Engine

    Applied Intuition • Mountain View, California, United States
    Full-time
    Applied Intuition is the vehicle intelligence company that accelerates the global adoption of safe, AI-driven machines.Founded in 2017, Applied Intuition delivers the toolchain, Vehicle OS, and aut...Show more
    Last updated: 30+ days ago • Promoted