Talent.com
Software Engineer, GPU Infrastructure - HPC
Software Engineer, GPU Infrastructure - HPCOpenAI • San Francisco, CA, United States
Software Engineer, GPU Infrastructure - HPC

Software Engineer, GPU Infrastructure - HPC

OpenAI • San Francisco, CA, United States
17 hours ago
Job type
  • Full-time
Job description

Software Engineer, GPU Infrastructure - HPC

Scaling - San Francisco

About the team

The Fleet team at OpenAI supports the computing environment that powers our cutting‑edge research and product development. We oversee large‑scale systems that span data centers, GPUs, networking, and more, ensuring high availability, performance, and efficiency. Our work enables OpenAI’s models to operate seamlessly at scale, supporting both internal research and external products like ChatGPT. We prioritize safety, reliability, and responsible AI deployment over unchecked growth.

About the role

As a software engineer on the Fleet High Performance Computing (HPC) team, you will be responsible for the reliability and uptime of all of OpenAI’s compute fleet. Minimizing hardware failure is key to research training progress and stable services, as even a single hardware hiccup can cause significant disruptions. With increasingly large supercomputers, the stakes continue to rise.

Being at the forefront of technology means that we are often the pioneers in troubleshooting these state‑of‑the‑art systems at scale. This is a unique opportunity to work with cutting‑edge technologies and devise innovative solutions to maintain the health and efficiency of our supercomputing infrastructure.

Our team empowers strong engineers with a high degree of autonomy and ownership, as well as ability to effect change. This role will require a keen focus on system‑level comprehensive investigations and the development of automated solutions. We want people who go deep on problems, investigate as thoroughly as possible, and build automation for detection and remediation at scale.

In this role, you will :

  • Build and maintain automation systems for provisioning and managing server fleets.
  • Develop tools to monitor server health, performance, and lifecycle events.
  • Collaborate with clusters, networking, and infrastructure teams.
  • Partner with external operators to ensure a high level of quality.
  • Identify and fix performance bottlenecks and inefficiencies.
  • Continuously improve automation to reduce manual work.

You might thrive in this role if you have :

  • Experience managing large‑scale server environments.
  • A balance of strengths in building and operationalizing.
  • Proficiency in Python, Go, or similar languages.
  • Strong Linux, networking, and server hardware knowledge.
  • Comfort digging into noisy data with SQL, PromQL, and Pandas or any other tool.
  • Bonus Skills :

  • Experience with low level details of hardware components, protocols, and associated Linux tooling (e.g., PCIe, Infiniband, networking, power management, kernel perf tuning)
  • Knowledge of hardware management protocols (e.g., IPMI, Redfish).
  • High‑performance computing (HPC) or distributed systems experience.
  • Prior experience developing, managing, or designing hardware.
  • Familiarity with monitoring tools (e.g., Prometheus, Grafana).
  • About OpenAI

    OpenAI is an AI research and deployment company dedicated to ensuring that general‑purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

    We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

    Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act. For unincorporated Los Angeles County workers : we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment : protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non‑public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.

    Compensation

    $325K – $590K + Offers Equity

    #J-18808-Ljbffr

    Create a job alert for this search

    Software Engineer Infrastructure • San Francisco, CA, United States

    Related jobs
    Flight Software Infrastructure Engineer

    Flight Software Infrastructure Engineer

    Reliable Robotics • Mountain View, CA, United States
    Permanent
    We're building safety-enhancing technology for aviation that will save lives.Automated aviation systems will enable a future where air transportation is safer, more convenient and fundamentally tra...Show more
    Last updated: 30+ days ago • Promoted
    Director, GPU System Architect

    Director, GPU System Architect

    Supermicro • San Jose, CA, United States
    Full-time
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Show more
    Last updated: 30+ days ago • Promoted
    Infrastructure Software Engineer

    Infrastructure Software Engineer

    VirtualVocations • Santa Clara, California, United States
    Full-time
    A company is looking for an Infrastructure Software Engineer focused on AI Tools.Key Responsibilities Design and implement tools and systems to enhance engineering velocity and code quality Util...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer, GPU Infrastructure

    Software Engineer, GPU Infrastructure

    OpenAI • San Francisco, CA, United States
    Full-time
    Software Engineer, GPU Infrastructure | OpenAI.Software Engineer, GPU Infrastructure.Apply now (opens in a new window).This role will support the fleet infrastructure team at OpenAI.The fleet team ...Show more
    Last updated: 17 hours ago • Promoted • New!
    Lead Engine Programmer

    Lead Engine Programmer

    VirtualVocations • Hayward, California, United States
    Full-time
    A company is looking for a Lead Engine Programmer to join their team on a major gaming project.Key Responsibilities Develop architectural proposals and guide the vision for diverse engine systems...Show more
    Last updated: 14 hours ago • Promoted • New!
    Principal GPU Software Engineer II

    Principal GPU Software Engineer II

    Roche • Santa Clara, CA, US
    Full-time
    At Roche you can show up as yourself, embraced for the unique qualities you bring.Our culture encourages personal expression, open dialogue, and genuine connections, where you are valued, accepted...Show more
    Last updated: 3 days ago • Promoted
    HPC Solutions Engineer

    HPC Solutions Engineer

    KLA • Milpitas, CA, United States
    Full-time
    KLA is a global leader in diversified electronics for the semiconductor manufacturing ecosystem.Virtually every electronic device in the world is produced using our technologies.No laptop, smartpho...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer, GPU Inference

    Software Engineer, GPU Inference

    OpenAI • San Francisco, CA, United States
    Full-time
    The Sora team is pioneering multimodal capabilities for OpenAI’s foundation models.We’re a hybrid research and product team focused on integrating multimodal functionalities into our AI products, e...Show more
    Last updated: 17 hours ago • Promoted • New!
    Senior Software Engineer - GPU

    Senior Software Engineer - GPU

    NVIDIA Corporation • Santa Clara, CA, United States
    Full-time
    Senior Software Engineer - GPU page is loaded.Senior Software Engineer - GPU.Apply locations US, CA, Santa Clara time type Full time posted on Posted 2 Days Ago job requisition id JR1999189.NVIDIA ...Show more
    Last updated: 29 days ago • Promoted
    Software Engineer, Inference – AMD GPU Enablement

    Software Engineer, Inference – AMD GPU Enablement

    OpenAI • San Francisco, CA, United States
    Full-time
    Software Engineer, Inference – AMD GPU Enablement.Apply now (opens in a new window).OpenAI’s Inference team ensures that our most advanced models run efficiently, reliably, and at scale.We build an...Show more
    Last updated: 6 days ago • Promoted
    Software Engineer (Infrastructure)

    Software Engineer (Infrastructure)

    Greptile • San Francisco, CA, United States
    Full-time
    K – $210K • $75K – $125K Equity • Up to $25,000 in relocation assistance.Greptile is an AI code reviewer that catches bugs and anti-patterns in pull requests with complete context of the codebase.H...Show more
    Last updated: 28 days ago • Promoted
    Computer Systems Engineer 3

    Computer Systems Engineer 3

    Lawrence Berkeley National Laboratory • Berkeley, CA, United States
    Full-time
    Lawrence Berkeley National Laboratory has multiple openings for a.Linux system and HPC cluster maintenance and installations, operating system upgrades, system security hardening and intrusion dete...Show more
    Last updated: 30+ days ago • Promoted
    Senior Infrastructure Software Engineer, Enterprise AI

    Senior Infrastructure Software Engineer, Enterprise AI

    Scale AI, Inc. • San Francisco, CA, United States
    Full-time
    Scale GP is building the next generation of enterprise-grade Generative AI products.Our platform provides APIs for knowledge retrieval, inference, and evaluation, enabling customers to build and de...Show more
    Last updated: 30+ days ago • Promoted
    Engineer III

    Engineer III

    Spectraforce Technologies • Pleasanton, CA, United States
    Full-time
    Location : Pleasanton, CA - Hybrid.Work Schedule - M-F Normal Business Hours.What are the top 3-5 skills, experience or education required for this position : . The software engineer III will work coll...Show more
    Last updated: 1 day ago • Promoted
    Principal GPU Software Engineer II

    Principal GPU Software Engineer II

    F. Hoffmann-La Roche Gruppe • Santa Clara, CA, United States
    Full-time
    At Roche you can show up as yourself, embraced for the unique qualities you bring.Our culture encourages personal expression, open dialogue, and genuine connections, where you are valued, accepted ...Show more
    Last updated: 24 days ago • Promoted
    HPC Systems Engineer

    HPC Systems Engineer

    KLA • Milpitas, CA, United States
    Full-time
    KLA is a global leader in diversified electronics for the semiconductor manufacturing ecosystem.Virtually every electronic device in the world is produced using our technologies.No laptop, smartpho...Show more
    Last updated: 30+ days ago • Promoted
    Infrastructure Software Engineer, Public Sector

    Infrastructure Software Engineer, Public Sector

    Scale AI, Inc. • San Francisco, CA, United States
    Full-time
    Scale AI is seeking a highly skilled and motivated.Software Engineer, AI Infrastructure & Security.Public Sector Engineering team. As a part of this team, you will play a critical role in delivering...Show more
    Last updated: 30+ days ago • Promoted
    Lead HPC Infrastructure Engineer

    Lead HPC Infrastructure Engineer

    Referrals Only • San Francisco, CA, United States
    Full-time
    We are seeking a highly accomplished engineer to take ownership of the operations and optimization of next-generation NVIDIA GB200 and GB300 GPU clusters. This role sits at the intersection of high-...Show more
    Last updated: 5 days ago • Promoted