About the Team
OpenAI’s Hardware organization develops silicon and system-level solutions designed for the unique demands of advanced AI workloads. The team is responsible for building the next generation of AI-native silicon while working closely with software and research partners to co-design hardware tightly integrated with AI models. In addition to delivering production-grade silicon for OpenAI’s supercomputing infrastructure, the team also creates custom design tools and methodologies that accelerate innovation and enable hardware optimized specifically for AI.
About the Role
As a software engineer on the Scaling team, you’ll help build and optimize the low-level stack that orchestrates computation and data movement across OpenAI’s supercomputing clusters. Your work will involve designing high-performance runtimes, building custom kernels, contributing to compiler infrastructure, and developing scalable simulation systems to validate and optimize distributed training workloads.
You will work at the intersection of systems programming, ML infrastructure, and high-performance computing, helping to create both ergonomic developer APIs and highly efficient runtime systems. This means balancing ease of use and introspection with the need for stability and performance on our evolving hardware fleet.
This role is based in San Francisco, CA, with a hybrid work model (3 days/week in-office). Relocation assistance is available.
In this role, you will:
Design and build APIs and runtime components to orchestrate computation and data movement across heterogeneous ML workloads.
Contribute to compiler infrastructure, including the development of optimizations and compiler passes to support evolving hardware.
Engineer and optimize compute and data kernels, ensuring correctness, high performance, and portability across simulation and production environments.
Profile and optimize system bottlenecks, especially around I/O, memory hierarchy, and interconnects, at both local and distributed scales.
Develop simulation infrastructure to validate runtime behaviors, test training stack changes, and support early-stage hardware and system development.
Rapidly deploy runtime and compiler updates to new supercomputing builds in close collaboration with hardware and research teams.
Work across a diverse stack, primarily using Rust and Python, with opportunities to influence architecture decisions across the training framework.
You might thrive in this role if you:
Have a deep curiosity for how large-scale systems work and enjoy making them faster, simpler, and more reliable.
Are proficient in systems programming (e.g., Rust, C++) and scripting languages like Python.
Have experience in one or more of the following areas: compiler development, kernel authoring, accelerator programming, runtime systems, distributed systems, or high-performance simulation.
Are excited to work in a fast-paced, highly collaborative environment with evolving hardware and ML system demands.
Value engineering excellence, technical leadership, and thoughtful system design.
Software Engineer, Hardware • San Francisco
Join the Future of Commerce with Whatnot!Whatnot is the largest livestream shopping platform in North America and Europe to buy, sell, and discover the things you love.Whether it's trading cards, f... Show more
About the TeamThe Platform Systems team at OpenAI operates at the intersection of cutting-edge AI and large-scale distributed systems.We build the engineering and research infrastructure required t... Show more
Coder/ProgrammerAt Gilead, we're creating a healthier world for all people.For more than 35 years, we've tackled diseases such as HIV, viral hepatitis, COVID-19 and cancer working relentlessly to d... Show more
Staff Engineer, AndroidPoshmark is the leading fashion marketplace where style comes alive through discovery, self-expression, and human connection.Powered by a vibrant community of 165 million mem... Show more
Software Engineer, Core TechnologyIXL Learning, developer of personalized learning products used by millions of people globally, is seeking Software Engineers who have a passion for technology and ... Show more
Specter Systems Software EngineerSpecter is creating a software-defined control plane for the physical world.We are starting with protecting American businesses by granting them ubiquitous percepti... Show more
Who We AreImprint is reimagining co-branded credit cards & financial products to be smarter, more rewarding, and truly brand-first.We partner with companies like Crate & Barrel, Rakuten, Bo... Show more
Software EngineerSan Francisco, CAMetriport is an open-source data intelligence platform that helps healthcare organizations access and exchange patient data in real-time.We integrate with all majo... Show more
About Emerald AIWe're at a pivotal moment for AI and energy.Demand for compute is skyrocketing, but power constraints are becoming a critical bottleneck.Emerald AI sits at the intersection of these... Show more
Software EngineerFull-timeCompany DescriptionGamingJob DescriptionSoftware Engineer,2to 5 years experiencePosition Overview:We're looking for a passionate and resourceful software engineer with an ... Show more
Staff Software Engineer, Platform (Hybrid)Homeward is rearchitecting the delivery of health and care in partnership with communities everywhere, starting in rural America.Today, 60 million American... Show more
Perplexity AI EngineerPerplexity is seeking creative, AI-pilled engineers to join our Acceleration team.Our company is reshaping the way people navigate the internet and the wider world.The Acceler... Show more
Location: San FranciscoMy client is building an AI-driven platform that helps teams operate some of the world's most critical infrastructure, starting with data centers.Trillions of dollars in glob... Show more
Job OpportunityPlaud is building the world's most trusted AI work companion for professionals to elevate productivity and performance through note-taking solutions, loved by over 1,500,000 users wo... Show more
Senior Software Engineer - Cryptographic Hardware ServicesLocation:San FranciscoBusiness Area:Engineering and CTORef #:10049384Description & RequirementsThe Team:In the Software Security Platfo... Show more
Why FluxFlux is taking the hard out of hardware, by developing the first AI Hardware Engineer.Our goal is to democratize the ability to create bleeding edge hardware, and revolutionize how electron... Show more
About AnthropicAnthropic's mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole.Our team is a quickly... Show more
Discovery Senior Software DeveloperWelcome to Warner Bros.Discovery the stuff dreams are made of.When we say, the stuff dreams are made of, we're not just referring to the world of wizards, dragons... Show more
Software Engineer III, RokuFounded by fans, Crunchyroll delivers the art and culture of anime to a passionate community.We super-serve over 100 million anime and manga fans across 200countries and ... Show more
Analyze, design and develop tests and test-automation suites.Design, create and develop a processing platform using various configuration management technologies.Test software development methodolo... Show more
