Engineering Manager, Data Infrastructure

Engineering Manager On Big Data Compute

You'll manage the team that's behind OpenAI's big data infrastructure that powers critical engineering, product, alignment teams that are core to the work we do at OpenAI. The systems we support include our data warehouse, batch compute infrastructure, data orchestration system, data lake, ingestion systems, critical integrations, and more.

The Applied Data Platform organization designs, builds, and operates the foundational data infrastructure that enables products and teams at OpenAI. There are multiple teams under Applied Data Platform, including Big Data Compute, Core Data Infrastructure, Real-time Infrastructure, Data Productivity, Data Movement and others.

As an Engineering Manager on Big Data Compute, you'll be tasked with leading and managing a team of highly experienced Data Infrastructure experts to build, maintain, and iterate on our systems. You will report to the Head of Applied Data Platform.

In addition to Data Infrastructure experience, you are well versed with infrastructure tooling such as Terraform, worked with Kubernetes, and have a strong SRE skillset.

This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees.

In this role, you will :

• Manage and support a diverse team of world class data infrastructure engineers.
• Design, build, and maintain data infrastructure systems such as distributed compute, data orchestration, distributed storage, streaming infrastructure while ensuring scalability, reliability, and security
• Ensure our data platform can scale reliably to the next several orders of magnitude
• Accelerate company productivity by empowering your fellow engineers & teammates with excellent data tooling and systems, providing a best in case experience
• Bring new features and capabilities to the world by partnering with product engineers, safety systems and other teams to build the technical foundations
• Set technical direction on evolving our compute and abstractions to support a growing business.
• Coach and nurture engineers to accelerate their growth and learning.

You might thrive in this role if you :

Some of the technologies you'll be working with include Apache Spark, Apache Iceberg, Airflow, Terraform, Kafka, Flink, Chronon etc.

This role is exclusively based in our San Francisco HQ. We offer relocation assistance to new employees.

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act.

At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.