Site Reliability Engineer

Senior Site Reliability Engineer (GPU Compute) | Hybrid — Bay Area, CA

Berkley Hunt is supporting a fast-growing AI startup building a high-performance, cloud-native platform to power cutting-edge machine learning workloads. As they scale, they’re hiring a Senior / Staff Infrastructure Engineer to lead the development of a scalable GPU compute environment from the ground up.

About the Role

This is a high-impact role for an experienced infrastructure engineer who thrives in fast-paced environments and wants to shape the future of AI infrastructure. You’ll design, build, and operate the systems that enable high-throughput GPU workloads at scale—collaborating closely with the core engineering team to optimize performance, efficiency, and reliability.

If you’re excited about solving deep technical challenges in distributed compute and cloud automation, this could be a standout opportunity.

Responsibilities

• Build and maintain a large-scale, distributed GPU compute platform powering AI workloads.
• Develop backend systems in Python to orchestrate GPU jobs, manage routing, observability, and capacity.
• Design and implement infrastructure with tools like Terraform, Ansible, and Kubernetes across cloud and bare metal environments.
• Own the reliability, scalability, and performance of the platform, from provisioning to deployment and monitoring.
• Collaborate with the engineering team to shape infrastructure vision and technical strategy over the next 1–5 years.
• Drive automation and improvements to minimize operational overhead and scale efficiently.

Requirements

Nice to Have

#J-18808-Ljbffr