AI Infra Engineer

Location

San Francisco

Employment Type

Full time

Location Type

Hybrid

Department

AI

We are looking for an AI Infra engineer to join our growing team. We work with Kubernetes, Slurm, Python, C++, PyTorch, and primarily on AWS. As an AI Infrastructure Engineer, you will be partnering closely with our Inference and Research teams to build, deploy, and optimize our large-scale AI training and inference clusters

Responsibilities

• Design, deploy, and maintain scalable Kubernetes clusters for AI model inference and training workloads
• Manage and optimize Slurm-based HPC environments for distributed training of large language models
• Develop robust APIs and orchestration systems for both training pipelines and inference services
• Implement resource scheduling and job management systems across heterogeneous compute environments
• Benchmark system performance, diagnose bottlenecks, and implement improvements across both training and inference infrastructure
• Build monitoring, alerting, and observability solutions tailored to ML workloads running on Kubernetes and Slurm
• Respond swiftly to system outages and collaborate across teams to maintain high uptime for critical training runs and inference services
• Optimize cluster utilization and implement autoscaling strategies for dynamic workload demands

Qualifications

Required Skills

Preferred Skills

Required Experience

The cash compensation range for this role is $190,000 - $250,000.

Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.

Equity : In addition to the base salary, equity may be part of the total compensation package.

Benefits : Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.

#J-18808-Ljbffr