ML Infrastructure Engineer

ML Infrastructure Engineer

Menlo Park, CA | On-Site | Full-Time / Direct Hire

Looking for ML Infra experts (Bay Area preferred) with deep experience in CUDA, GPU optimization, VLLMs, and LLM inference-pure language focus, no vision / audio.

Client Opportunity | Through Phizenix

Phizenix, a certified minority and women-led recruiting firm, is hiring on behalf of an AI startup pioneering diffusion-based large language models-built for faster generation, multimodal integration, and scalable enterprise deployment.

We're looking for a ML Infrastructure Engineer to help build the infrastructure that powers large-scale model training and real-time inference. You'll collaborate with world-class researchers and engineers to design high-performance, distributed systems that bring advanced LLMs into production.

Responsibilities

• Design and manage distributed infrastructure for ML training at scale
• Optimize model serving systems for low-latency inference
• Build automated pipelines for data processing, model training, and deployment
• Implement observability tools to monitor performance in production
• Maximize resource utilization across GPU clusters and cloud environments
• Translate research requirements into robust, scalable system designs

Must-Haves

Nice-to-Haves

At Phizenix , we're committed to supporting diverse and inclusive teams. This is your chance to shape the systems that power the next generation of AI innovation. Let's build the future-together.

California Pay Range

$180,000-$200,000 USD