ML Systems Engineer

We are Genmo, a research lab dedicated to building open, state-of-the-art models for video generation towards unlocking the right brain of AGI. Join us in shaping the future of AI and pushing the boundaries of what's possible in video generation.

The Role

You'll own our model serving layer, implementing high-performance inference systems that can handle millions of requests daily. You'll work at the intersection of ML frameworks and cloud infrastructure, building automated pipelines for model optimization and deployment. Your work will directly impact the performance and scalability of our video generation models, ensuring sub-second latency at global scale.

Key Responsibilities

• Design and implement high-performance model serving infrastructure supporting streaming, batching, and multi-modal inputs
• Build automated model compilation and optimization pipelines using TensorRT, torch.compile, and other compilers
• Optimize serving systems for throughput, latency, and GPU utilization across our H100 fleet
• Develop monitoring and observability for model-specific metrics (quality, latency, throughput)
• Collaborate with researchers to transition models from development to production
• Implement A / B testing, canary deployments, and gradual rollout strategies for models
• Integrate serving layer with platform infrastructure (load balancers, API gateways, queue systems)

Qualifications

We Value

Genmo is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. Genmo, Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish.