Machine Learning Engineer / Senior Machine Learning Engineer

C3 AI (NYSE : AI), is the Enterprise AI application software company. C3 AI delivers a family of fully integrated products including the C3 Agentic AI Platform, an end-to-end platform for developing, deploying, and operating enterprise AI applications, C3 AI applications, a portfolio of industry-specific SaaS enterprise AI applications that enable the digital transformation of organizations globally, and C3 Generative AI, a suite of domain-specific generative AI offerings for the enterprise.Learn more at : C3 AI

C3 AI Data Science team is dedicated to pushing the boundaries of what is possible with large-scale AI. We are seeking a hands-on Machine Learning Engineer to design, build, and operate a bespoke, next-generation research platform dedicated to training novel, large-scale foundation models far beyond conventional LLM recipes.

This is a critical systems role. You will create the orchestration, secure data pathways, and frictionless developer experience that empowers our researchers to move fast, experiment securely, and scale complex training jobs on heterogeneous GPU clusters.

Responsibilities :

We are looking for an expert who can solve infrastructure problems where off-the-shelf cloud tools are insufficient.

• Design and manage the core research compute cluster, including node layouts, queues / partitions, preemption / fair-share policies, and multi-tenant isolation.
• Implement secure access controls for all users and services across the cluster using Kubernetes and / or SLURM.
• Build robust branch-to-experiment CI / CD workflows, encompassing templated job creation, config promotion, and integrated version control.
• Implement an experiment and metrics tracking system (runs, configs, checkpoints, logs) with searchable lineage to enable frictionless cross-team collaboration and sharing.
• Design and integrate auto-checkpointing, artifact retention, and necessary rollout / rollback mechanisms.
• Stand up robust dataset registries, ensuring data lineage, versioning, and secure access.
• Implement sharding, streaming, and prefetch mechanisms to support efficient TB-scale data corpora access and long-term archival with reproducible rehydration.
• Profile NCCL / I / O hotspots, optimize training throughput (mixed precision / AMP, ZeRO / FSDP, kernel fusion, caching).
• Harden training pipelines for scale and resilience, including checkpoint recovery, and tolerance for spot / preemptible instances.
• Build opinionated templates, job specifications, and guardrails to ensure researchers can focus on modifying custom training code and recipes without fighting infrastructure bottlenecks.

Qualifications :

Preferred Qualifications :

C3 AI provides excellent benefits, a competitive compensation package and generous equity plan.

California Base Pay Range $140,000—$206,000 USD

C3 AI is proud to be an Equal Opportunity and Affirmative Action Employer. We do not discriminate on the basis of any legally protected characteristics, including disabled and veteran status.