Senior Software Engineer - ML Infrastructure

About Baseten

At Baseten, we provide the essential infrastructure, tools, and expertise needed to quickly bring exceptional AI products to market. Backed by prominent investors such as IVP, Spark Capital, Greylock, and Conviction, we are trusted by leading AI innovators like Writer, Abridge, Bland, Patreon, Descript, Retool, and Zed to ensure industry-leading performance, security, and reliability for their critical workloads. With our recent $75M Series C funding, we are rapidly growing to make AI accessible across all products.

The Role

As a Senior Software Engineer focused on ML Infrastructure at Baseten, you will take the lead in architecting and developing our machine learning inference platform that powers production AI applications. You will be instrumental in making key technical decisions related to the infrastructure that enables developers to effectively deploy, scale, and monitor ML models with optimal performance and reliability.

Example Initiatives

• Managing multi-cloud capacity effectively
• Implementing inference on B200 GPUs
• Facilitating multi-node inference
• Utilizing fractional H100 GPUs for efficient model serving

Responsibilities

Requirements

Benefits

Apply now to embark on a rewarding journey to shape the future of AI! If you are a motivated individual with a passion for machine learning and a desire to join a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.