We help the world run better
At SAP, we keep it simple : you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed.
We are seeking a highly skilled and driven Chief Machine Learning Expert to design and deliver intelligent, distributed systems that power large-scale AI and large language model (LLM) capabilities. In this role, you will shape cutting-edge infrastructure, mentor world-class engineers, and bring bold ideas from concept to production—driving meaningful impact across SAP's global ecosystem.
Description
As a key member of our fast-moving team, you will have the unique opportunity to define and execute the vision for AI and LLM-based systems at scale. We are looking for someone with exceptional programming expertise, deep distributed systems knowledge, and the curiosity and grit to tackle complex, ambiguous challenges. You will work across a diverse technology stack, collaborate closely with engineers and product leaders, and help set the technical direction for AI initiatives.
Key Responsibilities
Architect, design, and implement production systems in Go, Java and Python
Demonstrated expertise in designing and scaling Generative AI platforms and applications, leveraging agentic frameworks and orchestration technologies such as LangGraph, MCP, or equivalent, to deliver enterprise-grade AI solutions.
Deep knowledge of transformer architectures and machine learning lifecycles, with proven experience leading large-scale batch inference pipelines on GPU clusters.
Extensive experience leveraging modern distributed technologies such as Kafka, PostgreSQL, SAP HANA, gRPC, AWS, Kubernetes, and Docker to build scalable, resilient, and high-performance AI and data platforms.
Mentor and guide engineers from junior to senior levels, fostering technical excellence
Partner with cross-functional teams to translate business goals into scalable, high-impact solutions
Minimum Qualifications
Bachelor's degree in Computer Science, Mathematics, Physics, or related field, with strong programming expertise
10 years of software engineering experience, with a track record of delivering complex systems
Proven ability to work independently and lead initiatives from idea to deployment
Hands-on experience with AI / ML and / or LLM systems in a production environment
Expertise in distributed systems design and implementation
Familiarity with CI / CD pipelines and modern development practices
Strong English communication skills and ability to thrive in global, multicultural teams
Preferred Qualifications
Open-source contributions or significant personal technical projects
Experience integrating AI capabilities into large-scale enterprise products
Strong problem-solving skills and an iterative, results-oriented mindset
Why Join Us
Build cutting-edge AI and LLM systems used across SAP's global platforms
Work in a high-autonomy, trust-based environment without unnecessary bureaucracy
Collaborate with some of the best engineers in the industry in a fast-paced, impact-driven team
Take ownership of projects that directly influence SAP's AI strategy and product capabilities
AI Usage in the Recruitment Process
For information on the responsible use of AI in our recruitment process, please refer to our Guidelines for Ethical Usage of AI in the Recruiting Process (https : / / jobs.sap.com / content / Ethical_usage_of_AI_in_the_recruiting_process / ?locale=en_US).
Please note that any violation of these guidelines may result in disqualification from the hiring process.
Legal Notice
Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity, gender (including pregnancy, childbirth, etc.), sexual orientation, gender identity or expression, protected veteran status, or disability, in compliance with applicable federal, state, and local legal requirements.
J-18808-Ljbffr
Machine Learning Engineer • Palo Alto, CA, US