Talent.com
Staff ML Engineer

Staff ML Engineer

SynergisSanta Clara, California, United States
14 days ago
Job type
  • Permanent
Job description

Staff ML Engineer

Direct Hire

Detroit, MI or San Francisco, CA

$195K-$295K

About the Team :

The ML Inference Platform is part of the AI Compute Platforms organization within Infrastructure Platforms. Our team owns the cloud-agnostic, reliable, and cost-efficient platform that powers our client’s AI efforts. We’re proud to serve as the AI infrastructure platform for teams developing autonomous vehicles (L3 / L4 / L5), as well as other groups building AI-driven products for our client and their customers. We enable rapid innovation and feature development by optimizing for high-priority, ML-centric use cases. Our platform supports the serving of state-of-the-art (SOTA) machine learning models for experimental and bulk inference, with a focus on performance, availability, concurrency, and scalability. We’re committed to maximizing GPU utilization across platforms (B200, H100, A100, and more) while maintaining reliability and cost efficiency.

About the Role :

We are seeking a Staff ML Infrastructure engineer to help build and scale robust Compute platforms for ML workflows. In this role, you’ll work closely with ML engineers and researchers to ensure efficient model serving and inference in production, for their workflows such as data mining, labeling, model distillation, simulations and more. This is a high-impact opportunity to influence the future of AI infrastructure. You will play a key role in shaping the architecture, roadmap and user-experience of a robust ML inference service supporting real-time, batch, and experimental inference needs. The ideal candidate brings experience in designing distributed systems for ML, strong problem-solving skills, and a product mindset focused on platform usability and reliability.

What you’ll be doing :

Design and implement core platform backend software components.

  • Collaborate with ML engineers and researchers to understand critical workflows, parse them to platform requirements, and deliver incremental value.
  • Lead technical decision-making on model serving strategies, orchestration, caching, model versioning, and auto-scaling mechanisms.
  • Drive the development of monitoring, observability, and metrics to ensure reliability, performance, and resource optimization of inference services.
  • Proactively research and integrate state-of-the-art model serving frameworks, hardware accelerators, and distributed computing techniques.
  • Lead large-scale technical initiatives across ML ecosystem.
  • Raise the engineering bar through technical leadership, establishing best practices.
  • Contribute to open-source projects; represent in relevant communities.

Minimum Requirements

8+ years of industry experience, with focus on machine learning systems or high-performance backend services.

  • Expertise in either Go, Python, C++ or other relevant coding languages.
  • Expertise in ML inference, model serving frameworks (triton, rayserve, vLLM etc).
  • Strong communication skills and a proven ability to drive cross-functional initiatives.
  • Experience working with cloud platforms such as GCP, Azure, or AWS.
  • Ability to thrive in a dynamic, multi-tasking environment with ever-evolving priorities.
  • Preferred Qualifications

    Hands-on experience building ML infrastructure platforms for model serving / inference.

  • Experience working with or designing interfaces, APIs and clients for ML workflows.
  • Experience with Ray framework, and / or vLLM.
  • Experience with distributed systems and handling large-scale data processing.
  • Familiarity with telemetry, and other feedback loops to inform product improvements.
  • Familiarity with hardware acceleration (GPUs) and optimizations for inference workloads.
  • Contributions to open-source ML serving frameworks.
  • The compensation range for this position is $195,000 to $295,000

    (dependent on factors including but not limited to client requirements, experience, statutory considerations, and location).

  • Note : Disclosure as required by the Equal Pay for Equal Work Act (CO), NYC Pay Transparency Law, and sb5761 (WA)
  • Synergis is proud to be an Equal Opportunity Employer. We value diversity and do not discriminate on the basis of race, color, ethnicity, national origin, religion, age, gender, gender identity, political affiliation, sexual orientation, marital status, disability, military / veteran status, or any other status protected by applicable law.

    For consideration, please forward your resume to

    If you require assistance or an accommodation in the application or employment process, please contact us at .

    Qualified applicants with arrest or conviction records will be considered for employment in accordance with the requirements of applicable state and local laws, including but not limited to, the San Francisco Fair Chance Ordinance, the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance, the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.

    Synergis is a workforce solutions partner serving thousands of businesses and job seekers nationwide. Our digital world has accelerated the need for businesses to build IT ecosystems that enable growth and innovation along with enhancing the Total Experience (TX). Synergis partners with our clients at the intersection of talent and transformation to scale their balanced teams of tech, digital and creative professionals. Learn more about Synergis at ww.synergishr.com.

    Create a job alert for this search

    Ml Engineer • Santa Clara, California, United States

    Related jobs
    • Promoted
    Staff Software Development Engineer (LLM)

    Staff Software Development Engineer (LLM)

    FortinetSunnyvale, CA, United States
    Full-time
    Architect and implement functions to monitor and filter LLM requests / responses in real time, preventing prompt injection attacks and unauthorized data leakage. Build a highly scalable pipeline capab...Show moreLast updated: 28 days ago
    • Promoted
    Staff Systems Engineer

    Staff Systems Engineer

    Bio-Rad LaboratoriesPleasanton, CA, United States
    Full-time
    Working within Bio-Rad's Life Science R&D Group as a Systems Engineer, you will take engineering concepts, requirements and transform them into functional prototypes and finished products that impr...Show moreLast updated: 16 days ago
    • Promoted
    • New!
    Staff Engineer, AI / ML for Chip Design

    Staff Engineer, AI / ML for Chip Design

    Samsung SemiconductorSan Jose, CA, United States
    Full-time
    To provide the best candidate experience amidst our high application volumes, each candidate is limited to 10 applications across all open jobs within a 6-month period. Advancing the Worlds Technolo...Show moreLast updated: 22 hours ago
    • Promoted
    Staff Engineer

    Staff Engineer

    GEI ConsultantsOakland, CA, United States
    Full-time
    GEI is seeking a motivated civil engineer with advanced education in geotechnical engineering to assist with complex and challenging projects at locations in California and throughout the United St...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Machine Learning Engineer

    Staff Machine Learning Engineer

    HiveSan Francisco, CA, United States
    Full-time
    Hive is the leading provider of cloud-based AI solutions to understand, search, and generate content, and is trusted by hundreds of the world's largest and most innovative organizations.The company...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Software Engineer, Model Serving

    Staff Software Engineer, Model Serving

    Databricks Inc.San Francisco, CA, United States
    Full-time
    At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical ...Show moreLast updated: 20 days ago
    • Promoted
    Staff Machine Learning Engineer

    Staff Machine Learning Engineer

    scribehow.comSan Francisco, CA, United States
    Full-time
    We're looking for a highly motivated and skilled Staff Machine Learning Engineer to build the future of AI productivity software. You will lead high-impact research and development, drive our core A...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Staff Engineer

    Senior Staff Engineer

    ASMLSan Jose, CA, US
    Full-time
    ASML US brings together the most creative minds in science and technology to develop lithography machines that are key to producing faster, cheaper, more energy-efficient microchips.We design, deve...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Software Engineer Lead, AI / ML

    Staff Software Engineer Lead, AI / ML

    Google Inc.Mountain View, CA, United States
    Full-time
    Google place Mountain View, CA, USA.Bachelor’s degree or equivalent practical experience.ML infrastructure, or specialization in another ML field. ML design and ML infrastructure (e.Master's or PhD ...Show moreLast updated: 8 days ago
    • Promoted
    R&D Engineer, Sr Staff

    R&D Engineer, Sr Staff

    SynopsysSunnyvale, CA, United States
    Full-time
    Job Description and Requirements.You are an accomplished R&D professional with a passion for solving complex engineering challenges using cutting-edge technology. With a deep understanding of softwa...Show moreLast updated: 4 days ago
    • Promoted
    Staff ML Engineer

    Staff ML Engineer

    SynergisSunnyvale, California, United States
    Permanent
    Detroit, MI or San Francisco, CA.The ML Inference Platform is part of the AI Compute Platforms organization within Infrastructure Platforms. Our team owns the cloud-agnostic, reliable, and cost-effi...Show moreLast updated: 14 days ago
    • Promoted
    Staff Software Engineer, ML Platform

    Staff Software Engineer, ML Platform

    AttentiveSan Francisco, CA, United States
    Full-time
    Attentive® is the AI-powered mobile marketing platform transforming the way brands personalize consumer engagement.Attentive enables marketers to craft tailored journeys for every subscriber, drivi...Show moreLast updated: 21 days ago
    • Promoted
    Senior MLOps Engineer

    Senior MLOps Engineer

    Monad FoundationMountain View, CA, United States
    Full-time
    AI protocol on Monad that leverages idle consumer hardware for swarm inference.It enables Small Language Models to achieve advanced multi-step reasoning at lower costs, surpassing the performance a...Show moreLast updated: 9 days ago
    • Promoted
    Staff AI / ML Engineer

    Staff AI / ML Engineer

    HarnhamSunnyvale, CA, US
    Full-time
    We’re partnering with an early-stage tech company developing next-generation radar-based AI systems for human activity recognition and vital signs monitoring. They’re building products a...Show moreLast updated: 1 day ago
    • Promoted
    Staff Software Engineer, Foundational Model Serving

    Staff Software Engineer, Foundational Model Serving

    Databricks Inc.San Francisco, CA, United States
    Full-time
    At Databricks, we are passionate about enabling data teams to solve the world’s toughest problems — from making the next mode of transportation a reality to accelerating the development of medical ...Show moreLast updated: 11 days ago
    • Promoted
    Staff Machine Learning Engineer

    Staff Machine Learning Engineer

    Intuit Inc.Mountain View, CA, United States
    Full-time
    Come join Intuit as a Staff Machine Learning Engineer!.In this role, you’ll work alongside AI scientists and machine learning engineers to create AI-powered experiences. You’ll be expected to help c...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Engineer

    Staff Engineer

    Bio-Rad LaboratoriesPleasanton, CA, United States
    Full-time
    As a Senior Electrical Engineer, you will play a critical role in designing, debugging, and supporting custom electronics solutions for cutting-edge life science research platforms.You'll drive the...Show moreLast updated: 30+ days ago
    • Promoted
    Lead ML Engineer

    Lead ML Engineer

    VisaFoster City, CA, United States
    Full-time
    Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more t...Show moreLast updated: 9 days ago