Talent.com
Staff ML Engineer
Staff ML EngineerSynergis • Fremont, CA, US
Staff ML Engineer

Staff ML Engineer

Synergis • Fremont, CA, US
1 day ago
Job type
  • Permanent
Job description

Staff ML Engineer

Direct Hire

Detroit, MI or San Francisco, CA

$195K-$295K

About the Team :

The ML Inference Platform is part of the AI Compute Platforms organization within Infrastructure Platforms. Our team owns the cloud-agnostic, reliable, and cost-efficient platform that powers our client's AI efforts. We're proud to serve as the AI infrastructure platform for teams developing autonomous vehicles (L3 / L4 / L5), as well as other groups building AI-driven products for our client and their customers. We enable rapid innovation and feature development by optimizing for high-priority, ML-centric use cases. Our platform supports the serving of state-of-the-art (SOTA) machine learning models for experimental and bulk inference, with a focus on performance, availability, concurrency, and scalability. We're committed to maximizing GPU utilization across platforms (B200, H100, A100, and more) while maintaining reliability and cost efficiency.

About the Role :

We are seeking a Staff ML Infrastructure engineer to help build and scale robust Compute platforms for ML workflows. In this role, you'll work closely with ML engineers and researchers to ensure efficient model serving and inference in production, for their workflows such as data mining, labeling, model distillation, simulations and more. This is a high-impact opportunity to influence the future of AI infrastructure. You will play a key role in shaping the architecture, roadmap and user-experience of a robust ML inference service supporting real-time, batch, and experimental inference needs. The ideal candidate brings experience in designing distributed systems for ML, strong problem-solving skills, and a product mindset focused on platform usability and reliability.

What you'll be doing :

Design and implement core platform backend software components.

  • Collaborate with ML engineers and researchers to understand critical workflows, parse them to platform requirements, and deliver incremental value.
  • Lead technical decision-making on model serving strategies, orchestration, caching, model versioning, and auto-scaling mechanisms.
  • Drive the development of monitoring, observability, and metrics to ensure reliability, performance, and resource optimization of inference services.
  • Proactively research and integrate state-of-the-art model serving frameworks, hardware accelerators, and distributed computing techniques.
  • Lead large-scale technical initiatives across ML ecosystem.
  • Raise the engineering bar through technical leadership, establishing best practices.
  • Contribute to open-source projects; represent in relevant communities.

Minimum Requirements

8+ years of industry experience, with focus on machine learning systems or high-performance backend services.

  • Expertise in either Go, Python, C++ or other relevant coding languages.
  • Expertise in ML inference, model serving frameworks (triton, rayserve, vLLM etc).
  • Strong communication skills and a proven ability to drive cross-functional initiatives.
  • Experience working with cloud platforms such as GCP, Azure, or AWS.
  • Ability to thrive in a dynamic, multi-tasking environment with ever-evolving priorities.
  • Preferred Qualifications

    Hands-on experience building ML infrastructure platforms for model serving / inference.

  • Experience working with or designing interfaces, APIs and clients for ML workflows.
  • Experience with Ray framework, and / or vLLM.
  • Experience with distributed systems and handling large-scale data processing.
  • Familiarity with telemetry, and other feedback loops to inform product improvements.
  • Familiarity with hardware acceleration (GPUs) and optimizations for inference workloads.
  • Contributions to open-source ML serving frameworks.
  • The compensation range for this position is $195,000 to $295,000

    (dependent on factors including but not limited to client requirements, experience, statutory considerations, and location).

  • Note : Disclosure as required by the Equal Pay for Equal Work Act (CO), NYC Pay Transparency Law, and sb5761 (WA)
  • Synergis is proud to be an Equal Opportunity Employer. We value diversity and do not discriminate on the basis of race, color, ethnicity, national origin, religion, age, gender, gender identity, political affiliation, sexual orientation, marital status, disability, military / veteran status, or any other status protected by applicable law.

    For consideration, please forward your resume to dwicks@synergishr.com

    If you require assistance or an accommodation in the application or employment process, please contact us at dwicks@synergishr.com.

    Qualified applicants with arrest or conviction records will be considered for employment in accordance with the requirements of applicable state and local laws, including but not limited to, the San Francisco Fair Chance Ordinance, the City of Los Angeles' Fair Chance Initiative for Hiring Ordinance, the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.

    Synergis is a workforce solutions partner serving thousands of businesses and job seekers nationwide. Our digital world has accelerated the need for businesses to build IT ecosystems that enable growth and innovation along with enhancing the Total Experience (TX). Synergis partners with our clients at the intersection of talent and transformation to scale their balanced teams of tech, digital and creative professionals. Learn more about Synergis at ww.synergishr.com.

    Create a job alert for this search

    Ml Engineer • Fremont, CA, US

    Related jobs
    Senior Staff Software Engineer, ML Engineering, Perception

    Senior Staff Software Engineer, ML Engineering, Perception

    Waymo • Mountain View, CA, United States
    Full-time
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...Show more
    Last updated: 30+ days ago • Promoted
    Staff ML Engineer (Fremont)

    Staff ML Engineer (Fremont)

    Synergis • Fremont, CA, US
    Part-time +1
    Detroit, MI or San Francisco, CA.The ML Inference Platform is part of the AI Compute Platforms organization within Infrastructure Platforms. Our team owns the cloud-agnostic, reliable, and cost-effi...Show more
    Last updated: 1 day ago • Promoted
    Staff Machine Learning Engineer

    Staff Machine Learning Engineer

    Hive • San Francisco, CA, United States
    Full-time
    Hive is the leading provider of cloud-based AI solutions to understand, search, and generate content, and is trusted by hundreds of the world's largest and most innovative organizations.The company...Show more
    Last updated: 30+ days ago • Promoted
    Staff Software Engineer, Model Serving

    Staff Software Engineer, Model Serving

    Databricks Inc. • San Francisco, CA, United States
    Full-time
    At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical ...Show more
    Last updated: 5 days ago • Promoted
    Staff Machine Learning Engineer

    Staff Machine Learning Engineer

    Elios Talent • San Francisco, CA, United States
    Full-time
    Lead cutting-edge ML initiatives and platforms.Build distributed, scalable AI systems in production.Mentor and guide engineering teams in ML best practices. Staff Machine Learning Engineer.We are se...Show more
    Last updated: 23 days ago • Promoted
    Staff ML Engineer (Santa Clara)

    Staff ML Engineer (Santa Clara)

    Synergis • Santa Clara, CA, US
    Part-time +1
    Detroit, MI or San Francisco, CA.The ML Inference Platform is part of the AI Compute Platforms organization within Infrastructure Platforms. Our team owns the cloud-agnostic, reliable, and cost-effi...Show more
    Last updated: 1 day ago • Promoted
    Staff Machine Learning Engineer

    Staff Machine Learning Engineer

    scribehow.com • San Francisco, CA, United States
    Full-time
    We're looking for a highly motivated and skilled Staff Machine Learning Engineer to build the future of AI productivity software. You will lead high-impact research and development, drive our core A...Show more
    Last updated: 30+ days ago • Promoted
    Staff Machine Learning Engineer

    Staff Machine Learning Engineer

    Adobe Inc. • San Jose, CA, United States
    Full-time
    Adobe Experience Intelligence Team is looking for a Staff Machine Learning Engineer who will apply AI and machine learning techniques to big-data problems to help Adobe better understand, manage an...Show more
    Last updated: 30+ days ago • Promoted
    Staff ML Engineer (San Francisco Bay Area)

    Staff ML Engineer (San Francisco Bay Area)

    Synergis • San Francisco Bay Area, US
    Part-time +1
    Detroit, MI or San Francisco, CA.The ML Inference Platform is part of the AI Compute Platforms organization within Infrastructure Platforms. Our team owns the cloud-agnostic, reliable, and cost-effi...Show more
    Last updated: 1 day ago • Promoted
    Staff Software Engineer, ML Frameworks & Efficiency

    Staff Software Engineer, ML Frameworks & Efficiency

    Waymo • Mountain View, CA, United States
    Full-time
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...Show more
    Last updated: 30+ days ago • Promoted
    Staff ML Engineer (Hayward)

    Staff ML Engineer (Hayward)

    Synergis • Hayward, CA, US
    Part-time +1
    Detroit, MI or San Francisco, CA.The ML Inference Platform is part of the AI Compute Platforms organization within Infrastructure Platforms. Our team owns the cloud-agnostic, reliable, and cost-effi...Show more
    Last updated: 1 day ago • Promoted
    Staff Software Engineer, ML Platform

    Staff Software Engineer, ML Platform

    Attentive • San Francisco, CA, United States
    Full-time
    Attentive® is the AI-powered mobile marketing platform transforming the way brands personalize consumer engagement.Attentive enables marketers to craft tailored journeys for every subscriber, drivi...Show more
    Last updated: 6 days ago • Promoted
    Staff ML Engineer (San Jose)

    Staff ML Engineer (San Jose)

    Synergis • San Jose, CA, US
    Part-time +1
    Detroit, MI or San Francisco, CA.The ML Inference Platform is part of the AI Compute Platforms organization within Infrastructure Platforms. Our team owns the cloud-agnostic, reliable, and cost-effi...Show more
    Last updated: 1 day ago • Promoted
    Staff Engineer

    Staff Engineer

    Bio-Rad Laboratories • Pleasanton, CA, United States
    Full-time
    As a Senior Electrical Engineer, you will play a critical role in designing, debugging, and supporting custom electronics solutions for cutting-edge life science research platforms.You'll drive the...Show more
    Last updated: 30+ days ago • Promoted
    Sr. Staff Engineer

    Sr. Staff Engineer

    Bio-Rad Laboratories • Pleasanton, CA, United States
    Full-time
    You'll drive the development of hardware products that directly impact healthcare innovation and improve lives worldwide. You'll collaborate cross-functionally to.Your expertise in electrical engine...Show more
    Last updated: 30+ days ago • Promoted
    Senior ML Accelerator Modeling Engineer

    Senior ML Accelerator Modeling Engineer

    Waymo • Mountain View, CA, United States
    Full-time
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...Show more
    Last updated: 9 days ago • Promoted
    Staff ML Engineer

    Staff ML Engineer

    Synergis • San Mateo, CA, US
    Permanent
    Detroit, MI or San Francisco, CA.The ML Inference Platform is part of the AI Compute Platforms organization within Infrastructure Platforms. Our team owns the cloud-agnostic, reliable, and cost-effi...Show more
    Last updated: 1 day ago • Promoted
    Staff ML Engineer (San Francisco)

    Staff ML Engineer (San Francisco)

    Synergis • San Francisco, CA, US
    Part-time +1
    Detroit, MI or San Francisco, CA.The ML Inference Platform is part of the AI Compute Platforms organization within Infrastructure Platforms. Our team owns the cloud-agnostic, reliable, and cost-effi...Show more
    Last updated: 1 day ago • Promoted
    Staff ML Engineer (Alameda)

    Staff ML Engineer (Alameda)

    Synergis • Alameda, CA, US
    Part-time +1
    Detroit, MI or San Francisco, CA.The ML Inference Platform is part of the AI Compute Platforms organization within Infrastructure Platforms. Our team owns the cloud-agnostic, reliable, and cost-effi...Show more
    Last updated: 1 day ago • Promoted
    Staff Software Development Engineer (LLM)

    Staff Software Development Engineer (LLM)

    Fortinet • Sunnyvale, CA, United States
    Full-time
    Architect and implement functions to monitor and filter LLM requests / responses in real time, preventing prompt injection attacks and unauthorized data leakage. Build a highly scalable pipeline capab...Show more
    Last updated: 1 day ago • Promoted