Talent.com
Staff ML Engineer
Staff ML EngineerSynergis • Hayward, CA, US
Staff ML Engineer

Staff ML Engineer

Synergis • Hayward, CA, US
9 days ago
Job type
  • Permanent
Job description

Staff ML Engineer

Direct Hire

Detroit, MI or San Francisco, CA

$195K-$295K

About the Team :

The ML Inference Platform is part of the AI Compute Platforms organization within Infrastructure Platforms. Our team owns the cloud-agnostic, reliable, and cost-efficient platform that powers our client's AI efforts. We're proud to serve as the AI infrastructure platform for teams developing autonomous vehicles (L3 / L4 / L5), as well as other groups building AI-driven products for our client and their customers. We enable rapid innovation and feature development by optimizing for high-priority, ML-centric use cases. Our platform supports the serving of state-of-the-art (SOTA) machine learning models for experimental and bulk inference, with a focus on performance, availability, concurrency, and scalability. We're committed to maximizing GPU utilization across platforms (B200, H100, A100, and more) while maintaining reliability and cost efficiency.

About the Role :

We are seeking a Staff ML Infrastructure engineer to help build and scale robust Compute platforms for ML workflows. In this role, you'll work closely with ML engineers and researchers to ensure efficient model serving and inference in production, for their workflows such as data mining, labeling, model distillation, simulations and more. This is a high-impact opportunity to influence the future of AI infrastructure. You will play a key role in shaping the architecture, roadmap and user-experience of a robust ML inference service supporting real-time, batch, and experimental inference needs. The ideal candidate brings experience in designing distributed systems for ML, strong problem-solving skills, and a product mindset focused on platform usability and reliability.

What you'll be doing :

Design and implement core platform backend software components.

  • Collaborate with ML engineers and researchers to understand critical workflows, parse them to platform requirements, and deliver incremental value.
  • Lead technical decision-making on model serving strategies, orchestration, caching, model versioning, and auto-scaling mechanisms.
  • Drive the development of monitoring, observability, and metrics to ensure reliability, performance, and resource optimization of inference services.
  • Proactively research and integrate state-of-the-art model serving frameworks, hardware accelerators, and distributed computing techniques.
  • Lead large-scale technical initiatives across ML ecosystem.
  • Raise the engineering bar through technical leadership, establishing best practices.
  • Contribute to open-source projects; represent in relevant communities.

Minimum Requirements

8+ years of industry experience, with focus on machine learning systems or high-performance backend services.

  • Expertise in either Go, Python, C++ or other relevant coding languages.
  • Expertise in ML inference, model serving frameworks (triton, rayserve, vLLM etc).
  • Strong communication skills and a proven ability to drive cross-functional initiatives.
  • Experience working with cloud platforms such as GCP, Azure, or AWS.
  • Ability to thrive in a dynamic, multi-tasking environment with ever-evolving priorities.
  • Preferred Qualifications

    Hands-on experience building ML infrastructure platforms for model serving / inference.

  • Experience working with or designing interfaces, APIs and clients for ML workflows.
  • Experience with Ray framework, and / or vLLM.
  • Experience with distributed systems and handling large-scale data processing.
  • Familiarity with telemetry, and other feedback loops to inform product improvements.
  • Familiarity with hardware acceleration (GPUs) and optimizations for inference workloads.
  • Contributions to open-source ML serving frameworks.
  • The compensation range for this position is $195,000 to $295,000

    (dependent on factors including but not limited to client requirements, experience, statutory considerations, and location).

  • Note : Disclosure as required by the Equal Pay for Equal Work Act (CO), NYC Pay Transparency Law, and sb5761 (WA)
  • Synergis is proud to be an Equal Opportunity Employer. We value diversity and do not discriminate on the basis of race, color, ethnicity, national origin, religion, age, gender, gender identity, political affiliation, sexual orientation, marital status, disability, military / veteran status, or any other status protected by applicable law.

    For consideration, please forward your resume to dwicks@synergishr.com

    If you require assistance or an accommodation in the application or employment process, please contact us at dwicks@synergishr.com.

    Qualified applicants with arrest or conviction records will be considered for employment in accordance with the requirements of applicable state and local laws, including but not limited to, the San Francisco Fair Chance Ordinance, the City of Los Angeles' Fair Chance Initiative for Hiring Ordinance, the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.

    Synergis is a workforce solutions partner serving thousands of businesses and job seekers nationwide. Our digital world has accelerated the need for businesses to build IT ecosystems that enable growth and innovation along with enhancing the Total Experience (TX). Synergis partners with our clients at the intersection of talent and transformation to scale their balanced teams of tech, digital and creative professionals. Learn more about Synergis at ww.synergishr.com.

    Create a job alert for this search

    Ml Engineer • Hayward, CA, US

    Related jobs
    Staff Software Development Engineer (LLM)

    Staff Software Development Engineer (LLM)

    Fortinet • Sunnyvale, CA, United States
    Full-time
    Architect and implement functions to monitor and filter LLM requests / responses in real time, preventing prompt injection attacks and unauthorized data leakage. Build a highly scalable pipeline capab...Show more
    Last updated: 21 days ago • Promoted
    Staff Software Engineer, ML Performance Optimization

    Staff Software Engineer, ML Performance Optimization

    Zoox • Foster City, CA, US
    Full-time
    Zoox is on a mission to reimagine transportation and ground-up build autonomous robotaxis that are safe, reliable, clean, and enjoyable for everyone. We are still in the early stages of deploying ou...Show more
    Last updated: 14 days ago • Promoted
    AIML - Staff ML Infrastructure Engineer, ML Platform & Technology - Pre-training Compute

    AIML - Staff ML Infrastructure Engineer, ML Platform & Technology - Pre-training Compute

    Apple Inc. • San Francisco, CA, United States
    Full-time
    AIML - Staff ML Infrastructure Engineer, ML Platform & Technology - Pre-training Compute.San Francisco Bay Area, California, United States Machine Learning and AI. Apple is where individual imaginat...Show more
    Last updated: 14 days ago • Promoted
    Staff Machine Learning Engineer

    Staff Machine Learning Engineer

    VirtualVocations • Concord, California, United States
    Full-time
    A company is looking for a Staff Machine Learning Engineer - Wildfire.Key Responsibilities Architect and build advanced ML models to predict vegetation and fuel conditions Design and maintain da...Show more
    Last updated: 30+ days ago • Promoted
    Staff Software Engineer, ML Platform with CJIS Certification

    Staff Software Engineer, ML Platform with CJIS Certification

    VirtualVocations • Concord, California, United States
    Full-time
    A company is looking for a Staff Software Engineer, ML Platform.Key Responsibilities Own and extend MLOps systems, leading development and maintenance Enhance ML R&D infrastructure for rapid exp...Show more
    Last updated: 2 days ago • Promoted
    Staff Engineer

    Staff Engineer

    VirtualVocations • Fremont, California, United States
    Full-time
    A company is looking for a Staff Engineer - Remote, UK.Key Responsibilities Design and develop software solutions for complex systems Collaborate with cross-functional teams to ensure project su...Show more
    Last updated: 30+ days ago • Promoted
    Senior Staff Engineer

    Senior Staff Engineer

    VirtualVocations • Concord, California, United States
    Full-time
    A company is looking for a Senior Staff Engineer - Remote, UK.Key Responsibilities Lead engineering projects and initiatives to drive product development Collaborate with cross-functional teams ...Show more
    Last updated: 30+ days ago • Promoted
    MLOps Engineer

    MLOps Engineer

    VirtualVocations • Fremont, California, United States
    Full-time
    A company is looking for an MLOps / ML Platform Engineer.Key Responsibilities Design and operate ML infrastructure for high-throughput model workflows Build scalable pipelines for training and e...Show more
    Last updated: 30+ days ago • Promoted
    Staff Software Engineer Lead, AI / ML

    Staff Software Engineer Lead, AI / ML

    Google Inc. • Mountain View, CA, United States
    Full-time
    Google place Mountain View, CA, USA.Bachelor’s degree or equivalent practical experience.ML infrastructure, or specialization in another ML field. ML design and ML infrastructure (e.Master's or PhD ...Show more
    Last updated: 1 day ago • Promoted
    Staff ML Engineer - Infrastructure

    Staff ML Engineer - Infrastructure

    ChipStack • San Jose, CA, US
    Full-time
    Chips are at the center of today's tech-driven world.But how we design them has not changed in decades, while their complexity and specialization have skyrocketed due to increasing performance ...Show more
    Last updated: 30+ days ago • Promoted
    Principal ML Engineer

    Principal ML Engineer

    1010 Analog Devices Inc. • Rio Robles, CA, United States
    Full-time +1
    NASDAQ : ADI ) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the Intelligent Edge. ADI combines analog, digital, and software technologie...Show more
    Last updated: 30+ days ago • Promoted
    ML Engineer

    ML Engineer

    Phizenix • Menlo Park, CA, US
    Full-time +1
    Client Opportunity | Through Phizenix.Phizenix, a certified minority and women-led recruiting firm, is hiring on behalf of an innovative generative AI startup that's developing diffusion-based larg...Show more
    Last updated: 30+ days ago • Promoted
    Staff Software Engineer, ML Platform

    Staff Software Engineer, ML Platform

    Attentive • San Francisco, CA, United States
    Full-time
    Attentive® is the AI-powered mobile marketing platform transforming the way brands personalize consumer engagement.Attentive enables marketers to craft tailored journeys for every subscriber, drivi...Show more
    Last updated: 14 days ago • Promoted
    Staff Engineer

    Staff Engineer

    Kennedyjenks • San Francisco, CA, United States
    Full-time
    Founded in 1919, KJ has always looked to the future.With a talented team of professionals and a culture of continuous improvement, we deliver exceptional engineering, environmental consulting, and ...Show more
    Last updated: 2 days ago • Promoted
    Staff Engineer

    Staff Engineer

    Bio-Rad Laboratories • Pleasanton, CA, United States
    Full-time
    As a Senior Electrical Engineer, you will play a critical role in designing, debugging, and supporting custom electronics solutions for cutting-edge life science research platforms.You'll drive the...Show more
    Last updated: 30+ days ago • Promoted
    Lead ML Engineer

    Lead ML Engineer

    Visa • Foster City, CA, United States
    Full-time
    Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more t...Show more
    Last updated: 2 days ago • Promoted
    Sr. Staff Engineer

    Sr. Staff Engineer

    Bio-Rad Laboratories • Pleasanton, CA, United States
    Full-time
    You'll drive the development of hardware products that directly impact healthcare innovation and improve lives worldwide. You'll collaborate cross-functionally to.Your expertise in electrical engine...Show more
    Last updated: 30+ days ago • Promoted
    Senior ML Engineer

    Senior ML Engineer

    VirtualVocations • Concord, California, United States
    Full-time
    A company is looking for a Senior ML Engineer - Personalisation.Key Responsibilities Develop, deploy, and iterate on scalable, real-time Next Best Action (NBA) and ranking models Design and impl...Show more
    Last updated: 30+ days ago • Promoted