Talent.com
Senior Machine Learning Engineer II - LLM
Senior Machine Learning Engineer II - LLMMoveworks • Mountain View, California, United States
Senior Machine Learning Engineer II - LLM

Senior Machine Learning Engineer II - LLM

Moveworks • Mountain View, California, United States
30+ days ago
Job type
  • Full-time
Job description

What You Will Do

We are looking for a Machine Learning Engineer to help build cutting edge ML infrastructure for building and serving LLM’s  at Moveworks. This role will be critical in building, optimizing and scaling end-to-end machine learning systems. The ML infra team covers a variety of responsibilities including distributed training and inference pipeline for large language models(LLM), model evaluation and monitoring framework, LLM latency optimization, etc. These frameworks serve as a strong foundation for our hundreds of ML and NLP models in production serving hundreds of millions of enterprise employees. We are solving many challenges on scalability of services as well as optimization of core algorithms.

In this role you will work closely with our machine learning team, data infrastructure team and every core skill. Above all, your work will impact the way our customers experience AI. Put another way, this role is absolutely critical to the long term scalability of our core AI product and ultimately the company. You will be responsible for building and productionizing ML infrastructure that runs state of the art models. If you are looking for a high-impact, fast-moving role to take your work to the next level, we should have a conversation.

  • Design, build and optimize scalable machine learning infrastructure to support training, evaluation, and deployment of large language models.
  • Build abstractions to automate various steps in different ML workflows
  • Collaborate with cross functional teams of engineers, data analytics, machine learning experts, and product to build new features
  • Leverage your experience to drive best practices in ML and data engineering

What You Bring To The Table

  • 2+ years of industry experience in Machine Learning, Infrastructure or related fields
  • Experience with deep learning framework such as Pytorch or Huggingface or LLM serving frameworks such as vLLM or TensorRT-LLM.
  • Experience with building and scaling end-to-end machine learning systems
  • Experience building scalable micro services and ETL pipelines
  • Expertise in Python and experience with performant language such as C++ or GoLang
  • Bachelor's in Computer Science, Computer Engineering, Mathematics, or equivalent field.
  • A love of research publications in the machine learning and software engineering communities
  • Effective communicator with experience collaborating cross-functionally with other teams
  • Nice To Haves

  • Experience with ML Inference optimization using TensorRT.
  • Experience with distributed training  frameworks such as Deepspeed.
  • Experience in managing and scaling GPU Inference services via Kubernetes
  • Base salary compensation range : $200,000 - $275,000

    Create a job alert for this search

    Senior Machine Learning Engineer • Mountain View, California, United States

    Related jobs
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    Quantix Search • Fremont, CA, United States
    Full-time
    Senior Machine Learning Engineer.San Francisco | Hybrid, 3 days / week | $200K - $280K + equity.We are excited to partner with a rapidly growing healthtech startup that has successfully raised $40M i...Show more
    Last updated: 3 days ago • Promoted
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    Scribd • San Francisco, CA, United States
    Full-time
    At Scribd (pronounced “scribbed”), our mission is to spark human curiosity.Join our team as we create a world of stories and knowledge, democratize the exchange of ideas and information, and empowe...Show more
    Last updated: 30+ days ago • Promoted
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    Top Engineer • San Francisco, CA, United States
    Full-time
    Confidential Search for International Employer.Social Commerce / AI Technology.BS in Computer Science or Mathematics from Top 40 University. AI-POWERED SOCIAL COMMERCE REVOLUTION.Role : Senior Machin...Show more
    Last updated: 12 hours ago • Promoted • New!
    Senior Machine Learning Engineer, ML Platform

    Senior Machine Learning Engineer, ML Platform

    Block • San Francisco, CA, United States
    Full-time
    Senior Machine Learning Engineer, ML Platform.Block is one company built from many blocks, all united by the same purpose of economic empowerment. The blocks that form our foundational teams — Peopl...Show more
    Last updated: 8 days ago • Promoted
    Senior Machine Learning Engineer (Recommendations)

    Senior Machine Learning Engineer (Recommendations)

    Scribd • San Francisco, CA, United States
    Full-time
    At Scribd (pronounced “scribbed”), our mission is to spark human curiosity.Join our team as we create a world of stories and knowledge, democratize the exchange of ideas and information, and empowe...Show more
    Last updated: 30+ days ago • Promoted
    Senior Machine Learning Engineer, AI Enablement

    Senior Machine Learning Engineer, AI Enablement

    Genentech • San Francisco, CA, United States
    Full-time
    We advance science so that we all have more time with the people we love.It’s what drives us to innovate.To continuously advance science and ensure everyone has access to the healthcare they need t...Show more
    Last updated: 30+ days ago • Promoted
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    RainesDev • San Francisco, CA, United States
    Full-time
    We're a leading partner in social commerce, collaborating with major athletic wear, footwear, and electronics brands to expand their influencer-driven sales channels. Having achieved significant rev...Show more
    Last updated: 2 days ago • Promoted
    AIML - Senior Software Engineer, Machine Learning Platform Technologies

    AIML - Senior Software Engineer, Machine Learning Platform Technologies

    San Francisco Staffing • San Francisco, CA, United States
    Full-time
    We are looking for a Senior Software Engineer to shape how we measure the success and reliability of Apple Intelligence software features. This role is at the intersection of feature delivery, telem...Show more
    Last updated: 3 days ago • Promoted
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    Trucksmarter • San Francisco, CA, United States
    Full-time
    Truck drivers are the backbone of the American economy.They move 71% of our freight (~$800bn annually) and make up 6% of the American workforce. But the trucking industry is fragmented, opaque, and ...Show more
    Last updated: 30+ days ago • Promoted
    Machine Learning Engineer (I, II, or Sr.)

    Machine Learning Engineer (I, II, or Sr.)

    ikigailabs.io • San Mateo, CA, United States
    Full-time
    The Ikigai platform unlocks the power of generative AI for tabular data.We enable business users to connect disparate data, leverage no-code AI / ML, and build enterprise-wide AI apps in just a few c...Show more
    Last updated: 30+ days ago • Promoted
    Senior Machine Learning Engineer, AI Collaboration

    Senior Machine Learning Engineer, AI Collaboration

    Snowflake Computing • Menlo Park, CA, United States
    Full-time
    Snowflake is about empowering enterprises to achieve their full potential - and people too.With a culture that's all in on impact, innovation, and collaboration, Snowflake is the sweet spot for bui...Show more
    Last updated: 3 days ago • Promoted
    Senior Machine Learning Engineer II, NLU & Agentic AI

    Senior Machine Learning Engineer II, NLU & Agentic AI

    Moveworks • San Francisco, CA, United States
    Full-time
    Senior Machine Learning Engineer, NLU & Agentic AI.Senior Machine Learning Engineer, NLU & Agentic AI.We are seeking an experienced software engineer with machine learning expertise to help expand ...Show more
    Last updated: 30+ days ago • Promoted
    Senior AI / ML Engineer II

    Senior AI / ML Engineer II

    DigitalOcean • San Francisco, CA, United States
    Full-time
    Be among the first 25 applicants.Dive in and do the best work of your career at DigitalOcean.Journey alongside a strong community of top talent who are relentless in their drive to build the simple...Show more
    Last updated: 30+ days ago • Promoted
    Senior Staff Machine Learning Engineer

    Senior Staff Machine Learning Engineer

    Rippling • San Francisco, CA, United States
    Full-time
    Rippling gives businesses one place to run HR, IT, and Finance.It brings together all of the workforce systems that are normally scattered across a company, like payroll, expenses, benefits, and co...Show more
    Last updated: 30+ days ago • Promoted
    Senior Machine Learning Engineer, Relevance

    Senior Machine Learning Engineer, Relevance

    Patreon • San Francisco, CA, United States
    Full-time
    Patreon is a media and community platform where over 300,000 creators give their biggest fans access to exclusive work and experiences. We offer creators a variety of ways to engage with their fans ...Show more
    Last updated: 30+ days ago • Promoted
    Machine Learning Engineer II

    Machine Learning Engineer II

    Uber • San Francisco, CA, United States
    Full-time
    We are looking for candidates with a passion for solving new and difficult problems with data.In this role, you will be able to use your strong quantitative skills in the fields of machine learning...Show more
    Last updated: 30+ days ago • Promoted
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    Mercury • San Francisco, CA, United States
    Full-time
    Locations : San Francisco, CA; New York, NY; Portland, OR; or Remote within Canada or United States.Mercury is building systems to efficiently review customers’ applications to prevent money launder...Show more
    Last updated: 30+ days ago • Promoted
    AIML - Staff Machine Learning Engineer

    AIML - Staff Machine Learning Engineer

    Apple Inc. • Cupertino, CA, United States
    Full-time
    Cupertino, California, United States Machine Learning and AI.The Apple Knowledge & Information (AKI) Entity Resolution team is looking for senior and staff engineers to lead software projects suffu...Show more
    Last updated: 30+ days ago • Promoted