Talent.com
No longer accepting applications
Staff Software Engineer, ML Serving Platform

Staff Software Engineer, ML Serving Platform

DoorDashSan Francisco, CA, US
1 day ago
Job type
  • Full-time
Job description

About the Team

DoorDash is building the world’s most reliable on-demand logistics engine. Our Machine Learning Platform (MLP) powers real-time decision-making for millions of orders each day, supporting Ads, Groceries, Logistics, Fraud, and Search.

About the Role

We’re seeking a Staff Software Engineer with deep expertise in ML model serving to drive the next generation of our inference platform. This is a highly technical, hands-on role : design and build systems that power real-time predictions across millions of requests per second, addressing reliability, efficiency, and cost-aware scaling. You will collaborate with core infrastructure teams and applied ML teams across Ads, Fraud, Logistics, and Search who depend on our platform to productionize models. You’ll leverage open-source frameworks and vendor solutions and contribute back where it makes sense. As Staff Software Engineer, you will pair deep technical execution with influence on the roadmap, ensuring our serving systems scale reliably as model architectures and business needs evolve.

In this role, you will

  • Scale richer models at low latency - Design serving systems that handle large, complex models while balancing cost, throughput, and strict latency SLOs.
  • Bring modern inference optimizations into production - Operationalize advances from the ML serving ecosystem (e.g., efficient caching, attention optimizations, batching, quantization) to improve user experience, latency, and cost efficiency across our fleet.
  • Enable platform-wide impact - Build abstractions and primitives that let serving improvements apply broadly across workloads, not just point solutions for individual models.
  • Leverage and contribute to OSS - Utilize open-source serving ecosystems and vendor solutions and contribute improvements where it helps the community.
  • Drive cost & reliability - Design autoscaling and scheduling across heterogeneous hardware (GPU / TPU / CPU) with strong isolation, observability, and tail-latency control.
  • Collaborate broadly - Partner with ML engineers, infra teams, external vendors, and open-source communities to evolve our serving stack with business needs.
  • Raise the engineering bar - Establish metrics and processes that improve developer velocity, system reliability, and long-term maintainability.

We’re excited about you because…

  • Have 8+ years of engineering experience, including building or operating large-scale, high-QPS ML serving systems.
  • Bring deep familiarity with ML inference and serving ecosystems.
  • Know how to leverage and extend open-source frameworks and evaluate vendor solutions pragmatically.
  • Balance hands-on execution with long-term platform thinking, making sound trade-offs.
  • Care deeply about reliability, performance, observability, and security in production systems.
  • Lead by example — collaborating effectively, mentoring peers, and setting a high bar for craftsmanship.
  • Nice To Haves

  • GPU serving expertise with frameworks like NVIDIA Triton, TensorRT-LLM, ONNX Runtime, or vLLM, including KV caching, batching, and memory-efficient inference.
  • Familiarity with PyTorch, TensorFlow, and large language models (LLMs) such as GPT-OSS or BERT.
  • Hands-on experience with Kubernetes / EKS, microservice architectures, and large-scale orchestration for inference workloads.
  • Cloud experience (AWS, GCP, Azure) with a focus on scaling, observability, and cost optimization.
  • Prior contributions to OSS serving ecosystems or active participation in developer communities.
  • Compensation

    The successful candidate’s starting pay falls within the listed range and is determined by factors including skills, experience, location, and market conditions. Base salary is localized by work location. Ranges are market-dependent and may change. In addition to base salary, compensation includes opportunities for equity grants. Information provided by the recruiter can be shared as needed.

    DoorDash offers a comprehensive benefits package, including 401(k) with employer matching, paid parental leave, wellness benefits, commuter benefits match, paid time off and sick leave, medical / dental / vision benefits, paid holidays, disability and life insurance, family-forming assistance, and a mental health program. For more details, see the careers page.

    Paid time off details : salaried roles — flexible PTO plus paid sick time; hourly roles — vacation and sick time accrual as described in company policy.

    About DoorDash

    DoorDash empowers local economies by moving quickly, learning, and iterating to make impactful decisions for Dashers, merchant partners, and consumers. We are a technology and logistics company evolving from food delivery to a broader on-demand platform.

    Our Commitment to Diversity and Inclusion

    We are committed to building an inclusive community with diverse teams from all backgrounds, experiences, and perspectives. We believe true innovation happens when everyone has a seat at the table and access to tools and opportunities to excel.

    Statement of Non-Discrimination : We do not discriminate or harass based on protected categories and strive to prevent stereotype-driven barriers to success. We encourage applicants from diverse backgrounds to apply. If you need accommodations, please inform your recruiting contact.

    #J-18808-Ljbffr

    Create a job alert for this search

    Staff Software Engineer • San Francisco, CA, US

    Related jobs
    • Promoted
    Staff Software Engineer, Android

    Staff Software Engineer, Android

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Staff Software Engineer, Android to take ownership of their Android app across all phases of product development. Key Responsibilities Own Android technical strategy & d...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Staff Simulation Software Engineer

    Staff Simulation Software Engineer

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Staff Simulation Software Engineer.Key Responsibilities Design and build simulation frameworks and tools to evaluate robot performance across diverse environments and u...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Technical Staff Engineer

    Technical Staff Engineer

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Member of Technical Staff - Rapid Response - Integrations.Key Responsibilities Design, develop, and scale integrations with major cloud providers to support observabili...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Staff Software Engineer

    Staff Software Engineer

    SuperDialSan Mateo County, CA, US
    Full-time
    SuperDial is seeking a Staff Software Engineer to build and scale the backend systems that power large language model (LLM) applications in healthcare. This role is ideal for an engineer who thrives...Show moreLast updated: 9 hours ago
    • Promoted
    Staff Developer Advocate

    Staff Developer Advocate

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Staff Developer Advocate.Key Responsibilities Architect and develop AI-focused sample applications for developers Support and participate in local developer events and...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Software Engineer, Fullstack

    Software Engineer, Fullstack

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Software Engineer, Fullstack.Key Responsibilities Collaborate with reliability experts to assess and enhance the performance of the analytics platform Design and build...Show moreLast updated: 14 hours ago
    • Promoted
    Staff Software Engineer, Platform

    Staff Software Engineer, Platform

    Scale AI, Inc.San Francisco, CA, United States
    Full-time
    Software is eating the world, but AI is eating software.We live in unprecedented times - AI has the potential to exponentially augment human intelligence. Every person will have a personal tutor, co...Show moreLast updated: 14 days ago
    • Promoted
    Staff Software Engineer

    Staff Software Engineer

    VirtualVocationsSanta Clara, California, United States
    Full-time
    A company is looking for a Staff Software Engineer to join their Product Engineering team.Key Responsibilities Contribute to the design and implementation of frontend applications Set team stand...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Staff Protocol Engineer

    Senior Staff Protocol Engineer

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Senior Staff Protocol Engineer to join their Protocols team.Key Responsibilities Lead research and development initiatives to improve and scale Base's throughput Enhan...Show moreLast updated: 2 days ago
    • Promoted
    Staff Full-Stack Engineer

    Staff Full-Stack Engineer

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Staff Full-Stack Engineer, Front-end (SEO Engineering).Key Responsibilities Lead initiatives to enhance performance, SEO, and user engagement for high-traffic organic p...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Software Engineer

    Staff Software Engineer

    PsiQuantumPalo Alto, CA, United States
    Full-time
    Quantum computing holds the promise of humanity's mastery over the natural world, but only if we can build a.PsiQuantum is on a mission to build the first real, useful quantum computers, capable of...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer (Union Position)

    Software Engineer (Union Position)

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Software Engineer (JavaScript).Key Responsibilities : Develop and maintain web applications using JavaScript / TypeScript with NestJS and Next. Design and implement AI-driv...Show moreLast updated: 1 day ago
    • Promoted
    Lead Software Engineer

    Lead Software Engineer

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Lead Software Engineer who will work remotely.Key Responsibilities Design, develop, and implement software systems using server-side frameworks and client-side technolo...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Sr. Software Engineer

    Sr. Software Engineer

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Sightline Sr.Key Responsibilities Develop, enhance, maintain, and support software within Enterprise Business Solutions environments, focusing on SAP and Workday system...Show moreLast updated: 10 hours ago
    • Promoted
    Staff Software Engineer, ML Platform

    Staff Software Engineer, ML Platform

    PinterestSan Francisco, CA, United States
    Full-time
    Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we're on a mission to br...Show moreLast updated: 15 days ago
    • Promoted
    Staff Fullstack Software Engineer

    Staff Fullstack Software Engineer

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Staff Fullstack Software Engineer.Key Responsibilities Own the web and data frontend, API, ETL pipeline, and backend infrastructure Collaborate with fullstack and iOS ...Show moreLast updated: 1 day ago
    • Promoted
    Staff Software Engineer

    Staff Software Engineer

    Bio-Rad LaboratoriesHercules, CA, United States
    Full-time
    This role is both technical and collaborative.You will work closely with cross-functional teams including systems engineers, mechanical designers, assay development scientists, and quality engineer...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Staff ML Engineer, Robotics

    Staff ML Engineer, Robotics

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Staff ML Engineer, Robotics.Key Responsibilities Develop and deploy ML models for perception / navigation tasks Design and implement sensor fusion and mapping pipelines ...Show moreLast updated: 10 hours ago
    • Promoted
    Senior ML Engineer

    Senior ML Engineer

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Senior / Staff ML Engineer to enhance their AI capabilities for residential construction.Key Responsibilities Shape the vision for AI / ML integration into products and ope...Show moreLast updated: 2 days ago
    • Promoted
    Software Engineer

    Software Engineer

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Software Engineer - AI.Key Responsibilities Design and maintain backend APIs and orchestration services using Node. Express and Python Build data pipelines (ETL) to ing...Show moreLast updated: 30+ days ago