Talent.com
Staff Software Engineer, Inference (Bay Area / Paris / Remote)

Staff Software Engineer, Inference (Bay Area / Paris / Remote)

GenesisAISan Francisco, CA, United States
30+ days ago
Job type
  • Full-time
  • Remote
Job description

What You'll Do

  • Build low-latency inference pipelines for on-device deployment, enabling real-time next-token and diffusion-based control loops in robotics
  • Design and optimize distributed inference systems on GPU clusters, pushing throughput with large-batch serving and efficient resource utilization
  • Implement efficient low-level code (CUDA, Triton, custom kernels) and integrate it seamlessly into high-level frameworks
  • Optimize workloads for both throughput (batching, scheduling, quantization) and latency (caching, memory management, graph compilation)
  • Develop monitoring and debugging tools to guarantee reliability, determinism, and rapid diagnosis of regressions across both stacks

What You'll Bring

  • Deep experience in distributed systems, ML infrastructure, or high-performance serving (8+ years)
  • Production-grade expertise in Python, with strong background in systems languages (C++ / Rust / Go)
  • Low-level performance mastery : CUDA, Triton, kernel optimization, quantization, memory and compute scheduling
  • Proven track record scaling inference workloads in both throughput-oriented cluster environments and latency-critical on-device deployments
  • System-level mindset with a history of tuning hardware-software interactions for maximum efficiency, throughput, and responsiveness
  • Create a job alert for this search

    Staff Software Engineer • San Francisco, CA, United States

    Related jobs
    • Promoted
    Staff Engineer, Backend Platform

    Staff Engineer, Backend Platform

    ZūmRedwood City, CA, US
    Full-time
    Zum is a rapidly expanding Series E startup backed by industry leaders Sequoia Capital, SoftBank, Spark Capital, and GIC, with a bold mission to transform the stagnant school transportation industr...Show moreLast updated: 25 days ago
    • Promoted
    Staff Software Engineer, AI Platform

    Staff Software Engineer, AI Platform

    EvenUpSan Francisco, CA, United States
    Full-time
    EvenUp is on a mission to close the justice gap using technology and AI.We empower personal injury lawyers and victims to get the justice they deserve. Our products enable law firms to secure faster...Show moreLast updated: 4 days ago
    • Promoted
    Staff Systems Engineer

    Staff Systems Engineer

    Bio-Rad LaboratoriesPleasanton, CA, United States
    Full-time
    Working within Bio-Rad's Life Science R&D Group as a Systems Engineer, you will take engineering concepts, requirements and transform them into functional prototypes and finished products that impr...Show moreLast updated: 19 days ago
    • Promoted
    Software Engineer 2

    Software Engineer 2

    Typical Set, LLCBerkeley, CA, US
    Full-time
    Typical Set, LLC Position : Software Engineer 2 (SE2510) Responsible for developing systems to translate cutting-edge machine learning into complex trading behaviors. Touch areas as wide-ranging as m...Show moreLast updated: 11 days ago
    • Promoted
    Senior Staff Software EngineerSoftware Engineering • Berkeley, CA • Full time • On-site

    Senior Staff Software EngineerSoftware Engineering • Berkeley, CA • Full time • On-site

    Form EnergyBerkeley, CA, United States
    Full-time
    Are you ready to build America's energy future? Form Energy is an American manufacturing and energy technology company.We're revolutionizing energy storage with cost-effective, multi-day technology...Show moreLast updated: 12 days ago
    • Promoted
    Staff AI Software Engineer

    Staff AI Software Engineer

    Komodo HealthSan Francisco, CA, United States
    Full-time
    At Komodo Health, our mission is to reduce the global burden of disease.And we believe that smarter use of data is essential to this mission. That's why we built the Healthcare Map - the industry's ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Software Engineer, Staff - Applied AI

    Software Engineer, Staff - Applied AI

    Merge APISan Francisco, CA, United States
    Full-time
    Merge is the leading provider of agentic tools and customer-facing integrations for frontier LLMs, Fortune 500 organizations, and B2B SaaS companies. Our platform offers two core products : Merge Uni...Show moreLast updated: 14 hours ago
    • Promoted
    Staff Software Engineer

    Staff Software Engineer

    SupermicroSan Jose, CA, United States
    Full-time
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Software Engineer - AI

    Staff Software Engineer - AI

    RipplingSan Francisco, CA, United States
    Full-time
    Rippling gives businesses one place to run HR, IT, and Finance.It brings together all of the workforce systems that are normally scattered across a company, like payroll, expenses, benefits, and co...Show moreLast updated: 8 days ago
    • Promoted
    Staff Software Engineer

    Staff Software Engineer

    FortinetSunnyvale, CA, United States
    Full-time
    Fortinet is looking for a Staff Software Engineer on the FortiCNAPP Team! Be a valuable member of the team that owns and operates high-availability, cross-cloud, large-volume, data processing syste...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Software Engineer

    Staff Software Engineer

    PsiQuantumPalo Alto, CA, United States
    Full-time
    Quantum computing holds the promise of humanity's mastery over the natural world, but only if we can build a.PsiQuantum is on a mission to build the first real, useful quantum computers, capable of...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Software Engineer, AI

    Staff Software Engineer, AI

    Social Finance, Inc. (SoFi)San Francisco, CA, United States
    Full-time
    Shape a brighter financial future with us.Together with our members, we’re changing the way people think about and interact with personal finance. We’re a next-generation financial services company ...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Software Platform EngineerSoftware Engineering • Berkeley, CA; Somerville, MA; Weirton, WV • Full time • On-site

    Staff Software Platform EngineerSoftware Engineering • Berkeley, CA; Somerville, MA; Weirton, WV • Full time • On-site

    Form EnergyBerkeley, CA, United States
    Full-time
    Are you ready to build America's energy future? Form Energy is an American manufacturing and energy technology company.We're revolutionizing energy storage with cost-effective, multi-day technology...Show moreLast updated: 17 days ago
    • Promoted
    Staff Front End Software Engineer

    Staff Front End Software Engineer

    OSI EngineeringMenlo Park, CA, US
    Full-time
    Staff Front End Software Engineer Job Summary We are looking for a talented Staff Software Engineer to join our front-end engineering team developing web solutions. You will be part of a dynamic tea...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Software Engineer

    Staff Software Engineer

    Jibe VenturesSan Francisco, CA, United States
    Full-time
    We’re a Bay Area Cyber AI startup (with support for working remotely).We’ve raised funding from top tier investors.We’re a small team of researchers and engineers with a deep focus in cyber and AI....Show moreLast updated: 30+ days ago
    • Promoted
    Staff Software Engineer

    Staff Software Engineer

    Omada HealthSouth San Francisco, CA, United States
    Full-time
    Omada Health is on a mission to inspire and engage people in lifelong health, one step at a time.Omada Health is a digital care provider that empowers people to achieve their health goals through s...Show moreLast updated: 25 days ago
    • Promoted
    Staff Software Engineer

    Staff Software Engineer

    Bio-Rad LaboratoriesHercules, CA, United States
    Full-time
    This role is both technical and collaborative.You will work closely with cross-functional teams including systems engineers, mechanical designers, assay development scientists, and quality engineer...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Software Engineer, Staff - Applied AI

    Software Engineer, Staff - Applied AI

    Merge LLCSan Francisco, CA, United States
    Full-time
    Software Engineer - Applied AI.Software Engineer - Applied AI.Merge enables B2B companies to add hundreds of integrations to their products, making it easy to access and sync their customers' data....Show moreLast updated: 14 hours ago