Talent.com
Senior Technical Product Manager Token Factory - Inference

Senior Technical Product Manager Token Factory - Inference

NebiusRemote, Remote, United States
3 days ago
Job type
  • Full-time
  • Remote
Job description

Why work at Nebius

Nebius is leading a new era in cloud computing to serve the global AI economy. We create the tools and resources our customers need to solve real-world challenges and transform industries, without massive infrastructure costs or the need to build large in-house AI / ML teams. Our employees work at the cutting edge of AI cloud infrastructure alongside some of the most experienced and innovative leaders and engineers in the field.

Where we work

Headquartered in Amsterdam and listed on Nasdaq, Nebius has a global footprint with R&D hubs across Europe, North America, and Israel. The team of over 800 employees includes more than 400 highly skilled engineers with deep expertise across hardware and software engineering, as well as an in-house AI R&D team.

The role

In this role, you will lead the definition, development, and delivery of Nebius Token Factory’s inference capabilities, focusing on highly scalable, production-grade machine learning systems. You will be responsible for shaping the direction of our inference platform, driving product decisions that balance performance, reliability, and real-world customer needs. This includes working closely with engineering and research teams to design and optimize real-time and batch inference workflows, supporting customer PoCs, and translating technical challenges into clear product requirements.

You will work directly with customers and internal stakeholders to understand ML workflows at scale, identify bottlenecks, and define features that improve latency, throughput, orchestration, and deployment efficiency. You will also guide product adoption by delivering intuitive tools and robust infrastructure that solve complex inference problems across diverse use cases. This role requires a strong technical foundation in ML systems and a product mindset oriented toward execution, clarity, and long-term scalability.

You are welcome to work remotely from the US.

Your responsibilities will include :

  • Own the product roadmap for Nebius Token Factory inference capabilities, focusing on high-load, production-grade ML scenarios.
  • Be involved in customer PoCs involving distributed ML model deployment, inference orchestration, and optimization.
  • Work closely with engineering and research teams to shape scalable infrastructure for real-time and batch inference.
  • Act as the technical voice in customer conversations, translating ML workflows into product requirements.
  • Drive product adoption by delivering tools and features that solve real-world inference problems at scale.

We expect you to have :

  • 3–5 years of product management experience, ideally in cloud infrastructure, ML platforms, or developer tools.
  • Strong technical foundation (e.g. Computer Science or Engineering degree) with ability to dive deep into model architectures and serving systems.
  • Familiarity with modern ML inference tools and frameworks (e.g., Triton Inference Server, vLLM, SGLang, TensorRT-LLM, Dynamo, KServe, Ray Serve).
  • Proven track record of delivering technically complex products that support distributed and high-throughput ML pipelines.
  • Strong communicator with experience working across engineering, research, and customer-facing teams.
  • It will be an added bonus if you have :

  • Deep understanding of modern ML architectures, including transformer-based models and their inference characteristics.
  • Experience delivering or supporting ML solutions in production as part of a customer-facing or solutions role.
  • Knowledge of MLOps or AIOps cycles, including observability, performance optimization, and continuous delivery of ML systems.
  • Key employee benefits in the US :

  • Health insurance :  100% company-paid medical, dental, and vision coverage for employees and families.
  • 401(k) plan :   Up to 4% company match with immediate vesting.
  • Parental leave :  20 weeks paid for primary caregivers, 12 weeks for secondary caregivers.
  • Remote work reimbursement :  Up to $85 / month for mobile and internet.
  • Disability & life insurance : Company-paid short-term, long-term and life insurance coverage.
  • Compensation

    We offer competitive salaries, ranging from $204k - $255k OTE + equity based on your experience

    What we offer

  • Competitive salary and comprehensive benefits package.
  • Opportunities for professional growth within Nebius.
  • Flexible working arrangements.
  • A dynamic and collaborative work environment that values initiative and innovation.
  • We’re growing and expanding our products every day. If you’re up to the challenge and are excited about AI and ML as much as we are, join us!

    Create a job alert for this search

    Senior Technical Product Manager • Remote, Remote, United States

    Related jobs
    • Promoted
    Senior Technical Product Manager

    Senior Technical Product Manager

    OcientRemote, Remote, United States
    Remote
    Full-time
    Senior Technical Product Manager - Performance, Storage, QP.We cannot sponsor or transfer any visas, of any kind, at this time • . Vice President of Product Management.The salary offered for this pos...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Technical Product Manager (Crypto & FX Research SME), US

    Senior Technical Product Manager (Crypto & FX Research SME), US

    Ion GroupRemote, Remote, United States
    Remote
    Full-time
    Lab49 is seeking a Senior Technical Product Manager to lead and shape research initiatives in cryptocurrency and foreign exchange (FX). This role combines deep domain expertise with strong data anal...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Product Manager (f / m / d)

    Senior Product Manager (f / m / d)

    DeepopinionRemote, Remote, United States
    Full-time
    As a Senior Product Manager, you will play a pivotal role in shaping the future of our product.The ideal candidate has worked in dynamic startup environments and is passionate about applying state-...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Product Manager

    Senior Product Manager

    Mission BioRemote, Remote, United States
    Remote
    Full-time
    Based in South San Francisco, Mission Bio is the leader in single cell multi omics solutions for precision medicine.Our mission is to empower researchers and clinicians to eradicate cancer, and our...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Technical Product Manager

    Senior Technical Product Manager

    Scout MotorsUnited States, United States, United States
    Remote
    Full-time
    Here at Scout Motors, we're carrying forward the heritage of one of the most iconic American vehicles in history.One that forged the path for future generations of rugged SUVs and will do so once a...Show moreLast updated: 2 days ago
    • Promoted
    Senior Product Manager

    Senior Product Manager

    Red CanaryRemote, Remote, United States
    Full-time
    Red Canary was founded to create a world where every organization can make its greatest impact without fear of cyber threats. We’re a cyber security company who protects, supports and empowers organ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Product Manager - Core Platform

    Senior Product Manager - Core Platform

    GravieRemote, Remote, United States
    Full-time
    Our mission is to improve the way people purchase and access healthcare through innovative, consumer-centric health benefit solutions that people can actually use. Our industry-changing products and...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Technical Product Manager (Data Products) (United States)

    Principal Technical Product Manager (Data Products) (United States)

    KaratRemote, Remote, United States
    Remote
    Full-time
    Karat is transforming organizations around the world.We provide a powerful system for technical leaders at companies like PayPal, Atlassian, and Citi who want to take control of how they hire top e...Show moreLast updated: 30+ days ago
    • Promoted
    Technical Product Manager

    Technical Product Manager

    Injective LabsRemote, Remote, United States
    Remote
    Full-time
    We are seeking a motivated Technical Product Manager with a strong foundation in finance and hands-on experience working at an exchange (CEX or DEX) to join our Product team.You will work across mu...Show moreLast updated: 30+ days ago
    • Promoted
    Technical Product Manager

    Technical Product Manager

    AktosUnited States, United States, United States
    Full-time
    This role requires someone who thrives at the intersection of.You’ll be responsible for deeply understanding customer workflows, documenting requirements, and collaborating with engineering to tran...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Product Manager

    Senior Product Manager

    ArkestroUnited States, United States, United States
    Full-time
    Arkestro’s Predictive Procurement accelerates enterprise spend transformation, using AI and game theory to unlock trapped savings and reduce risk, enabling teams to influence significantly more spe...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Technical Product Manager - Core Database

    Senior Technical Product Manager - Core Database

    ClickhouseRemote, Remote, United States
    Full-time
    We are the company behind the popular open-source, high performance columnar OLAP database management system for real-time analytics. By offering a true column-based DBMS, it allows for systems to g...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Product Manager

    Senior Product Manager

    Elite TechnologyRemote, Remote, United States
    Remote
    Full-time
    Elite Technology is a leading, independent technology company that helps law firms drive profitability through improved operational effectiveness, increased efficiency, and greater visibility acros...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Product Manager, Platform

    Senior Product Manager, Platform

    AuturaRemote, Remote, United States
    Remote
    Full-time
    At Autura, we’re revolutionizing the towing and recovery industry with cutting-edge software that makes a real difference for our customers. From towing service providers to local governments, our t...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Product Manager - Technical

    Senior Product Manager - Technical

    PaypalRemote, Remote, United States
    Full-time
    PayPal has been revolutionizing commerce globally for more than 25 years.Creating innovative experiences that make moving money, selling, and shopping simple, personalized, and secure, PayPal empow...Show moreLast updated: 30+ days ago
    • Promoted
    Technical Product Manager

    Technical Product Manager

    BlenderboxUnited States, United States, United States
    Full-time
    Blenderbox Product Managers guide and support cross-functional teams of engineers, designers, and researchers toward the production and delivery of quality software products that have an immediate ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Technical Product Manager (Data Products) (United States)

    Senior Technical Product Manager (Data Products) (United States)

    KaratRemote, Remote, United States
    Remote
    Full-time
    Karat is transforming organizations around the world.We provide a powerful system for technical leaders at companies like PayPal, Atlassian, and Citi who want to take control of how they hire top e...Show moreLast updated: 30+ days ago
    • Promoted
    Technical Product Manager

    Technical Product Manager

    Reflex MediaRemote, Remote, United States
    Remote
    Full-time
    CAREER OPPORTUNITY : TECHNICAL PRODUCT MANAGER.As a Technical Product Manager at Reflex Media, you’ll take ownership of the internal tools and systems that support our platform’s operational excelle...Show moreLast updated: 30+ days ago