Talent.com
Senior Product Manager - Inference Benchmarking

Senior Product Manager - Inference Benchmarking

NVIDIASanta Clara, CA, US
30+ days ago
Job type
  • Full-time
Job description

Product Manager For AI Inference

NVIDIA has become the platform upon which every new AI-powered application is built. From healthcare research applications to autonomous vehicles, or voice-recognition systems, there is a need to simplify and deliver predictability for AI applications and workflows ... and NVIDIA is right in the center of this revolution. Businesses are often challenged with balancing the performance and costs of inference workloads. Token economics need to be matched with performance and user experience. NVIDIA technologies simplify model deployment while optimizing cost and performance for AI inference workloads. The role of this product manager is to work across NVIDIA to build the right kind of benchmarks, products, and tools that can help customers understand true performance & TCO of Inference.

What you will be doing :

  • Serve as a Subject Matter Expert on AI Inference : Maintain a deep understanding of the entire inference stack, including performance, scaling across workloads, and emerging technologies like disaggregated serving, to guide technical and product strategy.
  • Drive Product Strategy through Market and User Insights : Steer product evolution and partnership direction by conducting thorough research on market trends, competitor activities, and customer feedback, translating these insights into actionable development plans and innovative ideas.
  • Lead Partner Collaboration and Project Execution : Actively manage external partnerships by leading project planning, defining specific tasks and deliverables, serving as the primary liaison for communication, and educating partners on product value to ensure alignment and swift issue resolution.
  • Spearhead Cross-Functional Product Introduction : Drive the new product introduction and transition processes by collaborating seamlessly with engineering, design, operations, sales, and marketing teams, ensuring a unified approach from conception to launch.
  • Enhance Product and User Experience : Play a key role in the product development lifecycle by contributing to the ideation, design, and testing of user experiences, ensuring the final product meets and exceeds customer and partner expectations.

What we need to see :

  • BS or MS in Computer Science, Computer Engineering, or a related field (or equivalent experience)
  • 12+ years of product-management experience in enterprise technology.
  • Be a subject matter expert on Inference. Understand different components of the inference stack, how they perform, scale, and correlate to workloads.
  • Ability to articulate trade-offs among latency, throughput, cost, and reliability to both engineering and executive audiences.
  • Strong cross-functional execution : writes clear specs and PRDs, produces GTM collateral, and leads agile processes.
  • Ways to stand out from the crowd :

  • Masters / PhD or expertise in distributed systems or demonstrated experience in Inference.
  • Experience with Inference (within the stack or ecosystem) and integrating with enterprise platforms; deployments at modern data-center scale.
  • We have some of the most forward-thinking and hardworking people in the world working for us and, due to outstanding growth, our elite engineering teams are growing fast. NVIDIA is widely considered to be one of the industry's most desirable employers. NVIDIA is at the center of Deep Learning, Artificial Intelligence, and Autonomous Vehicles. If you're looking for a challenge, thrive in an ambiguous environment and share our passion for technology, we want to hear from you. We are looking for great people to help us accelerate the next wave of artificial intelligence.

    Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 208,000 USD - 327,750 USD. You will also be eligible for equity and benefits.

    Applications for this job will be accepted at least until September 9, 2025. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

    Create a job alert for this search

    Senior Product Manager • Santa Clara, CA, US

    Related jobs
    • Promoted
    Senior Product Manager, Monitoring Imagery

    Senior Product Manager, Monitoring Imagery

    Planet Labs PBCSan Francisco, CA, United States
    Full-time
    We believe in using space to help life on Earth.Planet designs, builds, and operates the largest constellation of imaging satellites in history. This constellation delivers an unprecedented dataset ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Product Manager, Core Product | San Francisco, CA (Hybrid)

    Senior Product Manager, Core Product | San Francisco, CA (Hybrid)

    TDASan Francisco, CA, United States
    Full-time
    Senior Product Manager, Core Product | San Francisco, CA (Hybrid).We’re looking for a Senior Product Manager, Core Product, to lead 0-to-1 product development at a fast-growing Series B startup tha...Show moreLast updated: 3 days ago
    • Promoted
    Senior Product Manager - Inference Benchmarking

    Senior Product Manager - Inference Benchmarking

    NVIDIA CorporationSanta Clara, CA, United States
    Full-time
    From healthcare research applications to autonomous vehicles, or voice-recognition systems, there is a need to simplify and deliver predictability for AI applications and workflows.NVIDIA is right ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Product Manager

    Senior Product Manager

    HockeyStack, Inc.San Francisco, CA, United States
    Full-time
    Applied AI company on a mission to automate sales, marketing, and customer success for B2B companies.We build the most complete and accurate picture of the B2B buyer. We use this data to power appli...Show moreLast updated: 30+ days ago
    • Promoted
    SeniorProduct Manager

    SeniorProduct Manager

    TomoCredit, Inc.San Francisco, CA, United States
    Full-time
    Tomo is hiring! Please review our open positions and apply to the positions that you think you are a good fit for.As seen on TechCrunch, Forbes, and Bloomberg, join one of the fastest growing areas...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Product Manager | Plasmid Sequencing

    Senior Product Manager | Plasmid Sequencing

    Plasmidsaurus Inc.San Francisco, CA, United States
    Full-time
    Plasmidsaurus is on a mission to accelerate new cures and promote a healthier planet by unlocking a new level of productivity for scientists who use DNA tools to bring their ideas to life.Our DNA s...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Product Manager

    Senior Product Manager

    Calyxo, Inc.Pleasanton, CA, United States
    Full-time
    The company was founded in 2016 to address the profound need for improved kidney stone treatment.Kidney stone disease is a common, painful condition that consumes vast amounts of healthcare resourc...Show moreLast updated: 9 days ago
    • Promoted
    Senior Product Marketing Manager

    Senior Product Marketing Manager

    PlenfulHayward, CA, US
    Full-time
    Plenful is on a mission to transform healthcare operations from the inside out.Fresh off our $50M Series B and backed by Bessemer Venture Partners, Notable Capital, TQ Ventures, Susa / Kivu Ventures,...Show moreLast updated: 3 days ago
    • Promoted
    Senior Product Manager

    Senior Product Manager

    AbridgeSan Francisco, CA, United States
    Full-time
    Abridge was founded in 2018 with the mission of powering deeper understanding in healthcare.Our AI-powered platform was purpose-built for medical conversations, improving clinical documentation eff...Show moreLast updated: 10 days ago
    • Promoted
    Senior Product Manager, Ads Measurement and Optimization

    Senior Product Manager, Ads Measurement and Optimization

    TikTokSan Jose, CA, United States
    Full-time
    Senior Product Manager, Ads Measurement and Optimization.Get AI-powered advice on this job and more exclusive features.TikTok's Ads Measurement Product team builds products that help marketers and ...Show moreLast updated: 30+ days ago
    • Promoted
    Product Manager

    Product Manager

    Strativ GroupHayward, CA, United States
    Full-time
    Founding Product Manager – AI4Drug Discovery.Comp : $200k - $250k Base + Variable + Equity.Developing new molecules that are safe, effective, and work well in the human body requires chemists to com...Show moreLast updated: 6 days ago
    • Promoted
    Senior Product Manager

    Senior Product Manager

    QC WarePalo Alto, CA, United States
    Full-time
    In this role, you will lead the strategy and execution of our molecular design platform, empowering customers in the Pharmaceuticals and Chemicals verticals to develop winning molecules faster.This...Show moreLast updated: 2 days ago
    • Promoted
    Senior Product Manager, Measurement & Experimentation, Copilot

    Senior Product Manager, Measurement & Experimentation, Copilot

    MicrosoftMountain View, CA, United States
    Full-time
    This role is part of the Copilot product team, which enables rigorous, data-informed product development across the organization. You’ll be responsible for building the infrastructure and processes ...Show moreLast updated: 2 days ago
    • Promoted
    Senior Product Marketing Manager - Anaplan Intelligence (AI)

    Senior Product Marketing Manager - Anaplan Intelligence (AI)

    AnaplanSan Ramon, CA, United States
    Full-time
    At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their comp...Show moreLast updated: 30+ days ago
    • Promoted
    Product Marketing, Senior Manager, AI & Analytics

    Product Marketing, Senior Manager, AI & Analytics

    Medallia, Inc.Pleasanton, CA, United States
    Full-time
    Medallia is the pioneer and market leader in Experience Management.Our award-winning SaaS platform, Medallia Experience Cloud, leads the market in the management of experiences, insights, and actio...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Product Development Engineer

    Senior Product Development Engineer

    Medical Instrument Development Laboratories, Inc.San Leandro, CA, US
    Full-time
    Product Development Engineer designs and develops Class I & II medical devices for eye surgeries, such as vitrectomy probes. These devices have features down to 2 micrometers that need to be pre...Show moreLast updated: 2 days ago
    • Promoted
    Senior Product Manager

    Senior Product Manager

    Invenia GroupSan Jose, CA, United States
    Full-time
    Are you looking for an exciting new career challenge?.An innovative life sciences company is seeking a Senior Product Manager (Spatial Genomics) to lead its expanding spatial genomics portfolio.Thi...Show moreLast updated: 30+ days ago
    • Promoted
    Product Manager | Fast-Growth AI Health Platform | Marketplace

    Product Manager | Fast-Growth AI Health Platform | Marketplace

    TDAHayward, CA, US
    Full-time
    I'm partnering with one of the most exciting companies at the intersection of AI, healthcare, and consumer tech — a Series B startup that's redefining preventative care through technology and desig...Show moreLast updated: 24 days ago