Talent.com
Principal Cloud Backend Engineer
Principal Cloud Backend EngineerSambanova Systems • Palo Alto, California, United States
Principal Cloud Backend Engineer

Principal Cloud Backend Engineer

Sambanova Systems • Palo Alto, California, United States
3 days ago
Job type
  • Full-time
Job description

The era of pervasive AI has arrived. In this era, organizations will use generative AI to unlock hidden value in their data, accelerate processes, reduce costs, drive efficiency and innovation to fundamentally transform their businesses and operations at scale.

About The Role

We are seeking a highly skilled and experienced Principal or Senior Principal Cloud Backend Engineer to architect and build the core platform that powers our large-scale AI inference services, with a critical focus on enabling flexible billing and monetization strategies. You will own the design and implementation of the systems that not only ensure reliability and scalability but also directly unlock new revenue streams and business models for our AI services.

This is a high-impact role where you will solve complex challenges at the intersection of cloud-native AI infrastructure, metering, and monetization. You will build the foundational systems for usage-based pricing, subscription plans, and dynamic entitlements that serve as the economic engine for our business. If you are passionate about building platforms that are both technically robust and commercially critical, we want to hear from you.

Key Responsibilities

  • Platform Architecture & Strategy : Lead the technical vision and architecture for our inference serving and monetization platform. Design systems that are fault-tolerant, highly available, and can scale to meet growing demand while accurately tracking usage for billing.
  • Monetization Platform Design : Architect the core systems for flexible monetization, including :
  • Entitlements & Quota Management : Designing a flexible system to define and enforce complex usage plans, rate limits, and access policies.
  • Usage Metering & Aggregation : Building a highly reliable and accurate system to meter usage (e.g., tokens, requests) at scale and prepare data for billing.
  • Billing Integration : Designing clean abstractions and APIs to seamlessly integrate with external billing and payment providers (e.g., Stripe, Metronome).
  • Distributed Systems Design : Architect and implement complex distributed systems involving real-time rate limiting, quota enforcement, and fair-share scheduling for a multi-tenant environment.
  • Performance & Cost Optimization : Identify and eliminate bottlenecks in the end-to-end system, ensuring low-latency request handling while maintaining precise financial accuracy.
  • Technical Leadership : Serve as a technical leader and mentor. Establish best practices in code quality, testing, and observability for business-critical financial data pipelines.
  • Cross-Functional Collaboration : Work closely with Product Management, Finance, and GTM teams to translate business requirements for new pricing models (e.g., subscriptions, pay-as-you-go, custom enterprise plans) into scalable technical solutions.

Required Qualifications (Senior Principal Level)

  • 10 + years of experience in software engineering, with a significant focus on designing and building large-scale, distributed backend systems in cloud environments.
  • 5 + years in a Principal or Lead Engineer role, with a proven track record of architecting, delivering, and operating business-critical platforms.
  • Expert proficiency in one or more of the following : Go, Rust and C++. Deep understanding of concurrency, performance optimization, and systems programming.
  • Deep, hands-on experience with cloud-native technologies (Kubernetes, Docker, etc.) and major cloud providers (AWS, GCP, Azure).
  • Extensive experience with both SQL and NoSQL databases (e.g., PostgreSQL, Redis) and designing data models for high-throughput, low-latency applications.
  • Strong foundation in API design (REST, gRPC), event-driven architecture, and building resilient microservices.
  • Excellent communication and leadership skills, with the ability to drive technical consensus and articulate complex concepts to a diverse audience.
  • Preferred Qualifications

  • Direct Monetization / Billing Experience : Proven experience building or significantly extending platforms for usage-based metering, subscription management, entitlements, or billing systems. Experience with billing providers (e.g., Stripe,Metronome) is a strong plus.
  • Experience in AI / ML Infrastructure : Direct experience building or operating platforms for serving, scaling, and managing AI models (e.g., inference servers, model deployment pipelines).
  • What You'll Work On

    As a key leader on our team, you will be at the forefront of building the economic backbone of our inference platform. Your work will directly impact our ability to :

  • Launch New Business Models : Enable product-led growth through self-service plans, automatic upgrades, pay-as-you-go pricing, and custom enterprise agreements.
  • Monetize Efficiently : Create a flexible platform that allows our business to experiment with and deploy new pricing strategies rapidly without complex engineering changes.
  • Ensure Financial Accuracy : Build robust, auditable systems for metering usage and generating billing events with high reliability.
  • Scale Economically : Design systems that dynamically manage resources and costs, tying infrastructure efficiency directly to business metrics.
  • You will be solving challenging problems at the intersection of distributed systems, cloud infrastructure, and commercial strategy, making our monetization platform a key competitive advantage.

    How to Apply

    Please submit your resume along with a cover letter. In your cover letter, we encourage you to describe your experience with a large-scale system you've architected, particularly any involving billing, entitlements, or monetization. Highlight the challenges you faced in ensuring scalability, reliability, and accuracy, and how you overcame them.

    Submission Guidelines

    Please note that in order to be considered an applicant for any position at SambaNova Systems, you must submit an application form for each position for which you believe you are qualified.

    EEO Policy

    SambaNova Systems is an Equal Opportunity / Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard basis of age (40 and over), color, disability, gender identity, genetic information, marital status, military or veteran status, national origin / ancestry, race, religion, creed, sex (including pregnancy, childbirth, breastfeeding), sexual orientation, and any other applicable status protected by federal, state, or local laws.

    Benefits Summary for US-Based, Full-Time Employment Positions

    SambaNova offers a competitive total rewards package, including the base salary, plus equity and benefits. We cover 95% premium coverage for employee medical insurance, and 77% premium coverage for dependents and offer a Health Savings Account (HSA) with employer contribution. We also offer Dental, Vision, Short / Long term Disability, Basic Life, Voluntary Life, and AD&D insurance plans in addition to Flexible Spending Account (FSA) options like Health Care, Limited Purpose, and Dependent Care. Our library of well-being benefits available to you and your dependents includes a full subscription to Headspace, Gympass+ membership with access to physical gyms, One Medical membership, counseling services with an Employee Assistance Program, and much more.

    Create a job alert for this search

    Principal Engineer Cloud • Palo Alto, California, United States

    Related jobs
    Staff Cloud Backend Engineer

    Staff Cloud Backend Engineer

    Coupand • Mountain View, California, United States
    Full-time
    We know we’re doing the right thing when we hear our customers say, "How did we ever live without Coupang?" Born out of an obsession to make shopping, eating, and living easier than ever, we’re col...Show more
    Last updated: 30+ days ago • Promoted
    Principal Java Cloud Platform Engineer w / DevOps - US Citizenship

    Principal Java Cloud Platform Engineer w / DevOps - US Citizenship

    Oracle • Pleasanton, CA, United States
    Full-time
    We are looking for Principal Java Cloud Platform Engineer who is passionate and creative about building complex architectures to join our Cloud Service Engineering Infrastructure team.You will have...Show more
    Last updated: 8 days ago • Promoted
    Cloud Engineer (Cloud-based Third-Party Integrations)

    Cloud Engineer (Cloud-based Third-Party Integrations)

    Cynet Systems • San Jose, CA, United States
    Full-time
    Backend and cloud development experience within connected vehicle or embedded systems.Cloud and API integration expertise. Strong experience with RESTful and / or GraphQL APIs.Knowledge of authenticat...Show more
    Last updated: 17 days ago • Promoted
    Principal Software Engineer

    Principal Software Engineer

    Supermicro • San Jose, CA, United States
    Full-time
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Show more
    Last updated: 30+ days ago • Promoted
    Senior / Staff Backend Engineer - Mountain View, CA

    Senior / Staff Backend Engineer - Mountain View, CA

    Cloudkitchens • Mountain View, California, United States
    Full-time
    At City Storage Systems, we're building Infrastructure for Better Food.We help restaurateurs around the world succeed in online food delivery. Our goal is to make food more affordable, higher qualit...Show more
    Last updated: 30+ days ago • Promoted
    Senior / Staff Backend Engineer - Mountain View, CA

    Senior / Staff Backend Engineer - Mountain View, CA

    City Storage Systems • Mountain View, California, United States
    Full-time
    At City Storage Systems, we're building Infrastructure for Better Food.We help restaurateurs around the world succeed in online food delivery. Our goal is to make food more affordable, higher qualit...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Engineer

    Cloud Engineer

    Bayone • San Jose, CA, United States
    Full-time
    The successful applicant will be performing work on US Government project for this role, and therefore, US citizenship is required. This position may also perform work that the U.Responsibilities in...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Engineer

    Cloud Engineer

    Zone IT Solutions • San Jose, CA, United States
    Full-time
    We are looking for a Cloud Engineer, where you will be a key player in shaping our cloud strategy and enhancing the services we provide to our clients. In this role, you will design, implement, and ...Show more
    Last updated: 22 days ago • Promoted
    Principal Software Engineer Operational Databases

    Principal Software Engineer Operational Databases

    Cloudera • Santa Clara, CA, United States
    Full-time
    At Cloudera, we empower people to transform complex data into clear and actionable insights.With as much data under management as the hyperscalers, we're the preferred data partner for the top comp...Show more
    Last updated: 26 days ago • Promoted
    Principal Software Engineer II - Elasticsearch - Query Engine, Database Internals

    Principal Software Engineer II - Elasticsearch - Query Engine, Database Internals

    Elastic • Mountain View, CA, United States
    Full-time
    Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale - unleashing the potential of businesses and people.The Elastic Search AI...Show more
    Last updated: 30+ days ago • Promoted
    Senior Full Stack Engineer - Cloud-Native Observability Platform

    Senior Full Stack Engineer - Cloud-Native Observability Platform

    Cisco Systems, Inc. • Milpitas, CA, United States
    Full-time
    Senior Full Stack Engineer - Cloud-Native Observability Platform.We are the Catalyst Center Platforms and Capabilities team, responsible for delivering scalable, secure, and high-productivity cloud...Show more
    Last updated: 8 days ago • Promoted
    Principal Software Engineer ( Core Banking Systems)

    Principal Software Engineer ( Core Banking Systems)

    First Citizens Bank • Santa Clara, CA, US
    Full-time
    This is a hybrid role, with the expectation that time working will regularly take place inside and outside of a company office. This position provides expert technical guidance on large, complex, an...Show more
    Last updated: 30+ days ago • Promoted
    Backend Engineer - Infrastructure

    Backend Engineer - Infrastructure

    Intellipro Group • Palo Alto, California, United States
    Full-time +1
    LiveX AI is on a mission to transform how companies engage with customers—before, during, and after the sale—through the power of AI. Backend Engineer - Infrastructure.We’re looking for a hands-on e...Show more
    Last updated: 30+ days ago • Promoted
    Staff Backend Engineer, City Storage Systems - Mountain View

    Staff Backend Engineer, City Storage Systems - Mountain View

    City Storage Systems • Mountain View, California, United States
    Full-time
    At City Storage Systems, we're building Infrastructure for Better Food.We help restaurateurs around the world succeed in online food delivery. Our goal is to make food more affordable, higher qualit...Show more
    Last updated: 30+ days ago • Promoted
    Staff Cloud Backend Engineer

    Staff Cloud Backend Engineer

    Sonatus • Sunnyvale, California, United States
    Full-time
    Join a high-performing team at Sonatus that’s redefining what cars can do in the era of Software-Defined Vehicles (SDV).At Sonatus, we’re driving the transformation to AI-enabled software-defined v...Show more
    Last updated: 30+ days ago • Promoted
    Principal Platform Engineer : Kubernetes, CI / CD & Scale

    Principal Platform Engineer : Kubernetes, CI / CD & Scale

    Expedia, Inc. • San Jose, CA, United States
    Full-time
    A leading travel technology company in San Jose seeks a Principal Software Development Engineer to lead the architecture of a Kubernetes platform. The ideal candidate will have over 8 years of exper...Show more
    Last updated: 8 days ago • Promoted
    Principal Engineer, Cloud Software

    Principal Engineer, Cloud Software

    Tarana Wireless, Inc. • Milpitas, CA, US
    Full-time
    Quick Apply
    Join the Team That's Redefining Wireless Technology At Tarana , we're more than just a fast-growing tech company—we’re a team of bold innovators on a mission to revolutionize broa...Show more
    Last updated: 30+ days ago
    Principal Engineer Software - Cortex Cloud

    Principal Engineer Software - Cortex Cloud

    Palo Alto Networks • Santa Clara, California, United States
    Full-time
    At Palo Alto Networks® everything starts and ends with our mission : .Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and m...Show more
    Last updated: 10 days ago • Promoted