Talent.com
Software Engineer III/Senior, AI Gateway
Software Engineer III/Senior, AI Gatewayalgojobs • San Francisco, CA, United States
Software Engineer III / Senior, AI Gateway

Software Engineer III / Senior, AI Gateway

algojobs • San Francisco, CA, United States
24 days ago
Job type
  • Permanent
Job description

Software Engineer III / Senior, AI Gateway

About ngrok Inc.

At ngrok, we believe that doing networking the right way should also be the easy way. Over the last 10 years, we’ve given developers and engineers simple interfaces for getting traffic into their apps and APIs without forcing them to deal with legacy proxies, external load balancers, or VPNs, and we’re now part of the standard stack for more than 9 million developers at some of the world’s top technology brands, like GitHub, Okta, HashiCorp, and Twilio.

Over the last few years, we’ve completely changed how that interface looks and works to make it easier, more composable, and infinitely flexible. We now give anyone who needs a “front door” to their apps or APIs powerful tools to orchestrate traffic, secure public endpoints, accelerate their services on a global network, observe all traffic passing to / from their network, and much more. The ngrok that millions love and trust has been completely transformed for the better.

The Opportunity

As a Software Engineer on the AI Gateway Team, you’ll be shaping the foundation of how developers and enterprises securely connect their applications through ngrok. This role gives you the chance to design and implement distributed systems that enforce policies, manage trust, and deliver advanced endpoint capabilities—all at global scale.

You’ll work on challenges that demand both technical depth and creativity : building high-performance distributed systems that route traffic with millisecond precision, securing sensitive workloads, and enabling the next generation of AI-driven applications. Every line of code you ship will directly influence how developers build, secure, and scale their most critical services on ngrok.

This is a remote position for candidates outside of the Bay Area and a hybrid role for candidates within commuting distance to San Francisco. Our Bay Area employees commute to the office on Tuesdays and Wednesdays. At this time, ngrok is unable to provide visa sponsorship for this position. Applicants must be authorized to work in the United States on a permanent, ongoing basis without the need for current or future sponsorship.

What You’ll Do

  • Build and evolve the gateway services that handle traffic routing, policy enforcement.
  • Implement new traffic policy objects (e.g., secrets, IP rules, mTLS / CA policies) to give customers fine-grained control over their applications.
  • Extend and optimize endpoint services that provide reliability and observability for developers.
  • Partner with product, platform, and security teams to ensure traffic management is robust, scalable, and enterprise-ready.
  • Write clean, high-quality, well-tested code and participate in thoughtful design / code reviews.
  • Investigate and resolve production issues across distributed systems.
  • Continuously improve the developer experience—simplifying how teams configure, secure, and scale their traffic.
  • Contribute to the evolution of shared infrastructure, tools, and libraries across ngrok.

You Are a Good Fit If You…

  • Have 3+ years of experience writing high-quality production software in Go or languages like Rust, C, Java, or C++.
  • Understand networking and distributed systems fundamentals (protocols, TLS / mTLS, proxies, load balancers, traffic shaping).
  • Have experience building AI gateways, reverse proxies, API gateways, or working with AI / ML service traffic.
  • Are motivated by building scalable, performant systems that developers love to use.
  • Enjoy working at the intersection of infrastructure, security, and developer tooling / experience.
  • Value pragmatism—delivering solutions that balance complexity with simplicity and maintainability.
  • Compensation

    Senior Software Engineer

  • Tier 1 (SF, LA, Seattle, NYC) : $180,000 – $225,000
  • Tier 2 (rest of US) : $165,600 – $207,000
  • Software Engineer III

  • Tier 1 (SF, LA, Seattle, NYC) : $160,000 – $200,000
  • Tier 2 (rest of US) : $147,200 – $184,000
  • Job level and actual compensation will be evaluated based on factors including, but not limited to, qualifications objectively assessed during the interview process (including skills and prior relevant experience, potential impact, and scope of role), internal equity with other team members, market data, and specific work location. We provide an attractive mix of salary and equity.

    #J-18808-Ljbffr

    Create a job alert for this search

    Software Engineer Ai • San Francisco, CA, United States

    Related jobs
    Senior Software Engineer, AI

    Senior Software Engineer, AI

    Sentry • San Francisco, CA, United States
    Full-time
    Bad software is everywhere, and we're tired of it.Sentry is on a mission to help developers write better software faster so we can get back to enjoying technology. With more than $217 million in fun...Show more
    Last updated: 18 days ago • Promoted
    Software Engineer III / Senior, AI Gateway

    Software Engineer III / Senior, AI Gateway

    ngrok Inc. • San Francisco, CA, United States
    Permanent
    Software Engineer III / Senior, AI Gateway.At ngrok, we believe that doing networking the right way should also be the easy way. Over the last 10 years, we’ve provided developers with simple interface...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer, AI

    Senior Software Engineer, AI

    Peregrine • San Francisco, CA, United States
    Full-time
    Backed by leading investors from Silicon Valley, Peregrine supports public safety agencies across the country — from Los Angeles to Louisville to Atlanta — empowering public servants to improve ope...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer II Maps Services

    Senior Software Engineer II Maps Services

    Samsara • San Francisco, California, USA
    Full-time
    Are you interested in building maps for commercial operations across large fleets of thousands of vehicles paving the way for efficient route planning safe transportation while maintaining complian...Show more
    Last updated: 20 days ago • Promoted
    Senior AI Software Engineer

    Senior AI Software Engineer

    Salesforce.Com Inc • San Francisco, CA, United States
    Full-time
    To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Salesforce is the #1 AI CRM, where humans with age...Show more
    Last updated: 18 days ago • Promoted
    Senior Software Engineer - AI Incubator

    Senior Software Engineer - AI Incubator

    Sprinter Health, Inc. • San Francisco, CA, United States
    Full-time
    We're looking for a Senior Software Engineer with at least 5 years of experience who wants to make an impact.We want to make a difference in the lives of those falling between the cracks of the cur...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer - AI

    Senior Software Engineer - AI

    Rippling • San Francisco, CA, United States
    Full-time
    Rippling gives businesses one place to run HR, IT, and Finance.It brings together all of the workforce systems that are normally scattered across a company, like payroll, expenses, benefits, and co...Show more
    Last updated: 18 days ago • Promoted
    Software Engineer II - AI Personalization

    Software Engineer II - AI Personalization

    Hinge Health • San Francisco, CA, United States
    Full-time
    Hinge Health is a digital health company focused on providing innovative, evidence-based solutions for musculoskeletal (MSK) pain. Through a combination of personalized exercise therapy and virtual ...Show more
    Last updated: 18 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    PG Forsta • Emeryville, CA, United States
    Full-time
    PG Forsta is the leading experience measurement, data analytics, and insights provider for complex industries-a status we earned over decades of deep partnership with clients to help them understan...Show more
    Last updated: 29 days ago • Promoted
    Senior Software Engineer (AI)

    Senior Software Engineer (AI)

    Affinity Executive Search • San Francisco, CA, United States
    Full-time
    Our client is building the future of growth marketing.Our mission is simple : companies should pay for outcomes, not tools. To make that real, we've built a vertically integrated software and service...Show more
    Last updated: 17 days ago • Promoted
    Software Engineer III Analytics

    Software Engineer III Analytics

    Guidewire • San Mateo, California, USA
    Full-time +1
    At Guidewire we offer a dynamic work environment that combines excellent career opportunities a rational and meritocratic company culture and high quality software products.Our commitment to innova...Show more
    Last updated: 23 days ago • Promoted
    Senior Software Engineer - AI Agents

    Senior Software Engineer - AI Agents

    FLEETWORKS INC. • San Francisco, CA, United States
    Full-time
    Every year, companies spend over a trillion dollars moving freight across the U.We're building voice agents that transform the chaotic freight booking process into a modern, intelligent marketplace...Show more
    Last updated: 18 days ago • Promoted
    Senior Software Engineer, Managed AI

    Senior Software Engineer, Managed AI

    Crusoe • San Francisco, CA, United States
    Full-time
    Crusoe is building the World’s Favorite AI-first Cloud infrastructure company.We’re pioneering vertically integrated, purpose-built AI infrastructure solutions trusted by Fortune 500 companies to p...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer–Artificial Intelligence (Artificial Intelligence)

    Software Engineer–Artificial Intelligence (Artificial Intelligence)

    Boeing • Berkeley, California, USA
    Full-time +2
    Software EngineerArtificial Intelligence (Artificial Intelligence).The Boeing Company is seeking a.Software Engineer Artificial Intelligence. This position will focus on supporting th.Boeing Defens...Show more
    Last updated: 22 days ago • Promoted
    Senior Software Engineer, AI Infra

    Senior Software Engineer, AI Infra

    Ambient AI • San Francisco, CA, United States
    Full-time
    Build a safer world with us, one incident at a time.AI-powered physical security platform helping the world's leading enterprises reduce risk, improve operational efficiency, and gain critical insi...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer, AI

    Senior Software Engineer, AI

    Peregrine Technologies • San Francisco, CA, United States
    Full-time
    Backed by leading Silicon Valley investors, Peregrine helps the world's most complex organizations solve their hardest problems with unprecedented speed and accuracy. Our AI-enabled platform turns s...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer, Identity Platform

    Senior Software Engineer, Identity Platform

    OpenAI • San Francisco, CA, United States
    Full-time
    Senior Software Engineer, Identity Platform | OpenAI.Senior Software Engineer, Identity Platform.Applied AI Engineering - San Francisco. Apply now (opens in a new window).Our team brings OpenAIs mos...Show more
    Last updated: 30+ days ago • Promoted
    Sr. Software Engineer II, AI Nurture

    Sr. Software Engineer II, AI Nurture

    Apartment List • San Francisco, CA, United States
    Full-time
    Software Engineer II, AI Nurture.At Apartment List, we’re on a mission to help every renter find a home they love at the best value. As the fastest-growing online rental marketplace, we leverage tec...Show more
    Last updated: 9 days ago • Promoted