Talent.com
Software Engineer III / Senior, AI Gateway

Software Engineer III / Senior, AI Gateway

algojobsSan Francisco, CA, United States
5 days ago
Job type
  • Permanent
Job description

Software Engineer III / Senior, AI Gateway

About ngrok Inc.

At ngrok, we believe that doing networking the right way should also be the easy way. Over the last 10 years, we’ve given developers and engineers simple interfaces for getting traffic into their apps and APIs without forcing them to deal with legacy proxies, external load balancers, or VPNs, and we’re now part of the standard stack for more than 9 million developers at some of the world’s top technology brands, like GitHub, Okta, HashiCorp, and Twilio.

Over the last few years, we’ve completely changed how that interface looks and works to make it easier, more composable, and infinitely flexible. We now give anyone who needs a “front door” to their apps or APIs powerful tools to orchestrate traffic, secure public endpoints, accelerate their services on a global network, observe all traffic passing to / from their network, and much more. The ngrok that millions love and trust has been completely transformed for the better.

The Opportunity

As a Software Engineer on the AI Gateway Team, you’ll be shaping the foundation of how developers and enterprises securely connect their applications through ngrok. This role gives you the chance to design and implement distributed systems that enforce policies, manage trust, and deliver advanced endpoint capabilities—all at global scale.

You’ll work on challenges that demand both technical depth and creativity : building high-performance distributed systems that route traffic with millisecond precision, securing sensitive workloads, and enabling the next generation of AI-driven applications. Every line of code you ship will directly influence how developers build, secure, and scale their most critical services on ngrok.

This is a remote position for candidates outside of the Bay Area and a hybrid role for candidates within commuting distance to San Francisco. Our Bay Area employees commute to the office on Tuesdays and Wednesdays. At this time, ngrok is unable to provide visa sponsorship for this position. Applicants must be authorized to work in the United States on a permanent, ongoing basis without the need for current or future sponsorship.

What You’ll Do

  • Build and evolve the gateway services that handle traffic routing, policy enforcement.
  • Implement new traffic policy objects (e.g., secrets, IP rules, mTLS / CA policies) to give customers fine-grained control over their applications.
  • Extend and optimize endpoint services that provide reliability and observability for developers.
  • Partner with product, platform, and security teams to ensure traffic management is robust, scalable, and enterprise-ready.
  • Write clean, high-quality, well-tested code and participate in thoughtful design / code reviews.
  • Investigate and resolve production issues across distributed systems.
  • Continuously improve the developer experience—simplifying how teams configure, secure, and scale their traffic.
  • Contribute to the evolution of shared infrastructure, tools, and libraries across ngrok.

You Are a Good Fit If You…

  • Have 3+ years of experience writing high-quality production software in Go or languages like Rust, C, Java, or C++.
  • Understand networking and distributed systems fundamentals (protocols, TLS / mTLS, proxies, load balancers, traffic shaping).
  • Have experience building AI gateways, reverse proxies, API gateways, or working with AI / ML service traffic.
  • Are motivated by building scalable, performant systems that developers love to use.
  • Enjoy working at the intersection of infrastructure, security, and developer tooling / experience.
  • Value pragmatism—delivering solutions that balance complexity with simplicity and maintainability.
  • Compensation

    Senior Software Engineer

  • Tier 1 (SF, LA, Seattle, NYC) : $180,000 – $225,000
  • Tier 2 (rest of US) : $165,600 – $207,000
  • Software Engineer III

  • Tier 1 (SF, LA, Seattle, NYC) : $160,000 – $200,000
  • Tier 2 (rest of US) : $147,200 – $184,000
  • Job level and actual compensation will be evaluated based on factors including, but not limited to, qualifications objectively assessed during the interview process (including skills and prior relevant experience, potential impact, and scope of role), internal equity with other team members, market data, and specific work location. We provide an attractive mix of salary and equity.

    #J-18808-Ljbffr

    Create a job alert for this search

    Software Engineer Ai • San Francisco, CA, United States

    Related jobs
    • Promoted
    Senior Software Engineer - AI tools

    Senior Software Engineer - AI tools

    AirwallexSan Francisco, CA, United States
    Full-time
    Airwallex is the only unified payments and financial platform for global businesses.Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses ...Show moreLast updated: 30+ days ago
    • Promoted
    AI Engineer

    AI Engineer

    Vagaro IncPleasanton, CA, United States
    Full-time
    Why Vagaro? At Vagaro, we believe in fostering a collaborative and inclusive work environment where every team member can thrive. Our culture is built on innovation, continuous learning, and a passi...Show moreLast updated: 7 days ago
    • Promoted
    Senior Software Engineer, AI

    Senior Software Engineer, AI

    PeregrineSan Francisco, CA, United States
    Full-time
    Backed by leading investors from Silicon Valley, Peregrine supports public safety agencies across the country — from Los Angeles to Louisville to Atlanta — empowering public servants to improve ope...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer, AI Infra

    Senior Software Engineer, AI Infra

    Ambient.aiSan Francisco, CA, United States
    Full-time
    AI-powered physical security platform helping the world’s leading enterprises reduce risk, improve operational efficiency, and gain critical insights. Fortune 500 organizations, rely on Ambient.Our ...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer, AI Infra

    Software Engineer, AI Infra

    ShepherdSan Francisco, CA, United States
    Full-time
    We provide savings on insurance premiums for commercial businesses that are leveraging modern technology on their worksites. While we began with commercial construction, we're expanding into adjacen...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer, Enterprise AI

    Software Engineer, Enterprise AI

    Scale AI, Inc.San Francisco, CA, United States
    Full-time
    Scale GP (Scale Generative AI Platform) is an enterprise-grade Generative AI platform that provides APIs for knowledge retrieval, inference, evaluation, and more. We are looking for a strong enginee...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer - AI Incubator

    Senior Software Engineer - AI Incubator

    Sprinter Health, Inc.San Francisco, CA, United States
    Full-time
    We're looking for a Senior Software Engineer with at least 5 years of experience who wants to make an impact.We want to make a difference in the lives of those falling between the cracks of the cur...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer - AI

    Senior Software Engineer - AI

    RipplingSan Francisco, CA, United States
    Full-time
    Rippling gives businesses one place to run HR, IT, and Finance.It brings together all of the workforce systems that are normally scattered across a company, like payroll, expenses, benefits, and co...Show moreLast updated: 10 days ago
    • Promoted
    Sr Software Engineer - AI

    Sr Software Engineer - AI

    The Trade DeskSan Francisco, CA, United States
    Full-time
    The Trade Desk is a global technology company with a mission to create a better, more open internet for everyone through principled, intelligent advertising. Handling over 1 trillion queries per day...Show moreLast updated: 19 days ago
    • Promoted
    Senior Software Engineer, Identity Platform

    Senior Software Engineer, Identity Platform

    OpenAISan Francisco, CA, United States
    Full-time
    Senior Software Engineer, Identity Platform | OpenAI.Senior Software Engineer, Identity Platform.Applied AI Engineering - San Francisco. Apply now (opens in a new window).Our team brings OpenAI’s mo...Show moreLast updated: 24 days ago
    • Promoted
    Software / API Engineer

    Software / API Engineer

    Lawrence Berkeley LabBerkeley, CA, United States
    Full-time
    The National Energy Research Scientific Computing Center (NERSC) is seeking a versatile Software / API Engineer to join our team building software systems that integrate scientific workflows and su...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer, AI

    Senior Software Engineer, AI

    SentrySan Francisco, CA, United States
    Full-time
    Bad software is everywhere, and we’re tired of it.Sentry is on a mission to help developers write better software faster so we can get back to enjoying technology. With more than $217 million in fun...Show moreLast updated: 8 days ago
    • Promoted
    Senior Software Engineer III, AI / ML, Visual Lanes

    Senior Software Engineer III, AI / ML, Visual Lanes

    Google Inc.Mountain View, CA, United States
    Full-time
    Senior Software Engineer III, AI / ML, Visual Lanes.Google place Mountain View, CA, USA.Bachelor’s degree or equivalent practical experience. AI / ML techniques : Generative AI, Computer Vision, Natural ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer, Managed AI

    Senior Software Engineer, Managed AI

    CrusoeSan Francisco, CA, United States
    Full-time
    Crusoe is building the World’s Favorite AI-first Cloud infrastructure company.We’re pioneering vertically integrated, purpose-built AI infrastructure solutions trusted by Fortune 500 companies to p...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer, Full-Stack - Enterprise Gen AI

    Senior Software Engineer, Full-Stack - Enterprise Gen AI

    Scale AI, Inc.San Francisco, CA, United States
    Full-time
    Senior Software Engineer, Full-Stack - Enterprise Gen AI.Scale GP (Scale Generative AI Platform) is an enterprise-grade AI platform providing APIs for knowledge retrieval, inference, evaluation, an...Show moreLast updated: 30+ days ago
    • Promoted
    Elasticsearch - Principal Software Engineer II - Vector Search

    Elasticsearch - Principal Software Engineer II - Vector Search

    ElasticMountain View, CA, United States
    Full-time
    Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale - unleashing the potential of businesses and people.The Elastic Search AI...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer - AI Agents

    Senior Software Engineer - AI Agents

    FleetWorks Technology, Inc.San Francisco, CA, United States
    Full-time
    Build and optimize autonomous AI agents that negotiate freight rates, book loads, and handle carrier conversations over phone and email. Own end-to-end feature development, working directly with a h...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer, AI

    Software Engineer, AI

    MonographSan Francisco, CA, United States
    Full-time
    Ambrook's mission is to make sustainability profitable for family-run businesses.In the face of historic heat waves, drought, flooding, supply chain disruptions, water shortages, and pollution, cli...Show moreLast updated: 30+ days ago