Talent.com
Software Engineer III/Senior, AI Gateway
Software Engineer III/Senior, AI GatewayNgrok • San Francisco, CA, US
No longer accepting applications
Software Engineer III / Senior, AI Gateway

Software Engineer III / Senior, AI Gateway

Ngrok • San Francisco, CA, US
1 day ago
Job type
  • Permanent
Job description

About ngrok Inc.

At ngrok, we believe that doing networking the right way should also be the easy way. Over the last 10 years, we've given developers and engineers simple interfaces for getting traffic into their apps and APIs without forcing them to deal with legacy proxies, external load balancers, or VPNs, and we're now part of the standard stack for more than 9 million developers at some of the world's top technology brands, like GitHub, Okta, HashiCorp, and Twilio.

Over the last few years, we've completely changed how that interface looks and works to make it easier, more composable, and infinitely flexible. We now give anyone who needs a "front door" to their apps or APIs powerful tools to orchestrate traffic, secure public endpoints, accelerate their services on a global network, observe all traffic passing to / from their network, and much more. The ngrok that millions love and trust has been completely transformed for the better.

The Opportunity

As a Software Engineer on the AI Gateway Team, you'll be shaping the foundation of how developers and enterprises securely connect their applications through ngrok. This role gives you the chance to design and implement distributed systems that enforce policies, manage trust, and deliver advanced endpoint capabilities—all at global scale.

You'll work on challenges that demand both technical depth and creativity : building high-performance distributed systems that route traffic with millisecond precision, securing sensitive workloads, and enabling the next generation of AI-driven applications. Every line of code you ship will directly influence how developers build, secure, and scale their most critical services on ngrok.

This is a remote position for candidates outside of the Bay Area and a hybrid role for candidates within commuting distance to San Francisco. Our Bay Area employees commute to the office on Tuesdays and Wednesdays. At this time, ngrok is unable to provide visa sponsorship for this position. Applicants must be authorized to work in the United States on a permanent, ongoing basis without the need for current or future sponsorship.

What You'll Do

Build and evolve the gateway services that handle traffic routing, policy enforcement.

Implement new traffic policy objects (e.g., secrets, IP rules, mTLS / CA policies) to give customers fine-grained control over their applications.

Extend and optimize endpoint services that provide reliability and observability for developers.

Partner with product, platform, and security teams to ensure traffic management is robust, scalable, and enterprise-ready.

Write clean, high-quality, well-tested code and participate in thoughtful design / code reviews.

Investigate and resolve production issues across distributed systems.

Continuously improve the developer experience—simplifying how teams configure, secure, and scale their traffic.

Contribute to the evolution of shared infrastructure, tools, and libraries across ngrok.

You Are a Good Fit If You…

Have 3+ years of experience writing high-quality production software in Go or languages like Rust, C, Java, or C++.

Understand networking and distributed systems fundamentals (protocols, TLS / mTLS, proxies, load balancers, traffic shaping).

Have experience building AI gateways, reverse proxies, API gateways, or working with AI / ML service traffic.

Are motivated by building scalable, performant systems that developers love to use.

Enjoy working at the intersection of infrastructure, security, and developer tooling / experience.

Value pragmatism—delivering solutions that balance complexity with simplicity and maintainability.

Compensation

Software Engineer III

Tier 1 (SF, LA, Seattle, NYC) : $160,000 – $200,000

Tier 2 (rest of US) : $147,200 – $184,000

Senior Software Engineer

Tier 1 (SF, LA, Seattle, NYC) : $180,000 – $225,000

Tier 2 (rest of US) : $165,600 – $207,000

Job level and actual compensation will be evaluated based on factors including, but not limited to, qualifications objectively assessed during the interview process (including skills and prior relevant experience, potential impact, and scope of role), internal equity with other team members, market data, and specific work location. We provide an attractive mix of salary and equity.

LI-Hybrid

All candidates must be US-based, and legally authorized to work in the United States.

If your experience is close but doesn't fulfill all requirements, please apply. ngrok is on a mission to build a special company. To achieve our goal, we are focused on hiring people with different backgrounds, perspectives, and experiences!

Benefits

Compensation for this role depends on level, but we provide a competitive mix of salary and equity.

We provide a 401(k) with a 100% match up to 3% of your salary and a 50% match up to another 2%.

We provide healthcare, dental, and vision with premiums fully covered on the base plan for employees. Half of premiums are covered for dependents.

We offer unlimited PTO and a culture in which the overwhelming majority of employees take more than four weeks. Your manager is also on the hook for encouraging you to do the same.

J-18808-Ljbffr

Create a job alert for this search

Software Engineer Ai • San Francisco, CA, US

Related jobs
Senior, Software Engineer - AI

Senior, Software Engineer - AI

Walmart • Sunnyvale, CA, United States
Full-time +1
Develop next generation Last Mile Delivery software applications, including very high capacity, guaranteed availability, and mass market usability without compromising quality.Engage in hands on en...Show more
Last updated: 2 days ago • Promoted
Senior Software Engineer II, Agentic AI Platform

Senior Software Engineer II, Agentic AI Platform

Moveworks.ai • Mountain View, CA, United States
Full-time
Are you up for an exciting challenge? Picture yourself scaling and optimizing a cutting-edge Generative AI product that offers instant assistance to enterprise users. Ever wondered how to apply abst...Show more
Last updated: 30+ days ago • Promoted
Senior Software Engineer, AI

Senior Software Engineer, AI

Peregrine • San Francisco, CA, United States
Full-time
Backed by leading investors from Silicon Valley, Peregrine supports public safety agencies across the country — from Los Angeles to Louisville to Atlanta — empowering public servants to improve ope...Show more
Last updated: 30+ days ago • Promoted
Software Engineer, Enterprise AI

Software Engineer, Enterprise AI

Scale AI, Inc. • San Francisco, CA, United States
Full-time
Scale GP (Scale Generative AI Platform) is an enterprise-grade Generative AI platform that provides APIs for knowledge retrieval, inference, evaluation, and more. We are looking for a strong enginee...Show more
Last updated: 30+ days ago • Promoted
Senior Software Engineer, AI Platform

Senior Software Engineer, AI Platform

LinkedIn • Mountain View, CA, United States
Full-time
LinkedIn is the worlds largest professional network, built to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover excit...Show more
Last updated: 30+ days ago • Promoted
Senior Software Engineer - AI Incubator

Senior Software Engineer - AI Incubator

Sprinter Health, Inc. • San Francisco, CA, United States
Full-time
We're looking for a Senior Software Engineer with at least 5 years of experience who wants to make an impact.We want to make a difference in the lives of those falling between the cracks of the cur...Show more
Last updated: 30+ days ago • Promoted
Senior Firmware EngineerSoftware Engineering • Berkeley, CA • Full time • On-site

Senior Firmware EngineerSoftware Engineering • Berkeley, CA • Full time • On-site

Form Energy • Berkeley, CA, United States
Full-time
Are you ready to build America's energy future? Form Energy is an American manufacturing and energy technology company.We're revolutionizing energy storage with cost-effective, multi-day technology...Show more
Last updated: 29 days ago • Promoted
Senior Software Engineer - AI Agent Infrastructure (Healthcare)

Senior Software Engineer - AI Agent Infrastructure (Healthcare)

Honey Health • Santa Clara, CA, United States
Full-time
Honey Health is the all-in-one AI back office for primary and specialty care.Our AI agents autonomously handle core back-office jobs, such as aggregating patients data, processing orders and prescr...Show more
Last updated: 12 days ago • Promoted
Senior Software Engineer, Agentic AI

Senior Software Engineer, Agentic AI

PayPal • San Jose, CA, United States
Full-time
PayPal has been revolutionizing commerce globally for more than 25 years.Creating innovative experiences that make moving money, selling, and shopping simple, personalized, and secure, PayPal empow...Show more
Last updated: 2 days ago • Promoted
Senior AI Software Engineer

Senior AI Software Engineer

Salesforce • Palo Alto, CA, United States
Full-time
To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Salesforce is the #1 AI CRM, where humans with age...Show more
Last updated: 2 days ago • Promoted
Sr Software Engineer - AI

Sr Software Engineer - AI

The Trade Desk • San Francisco, CA, United States
Full-time
The Trade Desk is a global technology company with a mission to create a better, more open internet for everyone through principled, intelligent advertising. Handling over 1 trillion queries per day...Show more
Last updated: 30+ days ago • Promoted
Software Engineer - AI Agent Infrastructure (Healthcare)

Software Engineer - AI Agent Infrastructure (Healthcare)

Honey Health • Fremont, CA, United States
Full-time
Honey Health is the all-in-one AI back office for primary and specialty care.Our AI agents autonomously handle core back-office jobs, such as aggregating patient data, processing orders and prescri...Show more
Last updated: 13 days ago • Promoted
Senior Software Engineer, AI for Quantum

Senior Software Engineer, AI for Quantum

PSI Quantum • Palo Alto, CA, United States
Full-time
Quantum computing holds the promise of humanity's mastery over the natural world, but only if we can build a.PsiQuantum is on a mission to build the first real, useful quantum computers, capable of...Show more
Last updated: 1 day ago • Promoted
Senior Software Engineer, Managed AI

Senior Software Engineer, Managed AI

Crusoe • San Francisco, CA, United States
Full-time
Crusoe is building the World's Favorite AI-first Cloud infrastructure company.We're pioneering vertically integrated, purpose-built AI infrastructure solutions trusted by Fortune 500 companies to p...Show more
Last updated: 30+ days ago • Promoted
Senior Agentic AI Engineer (Cybersecurity)

Senior Agentic AI Engineer (Cybersecurity)

Anomali • Redwood City, CA, United States
Full-time
Anomali is headquartered in Silicon Valley and is the Leading AI-Powered Security Operations Platform that is modernizing security operations. At the center of it is an omnipresent, intelligent, and...Show more
Last updated: 3 hours ago • Promoted • New!
Sr Software Engineer - AI Infrastructure

Sr Software Engineer - AI Infrastructure

Oracle • Santa Clara, CA, United States
Full-time
Oracle Cloud Infrastructure (OCI) is looking for a Senior Software Engineer - AI Infrastructure to lead the development of scalable, resilient, and secure infrastructure systems that underpin the c...Show more
Last updated: 30+ days ago • Promoted
Senior Software Engineer - Agentic AI

Senior Software Engineer - Agentic AI

NVIDIA • Santa Clara, CA, United States
Full-time
NVIDIA has been redefining computer graphics, PC gaming, and accelerated computing for more than 25 years! It's an outstanding legacy of innovation that's fueled by phenomenal technology—and outsta...Show more
Last updated: 30+ days ago • Promoted
AI Senior Software Engineer

AI Senior Software Engineer

General Motors • Mountain View, CA, United States
Full-time
As an AI Software Engineer on the Enterprise AI team, you will play a critical role in shaping GM's future through high-impact AI systems. You will be responsible for developing AI technologies and ...Show more
Last updated: 2 days ago • Promoted