Talent.com
Lead Software Engineer, AI Runtime Development
Lead Software Engineer, AI Runtime DevelopmentApollo Inc • Seattle, WA, United States
Lead Software Engineer, AI Runtime Development

Lead Software Engineer, AI Runtime Development

Apollo Inc • Seattle, WA, United States
2 days ago
Job type
  • Full-time
Job description

Are you ready to revolutionize agentic AI workflows? We are looking for a Lead Software Engineer to elevate our MCP Server into a powerful, enterprise-grade service, enabling seamless interaction between diverse tools and AI agents. In this role, you will play a crucial part in designing the new MCP Gateway, responsible for efficient request routing, policy enforcement, and establishing a solid foundation for scalable multi-agent systems. Your expertise will drive improvements in scalability, performance, and developer experience, ensuring a robust platform that meets enterprise demands.

About the Team

The Graph DX AI Runtime Team is at the forefront of building and maintaining the MCP Server and Gateway, which serve as the crucial communication backbone between agents and tools. We are dedicated to simplifying the developer experience, enabling efficient workflows, and facilitating reliable interactions. Our primary focus is on speed, security, and seamless integration, allowing teams to concentrate on creating intelligent applications rather than managing complex infrastructure.

Your Responsibilities

  • Scale our enterprise AI / MCP Server and Gateway to support multi-agent workflows across Apollo, including routing, orchestration, and integration.
  • Develop robust server infrastructure ensuring exceptional reliability, performance, and security under high-demand conditions.
  • Build and maintain tools for agent discovery, communication, and coordination.
  • Define effective deployment strategies and runtime optimizations to enhance efficiency and reduce operational overhead.
  • Create frameworks and patterns for seamless multi-agent collaboration and AI-driven orchestration.
  • Integrate observability, logging, and monitoring to gain complete visibility into server and agent operations.
  • Explore AI-enhanced developer workflows to optimize orchestration and agent interactions.
  • Collaborate with internal teams to adapt the MCP Server to meet evolving product and developer needs.

Technical Challenges You Will Address

  • Build and scale the MCP Gateway to ensure reliable agentic workflows across diverse environments.
  • Design and implement high-performance routing infrastructure centered on reliability, scalability, and security.
  • Establish routing patterns and coordination mechanisms that enable timely interaction between agents and tools.
  • Define deployment strategies and runtime optimizations to minimize latency while balancing operational overhead.
  • Explore AI-driven routing strategies to enhance context retrieval and decision-making accuracy.
  • Coordinate with cross-functional teams to ensure smooth integration of the MCP Server and Gateway with Apollo's control plane.
  • Integrate comprehensive observability and monitoring into the routing layer for insights into traffic flows, tool availability, and agent interactions.
  • What We Are Looking For

    Required Skills :

  • Expertise in agent-to-tool orchestration, routing, and coordination within scalable, fault-tolerant systems.
  • Proficiency in Rust programming language.
  • Strong background in distributed systems, server architecture, and high-performance backend development.
  • Proven experience in protocol design, message routing, and server-side orchestration frameworks.
  • Experience in developing and maintaining robust runtime infrastructure for AI-driven workflows.
  • Hands-on proficiency with observability, monitoring, and debugging frameworks in complex systems.
  • Commitment to clean, maintainable code, high reliability, and scalable architecture.
  • Experience in strategic system design, with an eye towards long-term scalability and maintainability.
  • Technical leadership skills, including mentoring junior engineers and promoting engineering best practices.
  • Ability to influence architectural decisions across teams and align engineering efforts with product and business objectives.
  • Demonstrated production ownership experience leading incident response and performance optimization in impactful backend systems.
  • Bonus Skills :

  • Understanding of AI / ML-enabled developer tooling or autonomous system orchestration.
  • Familiarity with cloud-native architectures, containerization, and orchestration frameworks.
  • Track record of performance optimization and cost-efficient scaling of high-throughput distributed systems.
  • Create a job alert for this search

    Lead Software Engineer • Seattle, WA, United States

    Related jobs
    Lead Software Engineer (AI)

    Lead Software Engineer (AI)

    Reply • Seattle, WA, United States
    Full-time
    Valorem Reply is an award-winning digital transformation firm focused on delivering data-driven enterprise, IT modernization, customer experience, product transformation and digital workplace.Throu...Show more
    Last updated: 30+ days ago • Promoted
    Senior AI Software Engineer

    Senior AI Software Engineer

    Imprint.com • Seattle, WA, United States
    Full-time
    Join us at Imprint as a Senior AI Software Engineer, where your creativity and technical expertise will drive the development of our innovative agent platform. In this role, you will be responsible ...Show more
    Last updated: 2 days ago • Promoted
    Senior Software Engineer, AI Model serving - Seattle, USA

    Senior Software Engineer, AI Model serving - Seattle, USA

    Speechify • Seattle, Washington, United States
    Full-time
    PLEASE APPLY THROUGH THIS LINK : .The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify’s text-to-speech products to turn whatever ...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer (Technical Leadership) - AI Specialist

    Software Engineer (Technical Leadership) - AI Specialist

    META • Bellevue, WA, United States
    Full-time
    Meta is seeking Researchers and Engineers to join our Generative AI organizations.Candidates will have industry experience working on LLM related topics and the experience to apply relevant AI and ...Show more
    Last updated: 30+ days ago • Promoted
    Senior SDE, Luna Gen AI

    Senior SDE, Luna Gen AI

    Amazon Games • Seattle, WA, United States
    Full-time
    We are seeking a Senior Software Development Engineer to join our Gen AI & Strategic Initiatives team that spans our Amazon Luna business. You will be a critical early member as we drive towards two...Show more
    Last updated: 2 days ago • Promoted
    Senior AI Engineer — Platform & Agent Automation

    Senior AI Engineer — Platform & Agent Automation

    Imprint • Seattle, Washington, United States
    Full-time
    A financial technology company in San Francisco is seeking an AI Engineer to build and enhance its internal agent platform. The ideal candidate will possess strong programming skills, experience wit...Show more
    Last updated: 3 days ago • Promoted
    Lead Software Engineer - Data Development for AI Applications

    Lead Software Engineer - Data Development for AI Applications

    AT&T • Bothell, WA, United States
    Full-time
    Lead Software Engineer – Data Development for AI applications.At AT&T, we are connecting the world through the latest tech, top-of-the-line communications and the best in entertainment.Our groundbr...Show more
    Last updated: 3 days ago • Promoted
    Senior ML Engineer — Real-Time AI & Information Retrieval

    Senior ML Engineer — Real-Time AI & Information Retrieval

    Apple Inc. • Seattle, WA, United States
    Full-time
    A leading technology company in Seattle, Washington is seeking a Machine Learning Engineer to join their Answers, Knowledge & Information team. The role involves shaping user experiences for product...Show more
    Last updated: 5 days ago • Promoted
    Sr. Software Engineer with AI

    Sr. Software Engineer with AI

    Yantran LLC • Seattle, WA, United States
    Full-time
    Software Engineer with AI Skill Set.Full Stack (C# TypeScript / JavaScript, and Python).Azure OpenAI, and Cognitive Services. Microsoft ecosystem experience.Playwright, JMeter, Postman, and REST API t...Show more
    Last updated: 2 days ago • Promoted
    Sr Engineer, Software AI

    Sr Engineer, Software AI

    T-Mobile USA, Inc. • Bellevue, WA, United States
    Full-time +1
    At T-Mobile, we invest in YOU! Our Total Rewards Package ensures that employees get the same big love we give our customers. All team members receive a competitive base salary and compensation pack...Show more
    Last updated: 30+ days ago • Promoted
    Senior Lead Software Engineer- AI Platform engineer

    Senior Lead Software Engineer- AI Platform engineer

    JPMorgan Chase Bank, N.A. • Seattle, WA, United States
    Full-time
    Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products. As a Senior Lead Software Engineer at JPMorgan Chase within ...Show more
    Last updated: 30+ days ago • Promoted
    Lead Software Engineer, Platform Development

    Lead Software Engineer, Platform Development

    Pryon • Seattle, WA, United States
    Full-time
    Join our talented team of experts in AI, technology, and linguistics, who have significantly contributed to products like Alexa, Siri, and Watson. We are in the process of creating a pioneering know...Show more
    Last updated: 2 days ago • Promoted
    Software Engineer with AI

    Software Engineer with AI

    Tech M USAAvance Consulting • Seattle, WA, United States
    Full-time
    Full Stack (C#, TypeScript / JavaScript, and Python).Azure OpenAl, and Cognitive Services.Microsoft ecosystem experience. Playwright, JMeter, Postman, and REST API testing.Show more
    Last updated: 3 days ago • Promoted
    Senior Rust AI Systems Engineer

    Senior Rust AI Systems Engineer

    Spice AI, Inc. • Seattle, WA, United States
    Full-time
    A technology firm specializing in AI solutions is looking for exceptional engineers to join their team in Seattle, WA.Candidates should have strong experience in Rust or C / C++, and a background in ...Show more
    Last updated: 7 days ago • Promoted
    Senior Software Engineer - Agentic AI

    Senior Software Engineer - Agentic AI

    Seattle Staffing • Seattle, WA, United States
    Full-time
    At PNNL, our core capabilities are divided among major departments that we refer to as Directorates within the Lab, focused on a specific area of scientific research or other function, with its own...Show more
    Last updated: 2 days ago • Promoted
    Senior Platform Engineer - AI / ML Microservices (Remote)

    Senior Platform Engineer - AI / ML Microservices (Remote)

    Medium • Seattle, WA, United States
    Remote
    Full-time
    A technology company specializing in AI is seeking a Senior Software Engineer to design and develop software components integrated into cloud architectures. Responsibilities include building automat...Show more
    Last updated: 7 days ago • Promoted
    Senior Platform Engineer - AI / ML Microservices (Remote)

    Senior Platform Engineer - AI / ML Microservices (Remote)

    Pryon Inc • Seattle, WA, United States
    Remote
    Full-time
    A leading AI technology company is seeking a Senior Software Engineer to design, develop, and implement microservices and software components integrated into cloud architectures.The ideal candidate...Show more
    Last updated: 6 days ago • Promoted
    Staff Software Engineer, Full-Stack - Enterprise Gen AI

    Staff Software Engineer, Full-Stack - Enterprise Gen AI

    Scale AI, Inc. • Seattle, WA, United States
    Full-time
    Staff Software Engineer, Full-Stack - Enterprise Gen AI.Scale GP (Scale Generative AI Platform) is an enterprise-grade AI platform providing APIs for knowledge retrieval, inference, evaluation, and...Show more
    Last updated: 19 days ago • Promoted