Talent.com
Lead Software Engineer, AI Runtime Development
Lead Software Engineer, AI Runtime DevelopmentApollo Inc • Seattle, WA, United States
No longer accepting applications
Lead Software Engineer, AI Runtime Development

Lead Software Engineer, AI Runtime Development

Apollo Inc • Seattle, WA, United States
1 day ago
Job type
  • Full-time
Job description

Are you ready to revolutionize agentic AI workflows? We are looking for a Lead Software Engineer to elevate our MCP Server into a powerful, enterprise-grade service, enabling seamless interaction between diverse tools and AI agents. In this role, you will play a crucial part in designing the new MCP Gateway, responsible for efficient request routing, policy enforcement, and establishing a solid foundation for scalable multi-agent systems. Your expertise will drive improvements in scalability, performance, and developer experience, ensuring a robust platform that meets enterprise demands.

About the Team

The Graph DX AI Runtime Team is at the forefront of building and maintaining the MCP Server and Gateway, which serve as the crucial communication backbone between agents and tools. We are dedicated to simplifying the developer experience, enabling efficient workflows, and facilitating reliable interactions. Our primary focus is on speed, security, and seamless integration, allowing teams to concentrate on creating intelligent applications rather than managing complex infrastructure.

Your Responsibilities

  • Scale our enterprise AI / MCP Server and Gateway to support multi-agent workflows across Apollo, including routing, orchestration, and integration.
  • Develop robust server infrastructure ensuring exceptional reliability, performance, and security under high-demand conditions.
  • Build and maintain tools for agent discovery, communication, and coordination.
  • Define effective deployment strategies and runtime optimizations to enhance efficiency and reduce operational overhead.
  • Create frameworks and patterns for seamless multi-agent collaboration and AI-driven orchestration.
  • Integrate observability, logging, and monitoring to gain complete visibility into server and agent operations.
  • Explore AI-enhanced developer workflows to optimize orchestration and agent interactions.
  • Collaborate with internal teams to adapt the MCP Server to meet evolving product and developer needs.

Technical Challenges You Will Address

  • Build and scale the MCP Gateway to ensure reliable agentic workflows across diverse environments.
  • Design and implement high-performance routing infrastructure centered on reliability, scalability, and security.
  • Establish routing patterns and coordination mechanisms that enable timely interaction between agents and tools.
  • Define deployment strategies and runtime optimizations to minimize latency while balancing operational overhead.
  • Explore AI-driven routing strategies to enhance context retrieval and decision-making accuracy.
  • Coordinate with cross-functional teams to ensure smooth integration of the MCP Server and Gateway with Apollo's control plane.
  • Integrate comprehensive observability and monitoring into the routing layer for insights into traffic flows, tool availability, and agent interactions.
  • What We Are Looking For

    Required Skills :

  • Expertise in agent-to-tool orchestration, routing, and coordination within scalable, fault-tolerant systems.
  • Proficiency in Rust programming language.
  • Strong background in distributed systems, server architecture, and high-performance backend development.
  • Proven experience in protocol design, message routing, and server-side orchestration frameworks.
  • Experience in developing and maintaining robust runtime infrastructure for AI-driven workflows.
  • Hands-on proficiency with observability, monitoring, and debugging frameworks in complex systems.
  • Commitment to clean, maintainable code, high reliability, and scalable architecture.
  • Experience in strategic system design, with an eye towards long-term scalability and maintainability.
  • Technical leadership skills, including mentoring junior engineers and promoting engineering best practices.
  • Ability to influence architectural decisions across teams and align engineering efforts with product and business objectives.
  • Demonstrated production ownership experience leading incident response and performance optimization in impactful backend systems.
  • Bonus Skills :

  • Understanding of AI / ML-enabled developer tooling or autonomous system orchestration.
  • Familiarity with cloud-native architectures, containerization, and orchestration frameworks.
  • Track record of performance optimization and cost-efficient scaling of high-throughput distributed systems.
  • Create a job alert for this search

    Lead Software Engineer • Seattle, WA, United States

    Related jobs
    Staff Software Engineer II (AI & Data Platform Engineer)

    Staff Software Engineer II (AI & Data Platform Engineer)

    Visa • Bellevue, WA, United States
    Full-time
    Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more t...Show more
    Last updated: 9 days ago • Promoted
    Lead Software Engineer (AI)

    Lead Software Engineer (AI)

    Reply • Seattle, WA, United States
    Full-time
    Valorem Reply is an award-winning digital transformation firm focused on delivering data-driven enterprise, IT modernization, customer experience, product transformation and digital workplace.Throu...Show more
    Last updated: 30+ days ago • Promoted
    Senior AI Software Engineer

    Senior AI Software Engineer

    Imprint.com • Seattle, WA, United States
    Full-time
    Join us at Imprint as a Senior AI Software Engineer, where your creativity and technical expertise will drive the development of our innovative agent platform. In this role, you will be responsible ...Show more
    Last updated: 1 day ago • Promoted
    Senior AI Software Engineer

    Senior AI Software Engineer

    Anduril Industries • Seattle, Washington, United States
    Full-time
    At Anduril, we’re transforming how knowledge powers innovation.Anduril’s internal AI team is growing rapidly to feed appetite across the company. Anduril makes use of AI tooling to empower our emplo...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer, AI Model serving - Seattle, USA

    Senior Software Engineer, AI Model serving - Seattle, USA

    Speechify • Seattle, Washington, United States
    Full-time
    PLEASE APPLY THROUGH THIS LINK : .The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify’s text-to-speech products to turn whatever ...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer (Technical Leadership) - AI Specialist

    Software Engineer (Technical Leadership) - AI Specialist

    META • Bellevue, WA, United States
    Full-time
    Meta is seeking Researchers and Engineers to join our Generative AI organizations.Candidates will have industry experience working on LLM related topics and the experience to apply relevant AI and ...Show more
    Last updated: 30+ days ago • Promoted
    Senior SDE, Luna Gen AI

    Senior SDE, Luna Gen AI

    Amazon Games • Seattle, WA, United States
    Full-time
    We are seeking a Senior Software Development Engineer to join our Gen AI & Strategic Initiatives team that spans our Amazon Luna business. You will be a critical early member as we drive towards two...Show more
    Last updated: 1 day ago • Promoted
    Senior ML Engineer — Real-Time AI & Information Retrieval

    Senior ML Engineer — Real-Time AI & Information Retrieval

    Apple Inc. • Seattle, WA, United States
    Full-time
    A leading technology company in Seattle, Washington is seeking a Machine Learning Engineer to join their Answers, Knowledge & Information team. The role involves shaping user experiences for product...Show more
    Last updated: 4 days ago • Promoted
    Sr. Software Engineer with AI

    Sr. Software Engineer with AI

    Yantran LLC • Seattle, WA, United States
    Full-time
    Software Engineer with AI Skill Set.Full Stack (C# TypeScript / JavaScript, and Python).Azure OpenAI, and Cognitive Services. Microsoft ecosystem experience.Playwright, JMeter, Postman, and REST API t...Show more
    Last updated: 1 day ago • Promoted
    Sr System Development Engineer, High-Performance Accelerator Servers for AI / ML

    Sr System Development Engineer, High-Performance Accelerator Servers for AI / ML

    Amazon Data Services, Inc. • Seattle, WA, US
    Full-time
    Do you want to shape the future of Generative AI at AWS? Join the team building the foundation of the world’s most advanced cloud for AI training and inference — where multi-billion-par...Show more
    Last updated: 15 hours ago • Promoted • New!
    Sr Engineer, Software AI

    Sr Engineer, Software AI

    T-Mobile USA, Inc. • Bellevue, WA, United States
    Full-time +1
    At T-Mobile, we invest in YOU! Our Total Rewards Package ensures that employees get the same big love we give our customers. All team members receive a competitive base salary and compensation pack...Show more
    Last updated: 30+ days ago • Promoted
    Lead Software Engineer

    Lead Software Engineer

    Relativity • Seattle, WA, United States
    Full-time
    Are you looking to be in a workplace where colleagues inspire one another, working together to build AI software solutions?. We're looking for a Lead Software Engineer to join our Relativity Privacy...Show more
    Last updated: 30+ days ago • Promoted
    Lead Software Engineer, Platform Development

    Lead Software Engineer, Platform Development

    Pryon • Seattle, WA, United States
    Full-time
    Join our talented team of experts in AI, technology, and linguistics, who have significantly contributed to products like Alexa, Siri, and Watson. We are in the process of creating a pioneering know...Show more
    Last updated: 1 day ago • Promoted
    Staff Software Engineer, Full-Stack - Enterprise Gen AI

    Staff Software Engineer, Full-Stack - Enterprise Gen AI

    Scale AI, Inc. • Seattle, WA, United States
    Full-time
    Staff Software Engineer, Full-Stack - Enterprise Gen AI.Scale GP (Scale Generative AI Platform) is an enterprise-grade AI platform providing APIs for knowledge retrieval, inference, evaluation, and...Show more
    Last updated: 17 days ago • Promoted
    Senior Software Engineer - Agentic AI

    Senior Software Engineer - Agentic AI

    Seattle Staffing • Seattle, WA, United States
    Full-time
    At PNNL, our core capabilities are divided among major departments that we refer to as Directorates within the Lab, focused on a specific area of scientific research or other function, with its own...Show more
    Last updated: 1 day ago • Promoted
    Senior Platform Engineer - AI / ML Microservices (Remote)

    Senior Platform Engineer - AI / ML Microservices (Remote)

    Medium • Seattle, WA, United States
    Remote
    Full-time
    A technology company specializing in AI is seeking a Senior Software Engineer to design and develop software components integrated into cloud architectures. Responsibilities include building automat...Show more
    Last updated: 6 days ago • Promoted
    Senior AI Engineer (US)

    Senior AI Engineer (US)

    Rhythms • Bellevue, Washington, United States
    Full-time
    Rhythms is building an AI operating system transforming ordinary teams into extraordinary ones through cutting-edge artificial intelligence. Founded by entrepreneurs behind successful companies like...Show more
    Last updated: 30+ days ago • Promoted
    AI Governance Lead - Remote

    AI Governance Lead - Remote

    Symetra • Bellevue, WA, United States
    Remote
    Full-time
    Symetra has an exciting opportunity to join our team as an.The AI Governance Lead will be responsible for evolving and managing Symetra's framework governing the ethical, transparent, secure, and c...Show more
    Last updated: 9 days ago • Promoted