Talent.com
Lead Software Engineer, AI Runtime Development
Lead Software Engineer, AI Runtime DevelopmentApollo Inc • Seattle, WA, United States
Lead Software Engineer, AI Runtime Development

Lead Software Engineer, AI Runtime Development

Apollo Inc • Seattle, WA, United States
2 days ago
Job type
  • Full-time
Job description

Are you ready to revolutionize agentic AI workflows? We are looking for a Lead Software Engineer to elevate our MCP Server into a powerful, enterprise-grade service, enabling seamless interaction between diverse tools and AI agents. In this role, you will play a crucial part in designing the new MCP Gateway, responsible for efficient request routing, policy enforcement, and establishing a solid foundation for scalable multi-agent systems. Your expertise will drive improvements in scalability, performance, and developer experience, ensuring a robust platform that meets enterprise demands.

About the Team

The Graph DX AI Runtime Team is at the forefront of building and maintaining the MCP Server and Gateway, which serve as the crucial communication backbone between agents and tools. We are dedicated to simplifying the developer experience, enabling efficient workflows, and facilitating reliable interactions. Our primary focus is on speed, security, and seamless integration, allowing teams to concentrate on creating intelligent applications rather than managing complex infrastructure.

Your Responsibilities

  • Scale our enterprise AI / MCP Server and Gateway to support multi-agent workflows across Apollo, including routing, orchestration, and integration.
  • Develop robust server infrastructure ensuring exceptional reliability, performance, and security under high-demand conditions.
  • Build and maintain tools for agent discovery, communication, and coordination.
  • Define effective deployment strategies and runtime optimizations to enhance efficiency and reduce operational overhead.
  • Create frameworks and patterns for seamless multi-agent collaboration and AI-driven orchestration.
  • Integrate observability, logging, and monitoring to gain complete visibility into server and agent operations.
  • Explore AI-enhanced developer workflows to optimize orchestration and agent interactions.
  • Collaborate with internal teams to adapt the MCP Server to meet evolving product and developer needs.

Technical Challenges You Will Address

  • Build and scale the MCP Gateway to ensure reliable agentic workflows across diverse environments.
  • Design and implement high-performance routing infrastructure centered on reliability, scalability, and security.
  • Establish routing patterns and coordination mechanisms that enable timely interaction between agents and tools.
  • Define deployment strategies and runtime optimizations to minimize latency while balancing operational overhead.
  • Explore AI-driven routing strategies to enhance context retrieval and decision-making accuracy.
  • Coordinate with cross-functional teams to ensure smooth integration of the MCP Server and Gateway with Apollo's control plane.
  • Integrate comprehensive observability and monitoring into the routing layer for insights into traffic flows, tool availability, and agent interactions.
  • What We Are Looking For

    Required Skills :

  • Expertise in agent-to-tool orchestration, routing, and coordination within scalable, fault-tolerant systems.
  • Proficiency in Rust programming language.
  • Strong background in distributed systems, server architecture, and high-performance backend development.
  • Proven experience in protocol design, message routing, and server-side orchestration frameworks.
  • Experience in developing and maintaining robust runtime infrastructure for AI-driven workflows.
  • Hands-on proficiency with observability, monitoring, and debugging frameworks in complex systems.
  • Commitment to clean, maintainable code, high reliability, and scalable architecture.
  • Experience in strategic system design, with an eye towards long-term scalability and maintainability.
  • Technical leadership skills, including mentoring junior engineers and promoting engineering best practices.
  • Ability to influence architectural decisions across teams and align engineering efforts with product and business objectives.
  • Demonstrated production ownership experience leading incident response and performance optimization in impactful backend systems.
  • Bonus Skills :

  • Understanding of AI / ML-enabled developer tooling or autonomous system orchestration.
  • Familiarity with cloud-native architectures, containerization, and orchestration frameworks.
  • Track record of performance optimization and cost-efficient scaling of high-throughput distributed systems.
  • Create a job alert for this search

    Lead Software Engineer • Seattle, WA, United States

    Related jobs
    Lead Software Engineer (AI)

    Lead Software Engineer (AI)

    Reply • Seattle, WA, United States
    Full-time
    Valorem Reply is an award-winning digital transformation firm focused on delivering data-driven enterprise, IT modernization, customer experience, product transformation and digital workplace.Throu...Show more
    Last updated: 30+ days ago • Promoted
    Senior AI Software Engineer

    Senior AI Software Engineer

    Imprint.com • Seattle, WA, United States
    Full-time
    Join us at Imprint as a Senior AI Software Engineer, where your creativity and technical expertise will drive the development of our innovative agent platform. In this role, you will be responsible ...Show more
    Last updated: 2 days ago • Promoted
    Staff Software Engineer II (AI Platform Engineer)

    Staff Software Engineer II (AI Platform Engineer)

    Visa • Bellevue, WA, United States
    Full-time
    Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more t...Show more
    Last updated: 2 hours ago • Promoted • New!
    Software Engineer (Technical Leadership) - AI Specialist

    Software Engineer (Technical Leadership) - AI Specialist

    META • Bellevue, WA, United States
    Full-time
    Meta is seeking Researchers and Engineers to join our Generative AI organizations.Candidates will have industry experience working on LLM related topics and the experience to apply relevant AI and ...Show more
    Last updated: 30+ days ago • Promoted
    Senior SDE, Luna Gen AI

    Senior SDE, Luna Gen AI

    Amazon Games • Seattle, WA, United States
    Full-time
    We are seeking a Senior Software Development Engineer to join our Gen AI & Strategic Initiatives team that spans our Amazon Luna business. You will be a critical early member as we drive towards two...Show more
    Last updated: 2 days ago • Promoted
    Lead Software Engineer - Data Development for AI Applications

    Lead Software Engineer - Data Development for AI Applications

    AT&T • Bothell, WA, United States
    Full-time
    Lead Software Engineer – Data Development for AI applications.At AT&T, we are connecting the world through the latest tech, top-of-the-line communications and the best in entertainment.Our groundbr...Show more
    Last updated: 3 days ago • Promoted
    Sr Engineer, Software AI

    Sr Engineer, Software AI

    T-Mobile USA, Inc. • Bellevue, WA, United States
    Full-time +1
    At T-Mobile, we invest in YOU! Our Total Rewards Package ensures that employees get the same big love we give our customers. All team members receive a competitive base salary and compensation pack...Show more
    Last updated: 30+ days ago • Promoted
    Lead Software Engineer

    Lead Software Engineer

    Relativity • Seattle, WA, United States
    Full-time
    Are you looking to be in a workplace where colleagues inspire one another, working together to build AI software solutions?. We're looking for a Lead Software Engineer to join our Relativity Privacy...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer- AI / ML, AWS Neuron Distributed Training

    Software Engineer- AI / ML, AWS Neuron Distributed Training

    Amazon • Seattle, WA, United States
    Full-time
    Annapurna Labs designs silicon and software that accelerates innovation.Customers choose us to create cloud solutions that solve challenges that were unimaginable a short time ago-even yesterday.Ou...Show more
    Last updated: 30+ days ago • Promoted
    Lead Software Engineer, Platform Development

    Lead Software Engineer, Platform Development

    Pryon • Seattle, WA, United States
    Full-time
    Join our talented team of experts in AI, technology, and linguistics, who have significantly contributed to products like Alexa, Siri, and Watson. We are in the process of creating a pioneering know...Show more
    Last updated: 2 days ago • Promoted
    Staff Software Engineer, Full-Stack - Enterprise Gen AI

    Staff Software Engineer, Full-Stack - Enterprise Gen AI

    Scale AI, Inc. • Seattle, WA, United States
    Full-time
    Staff Software Engineer, Full-Stack - Enterprise Gen AI.Scale GP (Scale Generative AI Platform) is an enterprise-grade AI platform providing APIs for knowledge retrieval, inference, evaluation, and...Show more
    Last updated: 18 days ago • Promoted
    Senior Software Applied AI Engineer

    Senior Software Applied AI Engineer

    hackerone • Seattle, WA, United States
    Full-time
    HackerOne is a global leader in Continuous Threat Exposure Management (CTEM).The HackerOne Platform unites agentic AI solutions with the ingenuity of the world's largest community of security resea...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer - Agentic AI

    Senior Software Engineer - Agentic AI

    Seattle Staffing • Seattle, WA, United States
    Full-time
    At PNNL, our core capabilities are divided among major departments that we refer to as Directorates within the Lab, focused on a specific area of scientific research or other function, with its own...Show more
    Last updated: 2 days ago • Promoted
    Software Engineer- AI / ML, AWS Neuron

    Software Engineer- AI / ML, AWS Neuron

    Amazon • Seattle, WA, United States
    Full-time
    AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine.Trn1 and Inf1 servers that use them. This role is for a software engineer in the Machine Learning Ap...Show more
    Last updated: 30+ days ago • Promoted
    Sr. Software Engineer- AI / ML, AWS Neuron Distributed Training - Performance Optimization

    Sr. Software Engineer- AI / ML, AWS Neuron Distributed Training - Performance Optimization

    Amazon • Seattle, WA, United States
    Full-time
    AWS Utility Computing (UC) provides product innovations that continue to set AWS's services and features apart in the industry. As a member of the UC organization, you'll support the development and...Show more
    Last updated: 30+ days ago • Promoted
    Senior AI / ML Engineer – Remote

    Senior AI / ML Engineer – Remote

    UnitedHealth Group • Seattle, Washington, US
    Remote
    Full-time
    Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives.The work you do with our team will directly improve health outcomes by connect...Show more
    Last updated: 8 days ago • Promoted
    AI Governance Lead - Remote

    AI Governance Lead - Remote

    Symetra • Bellevue, WA, United States
    Remote
    Full-time
    Symetra has an exciting opportunity to join our team as an.The AI Governance Lead will be responsible for evolving and managing Symetra's framework governing the ethical, transparent, secure, and c...Show more
    Last updated: 9 days ago • Promoted
    Senior Software Engineer, AI Model serving - Seattle, USA

    Senior Software Engineer, AI Model serving - Seattle, USA

    Speechify • Seattle, WA, United States
    Full-time
    PLEASE APPLY THROUGH THIS LINK : .The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify's text-to-speech products to turn whatever ...Show more
    Last updated: 30+ days ago • Promoted