Talent.com
Lead Software Engineer, AI Runtime Development
Lead Software Engineer, AI Runtime DevelopmentApollo Inc • Charlotte, NC, United States
Lead Software Engineer, AI Runtime Development

Lead Software Engineer, AI Runtime Development

Apollo Inc • Charlotte, NC, United States
1 day ago
Job type
  • Full-time
Job description

Are you ready to revolutionize agentic AI workflows? We are looking for a Lead Software Engineer to elevate our MCP Server into a powerful, enterprise-grade service, enabling seamless interaction between diverse tools and AI agents. In this role, you will play a crucial part in designing the new MCP Gateway, responsible for efficient request routing, policy enforcement, and establishing a solid foundation for scalable multi-agent systems. Your expertise will drive improvements in scalability, performance, and developer experience, ensuring a robust platform that meets enterprise demands.

About the Team

The Graph DX AI Runtime Team is at the forefront of building and maintaining the MCP Server and Gateway, which serve as the crucial communication backbone between agents and tools. We are dedicated to simplifying the developer experience, enabling efficient workflows, and facilitating reliable interactions. Our primary focus is on speed, security, and seamless integration, allowing teams to concentrate on creating intelligent applications rather than managing complex infrastructure.

Your Responsibilities

  • Scale our enterprise AI / MCP Server and Gateway to support multi-agent workflows across Apollo, including routing, orchestration, and integration.
  • Develop robust server infrastructure ensuring exceptional reliability, performance, and security under high-demand conditions.
  • Build and maintain tools for agent discovery, communication, and coordination.
  • Define effective deployment strategies and runtime optimizations to enhance efficiency and reduce operational overhead.
  • Create frameworks and patterns for seamless multi-agent collaboration and AI-driven orchestration.
  • Integrate observability, logging, and monitoring to gain complete visibility into server and agent operations.
  • Explore AI-enhanced developer workflows to optimize orchestration and agent interactions.
  • Collaborate with internal teams to adapt the MCP Server to meet evolving product and developer needs.

Technical Challenges You Will Address

  • Build and scale the MCP Gateway to ensure reliable agentic workflows across diverse environments.
  • Design and implement high-performance routing infrastructure centered on reliability, scalability, and security.
  • Establish routing patterns and coordination mechanisms that enable timely interaction between agents and tools.
  • Define deployment strategies and runtime optimizations to minimize latency while balancing operational overhead.
  • Explore AI-driven routing strategies to enhance context retrieval and decision-making accuracy.
  • Coordinate with cross-functional teams to ensure smooth integration of the MCP Server and Gateway with Apollo's control plane.
  • Integrate comprehensive observability and monitoring into the routing layer for insights into traffic flows, tool availability, and agent interactions.
  • What We Are Looking For

    Required Skills :

  • Expertise in agent-to-tool orchestration, routing, and coordination within scalable, fault-tolerant systems.
  • Proficiency in Rust programming language.
  • Strong background in distributed systems, server architecture, and high-performance backend development.
  • Proven experience in protocol design, message routing, and server-side orchestration frameworks.
  • Experience in developing and maintaining robust runtime infrastructure for AI-driven workflows.
  • Hands-on proficiency with observability, monitoring, and debugging frameworks in complex systems.
  • Commitment to clean, maintainable code, high reliability, and scalable architecture.
  • Experience in strategic system design, with an eye towards long-term scalability and maintainability.
  • Technical leadership skills, including mentoring junior engineers and promoting engineering best practices.
  • Ability to influence architectural decisions across teams and align engineering efforts with product and business objectives.
  • Demonstrated production ownership experience leading incident response and performance optimization in impactful backend systems.
  • Bonus Skills :

  • Understanding of AI / ML-enabled developer tooling or autonomous system orchestration.
  • Familiarity with cloud-native architectures, containerization, and orchestration frameworks.
  • Track record of performance optimization and cost-efficient scaling of high-throughput distributed systems.
  • Create a job alert for this search

    Lead Software Engineer • Charlotte, NC, United States

    Related jobs
    Software Engineer III-Gen AI Inferencing

    Software Engineer III-Gen AI Inferencing

    Bank of America • Charlotte, NC, United States
    Full-time
    Software Engineer III-Gen AI Inferencing.Addison, Texas;Charlotte, North Carolina; Kennesaw, Georgia; Newark, Delaware.To proceed with your application, you must be at least 18 years of age.To proc...Show more
    Last updated: 30+ days ago • Promoted
    AI First Software Engineer - Senior Manager

    AI First Software Engineer - Senior Manager

    PwC • Charlotte, NC, United States
    Full-time
    At PwC, our people in software and product innovation focus on developing cutting-edge software solutions and driving product innovation to meet the evolving needs of clients.These individuals comb...Show more
    Last updated: 2 days ago • Promoted
    AI / Machine Learning Engineer

    AI / Machine Learning Engineer

    Northpoint Search Group • Charlotte, North Carolina, United States
    Full-time
    Artificial Intelligence Engineer.NorthPoint Search Group Charlotte, NC (Hybrid).AI / Machine Learning Engineer -.Fortune 2000 company seeks an experienced. You’ll work across data, engineering, and ...Show more
    Last updated: 24 days ago • Promoted
    Travel MRI Tech - $1814.75 / Week

    Travel MRI Tech - $1814.75 / Week

    AMN Healthcare Allied • Rock Hill, SC, US
    Full-time
    AMN Healthcare Allied is seeking an experienced MRI Tech for an exciting Travel Allied job in Rock Hill, SC.Shift : 10 hr days Start Date : ASAP Duration : 13 weeks Pay : $1814.Job Description & Re...Show more
    Last updated: 26 days ago • Promoted
    Data Engineer (Python / Automation) - Charlotte, NC

    Data Engineer (Python / Automation) - Charlotte, NC

    Digital Technology Solutions • Charlotte, NC, US
    Full-time
    DTS is looking for Data Engineer (Python / Automation) for our direct client position in Charlotte, NC Role Summary The Business Analyst – Automation (SPARK Team) is a technical partner embedded with...Show more
    Last updated: 25 days ago • Promoted
    Lead AI / ML Platform Engineer

    Lead AI / ML Platform Engineer

    NorthPoint Search Group • Charlotte, NC, US
    Full-time
    Quick Apply
    Lead AI / ML Platform Engineer Who : .A seasoned engineering leader with 8+ years of experience in building and operating production-grade AI / ML platforms. You'll architect and evolve a GenAI platform, ...Show more
    Last updated: 30+ days ago
    Travel Speech Language Pathologist (SLP) - $2,066 per week in Troutman, NC

    Travel Speech Language Pathologist (SLP) - $2,066 per week in Troutman, NC

    AlliedTravelCareers • Troutman, NC, US
    Full-time
    AlliedTravelCareers is working with Coast Medical Service to find a qualified Speech Language Pathologist (SLP) in Troutman, North Carolina, 28166!. Coast Medical Service is a nationwide travel nurs...Show more
    Last updated: 30+ days ago • Promoted
    Full-time job opportunity for a GEN AI Architect

    Full-time job opportunity for a GEN AI Architect

    Jconnect Inc • Charlotte, NC, United States
    Full-time
    If you are comfortable with the JD and interested,.I've included the job description (JD) below for you to look over.Worked on Agentic AI Wokrflows. Should be specialized in building & deploying Gen...Show more
    Last updated: 2 days ago • Promoted
    Lead AI / ML Platform Engineer

    Lead AI / ML Platform Engineer

    NorthPoint Search Group Inc • Charlotte, NC, United States
    Full-time
    A seasoned engineering leader with 8+ years of experience in building and operating production-grade AI / ML platforms.You'll architect and evolve a GenAI platform, lead platform strategy, mentor tea...Show more
    Last updated: 1 day ago • Promoted
    Senior AI Software Engineer

    Senior AI Software Engineer

    Webflow • Charlotte, NC, United States
    Full-time +1
    At Webflow, we are on a mission to empower everyone with development superpowers.As the leading innovator of the Website Experience Platform (WXP), we are revolutionizing how teams build, manage, a...Show more
    Last updated: 1 day ago • Promoted
    Responsible AI Leader

    Responsible AI Leader

    First Citizens Bank • Charlotte, NC, US
    Full-time
    This leader will establish and oversee AI governance and oversight methods for the bank by partnering with Business Line Risk Mgmt, Enterprise Risk, Compliance, Model Risk Mgmt, Legal, Audit, Techn...Show more
    Last updated: 30+ days ago • Promoted
    Lead Software Engineer

    Lead Software Engineer

    Relativity • Charlotte, NC, United States
    Full-time
    We are seeking a Lead Software Engineer to join the Retrieval Ingestion Team at Relativity.This role is ideal for an experienced engineer who thrives on designing and operating high throughput inge...Show more
    Last updated: 30+ days ago • Promoted
    Travel Nurse RN - LDRP - Labor Delivery Recovery & Postpartum - $2,020 per week

    Travel Nurse RN - LDRP - Labor Delivery Recovery & Postpartum - $2,020 per week

    Ardor Health Solutions • Statesville, NC, United States
    Full-time
    Ardor Health Solutions is seeking a travel nurse RN LDRP - Labor Delivery Recovery & Postpartum for a travel nursing job in Statesville, North Carolina. Job Description & Requirements.LDRP - Labor D...Show more
    Last updated: 27 days ago • Promoted
    AI & ML Developer Lead

    AI & ML Developer Lead

    Diverse Lynx • Charlotte, NC, United States
    Full-time
    We are seeking an innovative and experienced AI & ML Developer Lead to spearhead our artificial intelligence initiatives. This role involves leading a team of engineers, designing and deploying scal...Show more
    Last updated: 2 days ago • Promoted
    AI Specialist -Software engineer

    AI Specialist -Software engineer

    Strategic Staffing Solutions • Charlotte, NC, United States
    Full-time
    STRATEGIC STAFFING SOLUTIONS (S3) HAS AN OPENING!.Strategic Staffing Solutions is currently looking for an AI specialist for one of its clients!!. Candidates should be willing to work on our W2 ONLY...Show more
    Last updated: 2 days ago • Promoted
    Gen AI Develope, NC

    Gen AI Develope, NC

    Career Mentors, LLC • Charlotte, NC, US
    Full-time
    Charlotte, NC (Local Candidates Preferred).W2 Contract (Minimum 12-Month Validity).The ideal candidate will have hands-on experience with large language models (LLMs), deep learning architectures, ...Show more
    Last updated: 30+ days ago
    Remote M&A Associate - AI Trainer ($50-$60 / hour)

    Remote M&A Associate - AI Trainer ($50-$60 / hour)

    Data Annotation • Rock Hill, South Carolina
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Show more
    Last updated: 21 days ago • Promoted
    NLP Engineer

    NLP Engineer

    Mercor • Charlotte, North Carolina, US
    Part-time
    Mercor is hiring an NLP Engineer on behalf of a leading AI lab.In this role, you’ll build language pipelines for classification, retrieval-augmented generation (RAG), and tokenization.You’ll design...Show more
    Last updated: 4 days ago • Promoted