Talent.com
Lead Software Engineer, AI Runtime Development

Lead Software Engineer, AI Runtime Development

Apollo IncCharlotte, NC, United States
2 days ago
Job type
  • Full-time
Job description

Are you ready to revolutionize agentic AI workflows? We are looking for a Lead Software Engineer to elevate our MCP Server into a powerful, enterprise-grade service, enabling seamless interaction between diverse tools and AI agents. In this role, you will play a crucial part in designing the new MCP Gateway, responsible for efficient request routing, policy enforcement, and establishing a solid foundation for scalable multi-agent systems. Your expertise will drive improvements in scalability, performance, and developer experience, ensuring a robust platform that meets enterprise demands.

About the Team

The Graph DX AI Runtime Team is at the forefront of building and maintaining the MCP Server and Gateway, which serve as the crucial communication backbone between agents and tools. We are dedicated to simplifying the developer experience, enabling efficient workflows, and facilitating reliable interactions. Our primary focus is on speed, security, and seamless integration, allowing teams to concentrate on creating intelligent applications rather than managing complex infrastructure.

Your Responsibilities

  • Scale our enterprise AI / MCP Server and Gateway to support multi-agent workflows across Apollo, including routing, orchestration, and integration.
  • Develop robust server infrastructure ensuring exceptional reliability, performance, and security under high-demand conditions.
  • Build and maintain tools for agent discovery, communication, and coordination.
  • Define effective deployment strategies and runtime optimizations to enhance efficiency and reduce operational overhead.
  • Create frameworks and patterns for seamless multi-agent collaboration and AI-driven orchestration.
  • Integrate observability, logging, and monitoring to gain complete visibility into server and agent operations.
  • Explore AI-enhanced developer workflows to optimize orchestration and agent interactions.
  • Collaborate with internal teams to adapt the MCP Server to meet evolving product and developer needs.

Technical Challenges You Will Address

  • Build and scale the MCP Gateway to ensure reliable agentic workflows across diverse environments.
  • Design and implement high-performance routing infrastructure centered on reliability, scalability, and security.
  • Establish routing patterns and coordination mechanisms that enable timely interaction between agents and tools.
  • Define deployment strategies and runtime optimizations to minimize latency while balancing operational overhead.
  • Explore AI-driven routing strategies to enhance context retrieval and decision-making accuracy.
  • Coordinate with cross-functional teams to ensure smooth integration of the MCP Server and Gateway with Apollo's control plane.
  • Integrate comprehensive observability and monitoring into the routing layer for insights into traffic flows, tool availability, and agent interactions.
  • What We Are Looking For

    Required Skills :

  • Expertise in agent-to-tool orchestration, routing, and coordination within scalable, fault-tolerant systems.
  • Proficiency in Rust programming language.
  • Strong background in distributed systems, server architecture, and high-performance backend development.
  • Proven experience in protocol design, message routing, and server-side orchestration frameworks.
  • Experience in developing and maintaining robust runtime infrastructure for AI-driven workflows.
  • Hands-on proficiency with observability, monitoring, and debugging frameworks in complex systems.
  • Commitment to clean, maintainable code, high reliability, and scalable architecture.
  • Experience in strategic system design, with an eye towards long-term scalability and maintainability.
  • Technical leadership skills, including mentoring junior engineers and promoting engineering best practices.
  • Ability to influence architectural decisions across teams and align engineering efforts with product and business objectives.
  • Demonstrated production ownership experience leading incident response and performance optimization in impactful backend systems.
  • Bonus Skills :

  • Understanding of AI / ML-enabled developer tooling or autonomous system orchestration.
  • Familiarity with cloud-native architectures, containerization, and orchestration frameworks.
  • Track record of performance optimization and cost-efficient scaling of high-throughput distributed systems.
  • Create a job alert for this search

    Lead Software Engineer • Charlotte, NC, United States

    Related jobs
    • Promoted
    • New!
    Financial Expert - AI Trainer ($150 per hour)

    Financial Expert - AI Trainer ($150 per hour)

    MercorRock Hill, South Carolina, US
    Remote
    Full-time
    UK / Canada / Europe / Singapore / Dubai / Australia-based • •Investment Banking or Private Equity Experts • • for a research project with a leading foundational model AI lab. You are a good fit if you : - Have •...Show moreLast updated: 3 hours ago
    • Promoted
    Software Engineer III-Gen AI Inferencing

    Software Engineer III-Gen AI Inferencing

    Bank of AmericaCharlotte, NC, United States
    Full-time
    Software Engineer III-Gen AI Inferencing.Addison, Texas;Charlotte, North Carolina; Kennesaw, Georgia; Newark, Delaware.To proceed with your application, you must be at least 18 years of age.To proc...Show moreLast updated: 30+ days ago
    • Promoted
    AI First Software Engineer - Senior Manager

    AI First Software Engineer - Senior Manager

    PwCCharlotte, NC, United States
    Full-time
    At PwC, our people in software and product innovation focus on developing cutting-edge software solutions and driving product innovation to meet the evolving needs of clients.These individuals comb...Show moreLast updated: 3 days ago
    • Promoted
    Travel MRI Tech - $1814.75 / Week

    Travel MRI Tech - $1814.75 / Week

    AMN Healthcare AlliedRock Hill, SC, US
    Full-time
    AMN Healthcare Allied is seeking an experienced MRI Tech for an exciting Travel Allied job in Rock Hill, SC.Shift : 10 hr days Start Date : ASAP Duration : 13 weeks Pay : $1814.Job Description & Re...Show moreLast updated: 27 days ago
    Lead AI / ML Platform Engineer

    Lead AI / ML Platform Engineer

    NorthPoint Search GroupCharlotte, NC, US
    Full-time
    Quick Apply
    Lead AI / ML Platform Engineer Who : .A seasoned engineering leader with 8+ years of experience in building and operating production-grade AI / ML platforms. You'll architect and evolve a GenAI platform, ...Show moreLast updated: 30+ days ago
    • Promoted
    Travel Speech Language Pathologist (SLP) - $2,066 per week in Troutman, NC

    Travel Speech Language Pathologist (SLP) - $2,066 per week in Troutman, NC

    AlliedTravelCareersTroutman, NC, US
    Full-time
    AlliedTravelCareers is working with Coast Medical Service to find a qualified Speech Language Pathologist (SLP) in Troutman, North Carolina, 28166!. Coast Medical Service is a nationwide travel nurs...Show moreLast updated: 30+ days ago
    • Promoted
    AI Solution Architect

    AI Solution Architect

    EisnerAmperCharlotte, NC, United States
    Full-time
    At EisnerAmper, we look for individuals who welcome new ideas, encourage innovation, and are eager to make an impact.Whether you're starting out in your career or taking your next step as a seasone...Show moreLast updated: 28 days ago
    • Promoted
    Dashers - Sign Up and Start Earning

    Dashers - Sign Up and Start Earning

    DoorDashStatesville, US
    Full-time +1
    DoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day. As a Dasher, you’ll stay busy with a variety o...Show moreLast updated: 1 day ago
    • Promoted
    Full-time job opportunity for a GEN AI Architect

    Full-time job opportunity for a GEN AI Architect

    Jconnect IncCharlotte, NC, United States
    Full-time
    If you are comfortable with the JD and interested,.I've included the job description (JD) below for you to look over.Worked on Agentic AI Wokrflows. Should be specialized in building & deploying Gen...Show moreLast updated: 3 days ago
    • Promoted
    Lead AI / ML Platform Engineer

    Lead AI / ML Platform Engineer

    NorthPoint Search Group IncCharlotte, NC, United States
    Full-time
    A seasoned engineering leader with 8+ years of experience in building and operating production-grade AI / ML platforms.You'll architect and evolve a GenAI platform, lead platform strategy, mentor tea...Show moreLast updated: 2 days ago
    • Promoted
    Senior AI Software Engineer

    Senior AI Software Engineer

    WebflowCharlotte, NC, United States
    Full-time +1
    At Webflow, we are on a mission to empower everyone with development superpowers.As the leading innovator of the Website Experience Platform (WXP), we are revolutionizing how teams build, manage, a...Show moreLast updated: 2 days ago
    • Promoted
    CFD Engineer - Motorsports Aerodynamics

    CFD Engineer - Motorsports Aerodynamics

    LEGACY MOTOR CLUBStatesville, North Carolina, United States
    Full-time
    We are launching a cutting-edge Computational Fluid Dynamics (CFD) program to enhance aerodynamic development for a NASCAR Cup Series team. This initiative will also support the refinement of simula...Show moreLast updated: 2 days ago
    • Promoted
    Responsible AI Leader

    Responsible AI Leader

    First Citizens BankCharlotte, NC, US
    Full-time
    This leader will establish and oversee AI governance and oversight methods for the bank by partnering with Business Line Risk Mgmt, Enterprise Risk, Compliance, Model Risk Mgmt, Legal, Audit, Techn...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Software Engineer

    Lead Software Engineer

    RelativityCharlotte, NC, United States
    Full-time
    We are seeking a Lead Software Engineer to join the Retrieval Ingestion Team at Relativity.This role is ideal for an experienced engineer who thrives on designing and operating high throughput inge...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer - AI Telephony Systems

    Senior Software Engineer - AI Telephony Systems

    Red VenturesCharlotte, NC, United States
    Full-time
    This role is not open to visa sponsorship or transfer of visa sponsorship including those on OPT and STEM-EXT OPT, nor is it available to work corp-to-corp. At Red Ventures, we combine the power of ...Show moreLast updated: 3 days ago
    • Promoted
    AI & ML Developer Lead

    AI & ML Developer Lead

    Diverse LynxCharlotte, NC, United States
    Full-time
    We are seeking an innovative and experienced AI & ML Developer Lead to spearhead our artificial intelligence initiatives. This role involves leading a team of engineers, designing and deploying scal...Show moreLast updated: 3 days ago
    • Promoted
    AI Specialist -Software engineer

    AI Specialist -Software engineer

    Strategic Staffing SolutionsCharlotte, NC, United States
    Full-time
    STRATEGIC STAFFING SOLUTIONS (S3) HAS AN OPENING!.Strategic Staffing Solutions is currently looking for an AI specialist for one of its clients!!. Candidates should be willing to work on our W2 ONLY...Show moreLast updated: 3 days ago
    Gen AI Develope, NC

    Gen AI Develope, NC

    Career Mentors, LLCCharlotte, NC, US
    Full-time
    Charlotte, NC (Local Candidates Preferred).W2 Contract (Minimum 12-Month Validity).The ideal candidate will have hands-on experience with large language models (LLMs), deep learning architectures, ...Show moreLast updated: 30+ days ago