Senior AI Engineering Lead (Core LLM and Agentic AI)

Overview

At Capital One, we are dedicated to creating cutting-edge, responsible AI systems that are revolutionizing banking for good. With years of innovation in machine learning, we excel in crafting real-time, personalized customer experiences. Our advanced technology infrastructure and expert talent position us at the forefront of the AI landscape, where we are transforming customer interactions—from alerting them to unusual charges to providing real-time answers to their queries. Join us in building world-class applied science and engineering teams to deliver groundbreaking products and scalable, high-performance AI infrastructure. Here, your contributions will help unlock the transformative power of emerging AI capabilities and reshape the way we engage with our customers.

Team Description :

The Intelligent Foundations and Experiences (IFX) team is pivotal in realizing Capital One's AI vision. Collaborating closely with cross-functional partners, we push the boundaries of AI science and engineering while constructing proprietary solutions that provide value to millions. Our AI models and platforms empower teams to enhance their products with scalable, responsible AI solutions, yielding significant impact.

In this role, you will :

Collaborate with a dynamic team of engineers, research scientists, technical program managers, and product managers to deliver AI products that transform work processes and customer interactions.

Design, develop, test, deploy, and maintain AI software components, encompassing foundation model training, LLM inference, similarity search, guardrails, model evaluation, and observability.

Utilize a wide array of Open Source and SaaS AI technologies, including AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, and PyTorch.

Innovate and implement state-of-the-art LLM optimization techniques to enhance performance metrics such as scalability, cost, latency, and throughput.

Influence the technical vision and long-term roadmap for foundational AI systems at Capital One.

The Ideal Candidate :

A builder at heart who values quality and is passionate about using technology to enact positive change in banking.

Keenly interested in the latest research advancements and capable of applying innovative techniques judiciously in a production environment.

Adaptable and thriving in ambiguous situations, you possess the ability to clarify complex problems and communicate your insights effectively.

Possessing a strong technical foundation in engineering and mathematics, you can identify optimization opportunities across hardware and software layers.

A resilient innovator, you embrace challenges and confidently navigate uncharted territories to meet business objectives.

Basic Qualifications :

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field with at least 4 years of experience in AI and ML development, or a Master's degree in a similar field with at least 2 years of experience.

At least 4 years of experience programming in Python, Go, Scala, or Java.

Preferred Qualifications :

6 years of experience deploying scalable AI solutions on cloud platforms (AWS, Google Cloud, Azure, or equivalent).

Experience in designing, developing, and supporting AI services.

Expertise in developing AI and ML algorithms (e.g., LLM Inference, Similarity Search, VectorDBs) using Python, C++, C#, Java, or Golang.

Experience in optimizing training and inference software for improved resource utilization, latency, throughput, and cost efficiency.

Deeply interested in AI research and focused on practical applications of novel techniques in production settings.

Capital One will consider sponsoring a new qualified applicant for employment authorization for this position. The minimum and maximum annual salaries for this role are as follows : Cambridge, MA : $193,400 - $220,700; McLean, VA : $193,400 - $220,700; New York, NY : $211,000 - $240,800; San Francisco, CA : $211,000 - $240,800; San Jose, CA : $211,000 - $240,800. Candidates hired in other locations will be subject to the pay range associated with that location. Actual salary will be reflected in the candidate's offer letter.

Performance-based incentive compensation may be available, including discretionary or non-discretionary cash bonuses and / or long-term incentives. Capital One offers a comprehensive, competitive, and inclusive benefits package that supports your well-being, with eligibility based on full-time or part-time status, exempt or non-exempt classification, and management level.

Capital One is an equal opportunity employer committed to non-discrimination in compliance with all applicable federal, state, and local laws. We promote a drug-free workplace and will consider qualified applicants with a criminal history consistent with legal requirements. If you require accommodation during the application process, please contact Capital One Recruiting.