Lead AI Engineer (Large Language Models)

Overview :

At Capital One, we are dedicated to building responsible and innovative AI systems that are transforming the banking sector for the better. With years of leadership in machine learning, we strive to create real-time, personalized customer experiences. Our advanced technology infrastructure and exceptional talent enable us to harness AI at the forefront of the industry. From detecting unusual transactions to providing instant answers to inquiries, our AI and ML applications bring simplicity and humanity to banking. Join us in creating cutting-edge applied science and engineering teams that deliver industry-leading capabilities and exceptional product experiences through scalable, high-performance AI infrastructure.

Team Description :

The Intelligent Foundations and Experiences (IFX) team is key in realizing our AI vision at Capital One. By collaborating closely with various partners across the company, we push the boundaries of science and AI engineering. We design and deploy proprietary solutions that are vital to our operations, delivering immense value to millions of customers. Our AI models and platforms empower teams company-wide to integrate transformative AI capabilities efficiently and responsibly.

In this role, you will :

Collaborate with a diverse team of engineers, research scientists, technical program managers, and product managers to create AI-powered products that enhance employee productivity and customer interactions with Capital One.

Design, develop, test, deploy, and maintain AI software components, including aspects like foundational model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.

Utilize a wide range of Open Source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, and more.

Innovate and implement state-of-the-art optimization techniques for large-scale production AI systems focusing on performance, scalability, cost-efficiency, latency, and throughput.

Contribute to shaping the technical vision and long-term roadmap for foundational AI systems at Capital One.

The Ideal Candidate :

You take pride in building systems of high quality and are driven by the passion to positively impact the banking sector.

You have a fervor for staying updated with the latest research, and can effectively apply novel techniques from scientific publications in a production environment.

You adapt swiftly to challenges and excel in clarifying complex, undefined problems. You are inquisitive and find joy in uncovering root causes, articulating your insights clearly. You feel confident sharing new, though yet unproven, ideas.

You possess strong technical expertise in engineering and mathematics, enabling you to identify optimization opportunities others might miss.

You are a resilient leader who thrives in navigating uncharted territories to achieve business objectives.

Basic Qualifications :

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related discipline plus at least 3 years of experience in developing AI and ML algorithms or technologies, or a Master's degree in the same fields with at least 1 year of experience.

A minimum of 3 years of programming experience in languages such as Python, Go, Scala, or Java.

Preferred Qualifications :

At least 4 years of experience deploying scalable and responsible AI solutions on cloud platforms like AWS, Google Cloud, Azure, or equivalent private cloud.

Experience in developing, delivering, and supporting AI services.

Expertise in AI and ML algorithms or technologies, including LLM Inference, Similarity Search and VectorDBs, Guardrails, and Memory, using programming languages such as Python, C++, C#, Java, or Golang.

Experience optimizing training and inference software to enhance hardware utilization, latency, throughput, and cost-effectiveness.

This role is located at Capital One’s office in Cambridge, MA, McLean, VA, New York, NY, San Francisco, CA, or San Jose, CA. Capital One will consider sponsorship for new qualified applicants for employment authorization for this position.

The compensation range for this role is as follows :

• Cambridge, MA : $158,600 - $181,000
• McLean, VA : $158,600 - $181,000
• New York, NY : $173,000 - $197,400
• San Francisco, CA : $173,000 - $197,400
• San Jose, CA : $173,000 - $197,400

Compensation may include performance-based incentives which can consist of cash bonuses and / or long-term incentives. Capital One offers a comprehensive set of competitive and inclusive health, financial, and other benefits that support your total well-being. Learn more on the Capital One Careers website.

Capital One is an equal opportunity employer committed to non-discrimination in compliance with applicable federal, state, and local laws. We promote a drug-free workplace and will consider qualified applicants with a criminal history in accordance with applicable laws and regulations.