Senior AI Engineer - Core Foundations and LLM Development

Overview :

Join Capital One as we redefine banking with innovative and responsible AI solutions. With our commitment to leveraging machine learning, we're transforming the banking experience to be more personalized and efficient. From monitoring unusual charges to providing real-time customer support, our AI applications are designed to enhance simplicity and humanity in financial services. At Capital One, you have the opportunity to contribute to groundbreaking AI systems that will revolutionize how we serve our customers.

Team Description :

The Intelligent Foundations and Experiences (IFX) team is pivotal in actualizing our AI vision. We collaborate closely across departments to advance state-of-the-art AI science and engineering. Our proprietary AI models and platforms empower teams throughout Capital One, allowing them to enhance their offerings responsively and at scale, delivering maximum impact.

In this role, you will :

Collaborate with a diverse team of engineers, research scientists, technical program managers, and product managers to create AI-driven products that transform both employee workflows and customer interactions.

Design, develop, test, deploy, and maintain AI software components, including foundational model training, large language model inference, similarity searches, and system governance.

Utilize a wide array of open-source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch.

Introduce advanced optimization techniques to enhance the scalability, cost-efficiency, latency, and throughput of large-scale production AI systems.

Contribute to our technical vision and long-term strategy for foundational AI systems at Capital One.

The Ideal Candidate :

You take pride in building high-quality systems and share our commitment to ethical practices in AI development. You are passionate about tackling complex problems that will make a genuine difference in banking.

You are enthusiastic about the latest research in AI, able to comprehend scientific literature, and adept at applying innovative techniques in real-world scenarios.

You are quick to adapt to changing environments, excel at clarifying complex issues, and possess the courage to propose and explore new ideas.

You are technically strong, with robust engineering and mathematical skills, and can identify optimization opportunities that may be overlooked by others.

You are a resilient innovator, able to carve out new strategies for achieving business objectives when the path is not well defined.

Basic Qualifications :

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field with at least 6 years of experience in AI and machine learning, or a Master's degree in these fields with at least 4 years of related experience.

At least 6 years of programming experience in Python, Go, Scala, or Java.

Preferred Qualifications :

7 years of experience deploying scalable and ethical AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure).

Experience in designing and supporting complex AI systems.

Proven ability to lead and mentor engineering teams and influence stakeholders across the board.

Experience with AI technologies, including LLM Inference, Similarity Search, VectorDBs, and optimizing performance using Python, C++, C#, Java, or Go.

Expertise in developing techniques to optimize AI training and inference processes for enhanced performance.

A passion for keeping up-to-date with cutting-edge AI research and applying it judiciously in production environments.

Strong communication skills, with the ability to clearly explain complex AI concepts to diverse audiences.

Capital One is an equal opportunity employer committed to diversity and inclusion. We invite applications from qualified candidates from all backgrounds. We offer a comprehensive compensation package including a competitive salary, performance incentives, and a wide range of benefits to support your overall well-being. This position is open for applications, and we look forward to your interest!