Senior AI Engineering Lead (LLM Customization and Fine-tuning)

Overview :

Join Capital One as we revolutionize banking through the responsible and innovative use of AI. We lead the industry by developing machine learning systems that create real-time, personalized customer experiences. Our commitment to technology and talent enables us to harness AI to deliver impactful solutions, from detecting unusual charges to providing instant answers to customer inquiries. Here, you'll be instrumental in harnessing cutting-edge AI capabilities to transform how we serve our valued customers.

Team Description :

The Intelligent Foundations and Experiences (IFX) team is at the forefront of our AI vision at Capital One. In collaboration with teams across the company, we push the boundaries of AI science and engineering, creating proprietary solutions that drive significant value for millions of customers. By enabling teams across Capital One to incorporate AI, we ensure our products are both scalable and responsible.

In this role, you will :

Collaborate with a diverse team of engineers, research scientists, technical program managers, and product managers to deliver AI-driven products that enhance both associate workflows and customer interactions with Capital One.

Design, develop, test, deploy, and maintain AI software components, including training foundation models, implementing large language model inference, conducting similarity searches, and ensuring model evaluation and governance.

Utilize a wide array of Open Source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, among others.

Innovate and apply state-of-the-art optimization techniques to enhance the performance of large-scale production AI systems in terms of scalability, cost efficiency, latency, and throughput.

Contribute to shaping the technical vision and long-term roadmap for foundational AI systems at Capital One.

The Ideal Candidate :

You are passionate about building high-quality systems and are driven by a desire to positively impact the banking industry.

You stay current with the latest research and can intuitively understand and apply novel techniques from scientific literature to production environments.

You excel in identifying and solving complex challenges, articulating your insights clearly, and are unafraid to propose innovative ideas.

You possess a solid technical foundation in engineering and mathematics, with the ability to find and exploit optimization opportunities in AI systems.

You are a resilient trailblazer capable of navigating uncharted paths to achieve business objectives.

Basic Qualifications :

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field with at least 6 years of experience in developing AI and ML technologies, or a Master's degree with at least 4 years of relevant experience.

At least 6 years of programming experience in Python, Go, Scala, or Java.

Preferred Qualifications :

7 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure).

Experience in designing, developing, integrating, and supporting complex AI systems.

Proven ability to lead and mentor teams, and influence stakeholders across functions.

Experience with AI and ML technologies, including LLM Inference, Similarity Search and VectorDBs, and more.

Expertise in optimizing training and inference software for performance improvements.

A strong interest in AI research and a commitment to applying cutting-edge techniques in real-world applications.

Exceptional communication and presentation skills, adept at conveying complex AI concepts effectively.

Location : This position may be based in McLean, VA; Cambridge, MA; New York, NY; San Francisco, CA; or San Jose, CA.

If you're ready to make your mark in a forward-thinking environment that values innovation, apply to Capital One today. We celebrate diversity and are committed to creating an inclusive environment for all employees. Capital One is an equal opportunity employer.