Senior Agentic AI Test and Evaluation Engineer

Overview

At Leidos, you'll contribute to AI solutions that serve critical national and global missions—ranging from defense and intelligence to healthcare, energy, and space exploration. Our work emphasizes Trusted Mission AI : systems that are transparent, ethical, resilient, and accountable. You'll collaborate with multidisciplinary teams to transition AI research into operational environments where accuracy, security, and reliability are non-negotiable. Joining Leidos means applying your expertise to solve some of the most complex and meaningful challenges of our time.

We are looking for a motivated Agentic AI Test and Evaluation Engineer who wants to work on challenging problems in a variety of domains – including enterprise IT, health, defense, intelligence, and energy – to get results that apply and go beyond the state of the art for measurably better outcomes. We apply our knowledge, capabilities, and experience to develop and deploy Trusted Mission AI – AI that deserves to be trusted by system owners, end users, and the public – to be accurate, ethical, reliable, and adaptable.

You will work with a team of agentic AI scientists, data scientists and data engineers to operationalize new approaches for test and evaluation of Agentic AI models that produce measurable advances over state of the art solutions.

Primary Responsibilities

• Develops AI Models Test and Evaluation CONOPS
• Creates scalable Test and Model Evaluation plans for Agentic AI systems including process, techniques and tools.
• Works with AI scientists, agentic AI scientists, data scientists and data engineers to understand the AI system under test to develop test procedures
• Both positive and negative testing and evaluation
• Collect performance metrics as part of evaluation results documentation
• Works with MLOps engineers to integrate testing tools and procedures with the CI / CD pipeline
• Analyzes existing processes and resultant metrics to recommend potential improvements
• Collaborates with AI Governance team to maintain visibility and explainability through testing
• Implements testing process in the AI system design, development and deployment life cycle
• Identifies the risk in testing of projects, particularly for assessing the limitations of planned tests on complex AI systems
• Works within teams of AI / ML researchers and engineers using Agile development processes

Basic Qualifications

0s degree in Computer Science, Data Science or related field and over 8 years of relevant experience, Masters with 6 years experience. Additional experience may be considered in lieu of degree.

Preferred Qualifications

At Leidos, we don't want someone who "fits the mold"—we want someone who melts it down and builds something better. This is a role for the restless, the over-caffeinated, the ones who ask, "what's next?" before the dust settles on "what's now."

If you're already scheming step 20 while everyone else is still debating step 2… good. You'll fit right in.

Original Posting

August 29, 2025

Pay Range

Pay Range $104,650.00 - $189,175.00

The Leidos pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.

Remote

J-18808-Ljbffr