Senior Agentic AI Test and Evaluation Engineer

Description

At Leidos, you'll contribute to AI solutions that serve critical national and global missions-ranging from defense and intelligence to healthcare, energy, and space exploration. Our work emphasizes Trusted Mission AI : systems that are transparent, ethical, resilient, and accountable. You'll collaborate with multidisciplinary teams to transition AI research into operational environments where accuracy, security, and reliability are non-negotiable. Joining Leidos means applying your expertise to solve some of the most complex and meaningful challenges of our time.

We are looking for a motivated Agentic AI Test and Evaluation Engineer who wants to work on challenging problems in a variety of domains - including enterprise IT, health, defense, intelligence, and energy - to get results that apply and go beyond the state of the art for measurably better outcomes. We apply our knowledge, capabilities, and experience to develop and deploy Trusted Mission AI - AI that deserves to be trusted by system owners, end users, and the public - to be accurate, ethical, reliable, and adaptable.

You will work with a team of agentic AI scientists, agentic AI scientists, data scientists and data engineers to operationalize new approaches for test and evaluation of Agentic AI models that produce measurable advances over state of the art solutions.

Primary Responsibilities

• Develops AI Models Test and Evaluation CONOPS
• Creates scalable Test and Model Evaluation plans for Agentic AI systems including process, techniques and tools.
• Works with AI scientists, agentic AI scientists, data scientists and data engineers to understand the AI system under test to develop test procedures
• both positive and negative testing and evaluation
• Collect performance metrics as part of evalulation results documentation
• Works with MLOps engineers to integrate testing tools and procedures with the CI / CD pipeline
• Analyzes existing processes and resultant metrics to recommend potential improvements
• Collaborates with AI Governance team to maintain visibility and explainability through testing
• Implements testing process in the AI system design, development and deployment life cycle
• Identifies the risk in testing of projects, particularly for assessing the limitations of planned tests on complex AI systems
• Works within teams of AI / ML researchers and engineers using Agile development processes

Basic Qualifications

Preferred Qualifications

LeidosAI

If you're looking for comfort, keep scrolling. At Leidos, we outthink, outbuild, and outpace the status quo - because the mission demands it. We're not hiring followers. We're recruiting the ones who disrupt, provoke, and refuse to fail. Step 10 is ancient history. We're already at step 30 - and moving faster than anyone else dares.

Original Posting : August 29, 2025

For U.S. Positions : While subject to change based on business needs, Leidos reasonably anticipates that this job requisition will remain open for at least 3 days with an anticipated close date of no earlier than 3 days after the original posting date as listed above.

Pay Range :

Pay Range $104,650.00 - $189,175.00

The Leidos pay range for this job level is a general guideline onlyand not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.

#Remote