Talent.com
Senior Agentic DevOps Engineer – Runtime Validation & Governance
Senior Agentic DevOps Engineer – Runtime Validation & GovernanceKeysight Technologies • Calabasas, California, US
Senior Agentic DevOps Engineer – Runtime Validation & Governance

Senior Agentic DevOps Engineer – Runtime Validation & Governance

Keysight Technologies • Calabasas, California, US
30+ days ago
Job type
  • Full-time
Job description

Overview

Keysight is at the forefront of technology innovation, delivering breakthroughs and trusted insights in electronic design, simulation, prototyping, test, manufacturing, and optimization. Our ~15, employees create world-class solutions in communications, 5G, automotive, energy, quantum, aerospace, defense, and semiconductor markets for customers in over countries. Learn more about what we do.

Our award-winningculture embraces a bold vision of where technology can take us and a passion for tackling challenging problems with industry-first solutions. We believe that when people feel a sense of belonging, they can be more creative, innovative, and thrive at all points in their careers.

About the Initiative

Keysight’s Applied AI Autonomy Initiative is developing a next-generation agentic orchestration framework that enables AI agents to reason, adapt, and coordinate across complex engineering workflows. Built on LangGraph and reinforcement-inspired feedback mechanisms , this framework transforms prompts and design intents into executable orchestration strategies that evolve autonomously through iterative simulation and validation loops.

Our ambition is not merely to replicate human reasoning, but to push past human limits - enabling agentic systems to explore design spaces, optimize engineering workflows, and evolve orchestration strategies at a scale and speed no human could achieve.

To make this possible, it will require robust runtime governance and regression intelligence layer — one that ensures every autonomous action is verified, reversible, traceable, and safe before it influences live engineering systems.

This role defines that layer : the bridge between autonomy and operational trust , enabling production-scale AI-driven orchestration with assurance and auditability.

What This Role Offers — Optimized for Agentic DevOps

  • A foundational and highly visible role shaping how AI-generated orchestration earns operational trust across Keysight’s engineering ecosystem.
  • The mandate to define the validation, governance, and assurance standards that determine when and how autonomous agent logic may safely enter production.
  • Ownership of the mission-critical regression and verification pipeline , where agent actions, simulation feedback, and safety controls converge — enabling autonomy that is explainable, reversible, measurable, and audit-ready .

Responsibilities

Role Overview

As the Senior Agentic DevOps Engineer , you will architect and implement the runtime validation, control, and feedback systems that govern how agent-generated logic is tested, verified, and promoted into production.

This is not classical DevOps or CI / CD — it is Agentic DevOps : embedding intelligent agents into the deployment fabric with guardrails, feedback loops, rollback capabilities, and telemetry built into every stage.

Your mission is to enable a self-aware orchestration pipeline where agents can act, learn, adapt, and be safely governed , delivering predictable, and stable outcomes across dynamic, high-assurance environments.

Core Engineering Domains

  • Execution Integrity Architecture
  • Design sandboxed and containerized evaluation zones for testing agent-generated logic prior to deployment.
  • Build a multi-stage release pipeline spanning sandbox → validation → gated staging → monitored execution.
  • Define and enforce isolation and containment protocols to prevent propagation of unsafe or misconfigured agent actions.
  • Establish runtime health scoring , confidence thresholds , and promotion gates to control when an agent’s output can advance to production.
  • Regression Intelligence & Continuous Verification
  • Develop regression and validation frameworks tailored for agentic orchestrations to detect drift, instability, or emergent behaviors.
  • Implement baseline comparison and differential validation systems to continuously verify agent outputs against expected outcomes.
  • Construct autonomous CI / CD pipelines integrating both neural (agent-generated) and traditional (human-written) logic with versioning and reproducibility guarantees.
  • Provide predictable replay and audit mechanisms to re-execute orchestration cycles for debugging, validation, and compliance.
  • Observability, Governance & Rollback
  • Engineer always-on telemetry and introspection pipelines capturing every agent decision, validation result, and anomaly.
  • Develop snapshot and rollback frameworks enabling rapid restoration to verified system states.
  • Ensure end-to-end traceability of all orchestration artifacts, mapping which agent produced what output, with what data and under what conditions.
  • Surface trust metrics, validation outcomes, and confidence scores through operator dashboards and governance APIs in collaboration with Dev / UI teams.
  • Key Responsibilities

  • Lead the definition and implementation of validation, governance, and regression standards across Keysight’s agentic orchestration runtime.
  • Architect and deploy a continuous validation pipeline integrating feedback loops, guardrails, telemetry, and rollback systems.
  • Build self-diagnosing runtime logic that enables agents and infrastructure to detect, contain, and recover from instability autonomously.
  • Define and maintain safety certification, auditability, and reproducibility frameworks for agent-generated actions in production.
  • Collaborate with framework architects, safety engineers, ML researchers, and data intelligence teams to align validation infrastructure with orchestration and learning feedback systems.
  • Qualifications

    Required Qualifications

  • PhD or 5+ years of experience in systems engineering , runtime validation , safety-critical infrastructure , or high-assurance deployment frameworks .
  • Proficiency with CI / CD systems (e.g., Jenkins, GitLab CI, GitHub Actions, or ArgoCD) for automation, validation, and controlled deployments.
  • Proven experience designing sandboxed execution environments, controlled-release and CI / CD pipelines , or validated deployment systems at production scale.
  • Strong proficiency in Python and C / C++ , with expertise in sandbox architecture, promotion control, and rollback mechanisms.
  • Demonstrated ability in regression governance, continuous verification , and telemetry-driven runtime monitoring .
  • Proficiency with agentic AI frameworks (e.g., LangGraph, LangChain) and validation mechanisms for multi-agent orchestration and reasoning stability.
  • Preferred Qualifications

  • Experience with simulation orchestration , HPC systems , or digital-twin environments feeding live feedback into control loops.
  • Knowledge of differential validation , golden-run comparison , confidence-scored promotion models , and structured evaluation frameworks.
  • Background in governance frameworks for machine-generated logic or autonomous systems (e.g., AI or robotics).
  • The level of role will be based on applicable experience, education and skills; Most offers will be between the minimum and the midpoint of the Salary Range listed below.

    CA pay range : MIN $,- MAX $,

    Note : For other locations, pay ranges will vary by region

    This role is eligible for our Keysight Results Bonus Program

    US Employees may be eligible for the following benefits :

  • Medical, dental and vision
  • Health Savings Account
  • Health Care and Dependent Care Flexible Spending Accounts
  • Life, Accident, Disability insurance
  • Business Travel Accident and Business Travel Health
  • (k) Plan
  • Flexible Time Off, Paid Holidays
  • Paid Family Leave
  • Discounts, Perks
  • Tuition Reimbursement
  • Adoption Assistance
  • ESPP (Employee Stock Purchase Plan)
  • Restricted Stock Units
  • Careers Privacy Statement

    Keysight is an Equal Opportunity Employer

    Keysight Technologies Inc. is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability or any other protected categories under all applicable laws.

    Create a job alert for this search

    Senior Agentic DevOps Engineer Runtime Validation Governance • Calabasas, California, US

    Similar jobs
    Advanced Reporting and Visualization Analyst

    Advanced Reporting and Visualization Analyst

    Vallarta Supermarkets • Santa Clarita, California, United States
    Full-time
    Quick Apply
    Advanced Reporting and Visualization Analyst.Non-exempt - Full-time; $33 - $42 hourly.The Advanced Reporting and Visualization Analyst plays a critical role in transforming complex datasets into cl...Show more
    Last updated: 14 days ago
    Travel Surgical Tech - Certified - $1923.2 / Week

    Travel Surgical Tech - Certified - $1923.2 / Week

    InSync Consulting Services • Tarzana, CA, US
    Full-time
    InSync Consulting Services is seeking an experienced Surgical Tech - Certified for an exciting Travel Allied job in Tarzana, CA. Shift : 5x8 hr days Start Date : 02 / 16 / 2026 Duration : 13 weeks Pay : $19...Show more
    Last updated: 16 hours ago • Promoted • New!
    Sr. FPGA Engineer (Contract-Perm)

    Sr. FPGA Engineer (Contract-Perm)

    A2e Technologies • Northridge, CA, US
    Full-time
    Quick Apply
    Term : Contract-Perm (Perm Potential).Duration : Long-Term (24+ Months).Strong Design skills in VHDL & Verilog.Extensive experience w / Bring-up. Verilog and Python based Simulations.Solid backgroun...Show more
    Last updated: 30+ days ago
    Remote Go Engineer - AI Trainer

    Remote Go Engineer - AI Trainer

    SuperAnnotate • Agoura Hills, California, US
    Remote
    Full-time
    As an hourly paid, fully remote Go Engineer for AI Data Training, you will review AI-generated Go code and explanations or generate your own, evaluate the reasoning quality and step-by-step problem...Show more
    Last updated: 8 days ago
    Travel Surgical Tech - $1,689 per week in Tarzana, CA

    Travel Surgical Tech - $1,689 per week in Tarzana, CA

    AlliedTravelCareers • Tarzana, CA, US
    Full-time
    AlliedTravelCareers is working with Mindlance Health to find a qualified Surg Tech in Tarzana, California, 91356!.ID : 75318656 Shift : Day 5x8-Hour (08 : 30 - 17 : 30) Description : Certified Orthopedic ...Show more
    Last updated: 1 day ago • Promoted
    DevOps Software Engineer - HPC Specialist

    DevOps Software Engineer - HPC Specialist

    Hrl Laboratories • Calabasas, California, United States
    Full-time
    We are seeking a DevOps Software Engineer – HPC Specialist, where our DevOps team supports and maintains high-performance computing (HPC) environments and secure CI / CD infrastructure that support s...Show more
    Last updated: 1 day ago • Promoted
    Senior Software Engineer (Teradyne, Agoura Hills)

    Senior Software Engineer (Teradyne, Agoura Hills)

    Teradyne • Agoura Hills, CA, United States
    Full-time
    We are the global test and automation specialists, powering next-generation technologies through sophisticated solutions. Behind every electronic device you use, Teradyne's test technology ensures y...Show more
    Last updated: 2 days ago • Promoted
    Senior Software Engineer, Core Experiences - Santa Clarita, USA

    Senior Software Engineer, Core Experiences - Santa Clarita, USA

    Speechify • Valencia, CA, United States
    Full-time
    Senior Software Engineer, Core Experiences / h2pstrongMission / strong / ppSpeechify is the easiest way to listen to the worlds information. Articles on the web, documents in the cloud, books on your phon...Show more
    Last updated: 2 days ago • Promoted
    Travel Surgical Tech - $1768.5 / Week

    Travel Surgical Tech - $1768.5 / Week

    Cynet Health • Westlake Village, CA, US
    Full-time
    Cynet Health is seeking an experienced Surgical Tech for an exciting Travel Allied job in Westlake Village, CA.Shift : 5x8 hr days Start Date : 02 / 23 / 2026 Duration : 13 weeks Pay : $1768.Ranked #5 Best...Show more
    Last updated: 1 day ago • Promoted
    Travel Surgical Tech - $1,689 per week in Westlake Village, CA

    Travel Surgical Tech - $1,689 per week in Westlake Village, CA

    AlliedTravelCareers • Westlake Village, CA, US
    Full-time
    AlliedTravelCareers is working with Mindlance Health to find a qualified Surg Tech in Westlake Village, California, 91361!. ID : 75318659 Shift : Day 5x8-Hour (08 : 30 - 17 : 30) Description : Certified Or...Show more
    Last updated: 1 day ago • Promoted
    Validation Engineer II

    Validation Engineer II

    Sunco Lighting, Inc. • Valencia, California, United States, 91355
    Full-time
    Note to applicants : This is a full-time, onsite position working out of our HQ in Valencia, CA.Sunco is one of the largest and fastest-growing online lighting retailers in the U.Headquartered in su...Show more
    Last updated: 7 days ago
    R&D Senior Software Engineer

    R&D Senior Software Engineer

    Keysight Technologies SAles Spain SL. • Calabasas, CA, United States
    Full-time
    Keysight is at the forefront of technology innovation, delivering breakthroughs and trusted insights in electronic design, simulation, prototyping, test, manufacturing, and optimization.Our ~15,000...Show more
    Last updated: 18 hours ago • Promoted • New!
    Senior Databricks Application Engineer

    Senior Databricks Application Engineer

    Numentica LLC • Calabasas, California, USA
    Full-time +1
    City : Calabasas CA / Las Vegas NV - Onsite 4 days a week.Duration : 6 months Contract to Hire C2C or W2 during contract. Work Authorization : Green Card or USC only no H1Bs F1s or EADs.Bachelors degree...Show more
    Last updated: 15 days ago • Promoted
    Senior Software Engineer, Core Experiences - Remote SDKs

    Senior Software Engineer, Core Experiences - Remote SDKs

    Speechify • Santa Clarita, CA, United States
    Full-time
    A technology company in Santa Clarita is seeking a Senior Software Engineer to join their Core Experiences Team.The role involves designing reliable APIs and backend services to enhance user experi...Show more
    Last updated: 20 hours ago • Promoted • New!
    AI Engineer (On-Site, Calabasas Office – Immediate Hire)

    AI Engineer (On-Site, Calabasas Office – Immediate Hire)

    Get Covered LLC • Calabasas, California, United States, 91302
    Full-time
    We provide cost-effective coverage with just a few clicks — satisfying residents, property managers, agencies, and distribution partners with a process that is as simple and touchless as possible.W...Show more
    Last updated: 28 days ago
    Senior Architect - Agentic Orchestration Frameworks

    Senior Architect - Agentic Orchestration Frameworks

    Keysight Technologies • Calabasas, CA, United States
    Full-time
    Keysight is at the forefront of technology innovation, delivering breakthroughs and trusted insights in electronic design, simulation, prototyping, test, manufacturing, and optimization.Our ~15,000...Show more
    Last updated: 1 day ago • Promoted
    Senior Software Engineer, Backend

    Senior Software Engineer, Backend

    MachinaLabs • Chatsworth, California, United States, 91311
    Full-time
    Senior Software Engineer, Backend.At Machina Labs, were reshaping manufacturing through advanced robotics and machine learning. Our platform uses the largest 6-axis robots on the market to form 2D s...Show more
    Last updated: 8 days ago
    Senior Software Engineer, Computational Geometry

    Senior Software Engineer, Computational Geometry

    MachinaLabs • Chatsworth, California, United States, 91311
    Full-time
    Senior Software Engineer, Computational Geometry.At Machina Labs, were reshaping manufacturing through advanced robotics and machine learning. Our platform uses the largest 6-axis robots on the mark...Show more
    Last updated: 8 days ago