Talent.com
Research Lead - AI Cyber Testing & Evaluation

Research Lead - AI Cyber Testing & Evaluation

RANDSanta Monica, CA, United States
30+ days ago
Job type
  • Temporary
Job description

Overview

Job Type : Term (Fixed Term)

RAND's Meselson Center, part of the Global and Emerging Risks (GER) division, is seeking an accomplished technical leader to drive our ambitious AI cyber evaluation agenda. As Research Lead - AI Cyber Testing & Evaluation, you'll direct a comprehensive research portfolio focused on assessing the offensive cyber capabilities of frontier AI models.

You will be responsible for managing significant research budgets and personnel, overseeing complex technical research and policy analysis projects, and leading multidisciplinary teams of policy researchers, engineers, and scientists. Your team will build systems to evaluate how AI models perform across the full attack lifecycle, including resource development, initial access, discovery, lateral movement, and defense evasion.

Your projects may include developing benchmarks for fully autonomous operations using scaffolding and tools, as well as uplift of both novice and expert humans. Such benchmarks may involve environments like CTF challenges, frameworks for assessing ability to reason over attack graphs and conduct multi-stage operations, assessment of stealth and defense evasion capabilities, and benchmarks for ability to conduct time-sensitive operations at machine speed.

Many of your evaluations will be commissioned directly by relevant government agencies, and the results of your evaluations will drive responsible AI policy across the world. Your team will communicate findings through detailed technical analyses, evaluation frameworks, and quick-turnaround policy briefs. Your work will shape recommendations for the White House, regulatory agencies, the intelligence community, other national governments, and industry leaders.

This position is structured as a focused two-year appointment to create the urgency needed to drive ambitious change in this rapidly evolving field. Every day of your tenure will count toward achieving ambitious projects in AI security. The appointment may be renewed for an additional year, with options for longer-term employment at RAND thereafter.

RAND's reputation for excellence is built on our commitment to high-quality, rigorous analysis and objectivity. As a Research Lead - AI Cyber Testing & Evaluation, you'll have access to RAND's leading researchers, extensive government and industry connections, and world-class analytical resources.

Qualifications

All research positions require excellent analytic skills; the ability to communicate clearly and effectively, both orally and in writing; the ability to work effectively as a member of a multi-disciplinary team; and a strong commitment to RAND's core values of quality and objectivity.

Required :

  • 6+ years of technical experience in security engineering, software engineering, firmware engineering, hardware engineering, or related fields
  • 6+ years of technical management experience, including leading cross-functional teams, managing project budgets, and mentoring and developing team members
  • Demonstrated ability to successfully lead complex projects to completion
  • Proficiency in Python, Java, C / C++, or other popular programming languages
  • Experience with red team operations or offensive cyber capabilities development
  • Ability to develop rigorous and comprehensive threat models and identify potential system vulnerabilities
  • Strong ability to communicate effectively in English, both verbally and in writing
  • Ability to work effectively in a collaborative, multidisciplinary environment
  • Fluency with MS Office suite

Preferred :

  • Graduate of the Computer Network Operations Development Program (CNODP), Remote Interactive Operator Training (RIOT), Future Operator Readiness Growth and Enrichment (FORGE), or equivalent experience
  • Understanding of advanced persistent threat (APT) tactics, techniques, and procedures (TTPs) and experience with defending against them
  • Ability to think creatively about offensive and / or defensive techniques and strategies, beyond compliance with existing regulations
  • Experience working on AI research, ML model training, or model deployment
  • Education Requirements

    RAND is hiring a Research Lead at either the specialist or expert level of experience. Minimum education requirements at the specialist level include :

  • A PhD in Computer Science, Computer Engineering, Electrical Engineering, Cybersecurity, Information Security, Information Technology, Mathematics, Applied Mathematics, Physics, Applied Physics, Engineering Physics, Artificial Intelligence, Machine Learning, Engineering and Public Policy, Technology and Policy, National Security Policy, Policy Analysis, Political Science, International Relations, or similar with at least 3 years of relevant professional experience is required.
  • OR A Master’s degree in the fields listed above with at least 6 years of relevant professional experience, is required.
  • OR A Bachelor’s degree in the fields listed above with at least 8 years of relevant professional experience, is required.
  • Master’s or PhD preferred.

    Security Clearance

    Ability to obtain and maintain a U.S. government clearance is preferred but not required.

    Location

    We are hiring for this position in San Francisco, CA; Washington, DC; Santa Monica, CA; Pittsburgh, PA; and Boston, MA. We offer a hybrid work arrangement, combining work from home and on-site options. Fully remote work will also be considered.

    Writing or Code Sample

    Either a writing sample or a code sample is required for this position. This sample can use a recent, previously written paper or technical report (e.g., journal article, master's thesis or paper written for coursework, research project, technical analysis, briefings), or source code showing technical expertise in relevant domains.

    Term

    This position is a 2-year term appointment with a possibility of renewal for up to 3 years, alongside options for longer term employment.

    Salary Range

    Salary Range : $137,000 - $246,600

    Visiting Technical Specialist = $137,000 - $209,000

    Visiting Technical Expert = $157,800 - $246,600

    RAND considers a variety of factors when formulating an offer, including but not limited to, the role, responsibilities, experience, and internal equity. The salary range includes base pay plus RAND's sabbatical pay. RAND offers strong benefits including health insurance, life and disability insurance, savings plan, paid time off and more.

    Equal Opportunity Employer

    #J-18808-Ljbffr

    Create a job alert for this search

    Research Lead Ai Cyber Testing Evaluation • Santa Monica, CA, United States

    Related jobs
    • Promoted
    Read allabout it

    Read allabout it

    StaplesWestlake Village, CA, US
    Full-time
    Focus on the main content of the job post, removing all unnecessary metadata, links, buttons, and extraneous details.The goal is to present a clean, beautiful, and high signal to noise ratio versio...Show moreLast updated: 30+ days ago
    • Promoted
    Online Survey Taker. Earn up to $25 per survey. - Remote

    Online Survey Taker. Earn up to $25 per survey. - Remote

    Earn HausAltadena, California, US
    Remote
    Full-time +1
    We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...Show moreLast updated: 30+ days ago
    • Promoted
    Military Intelligence

    Military Intelligence

    NavyAgoura Hills, CA, United States
    Full-time
    ABOUT Effective, secure communication in the cyber domain is essential to the everyday operations of military intelligence in America’s Navy. Information Professionals who oversee the seamless opera...Show moreLast updated: 14 days ago
    • Promoted
    Research Lead - AI Cyber Testing & Evaluation

    Research Lead - AI Cyber Testing & Evaluation

    RAND CorporationSanta Monica, CA, United States
    Temporary
    RAND's Meselson Center, part of the Global and Emerging Risks (GER) division, is seeking an accomplished technical leader to drive our ambitious AI cyber evaluation agenda.As Research Lead - AI Cyb...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Defense Machine Learning Engineer - Remote (Santa Clarita)

    Defense Machine Learning Engineer - Remote (Santa Clarita)

    iO AssociatesSanta Clarita, CA, US
    Remote
    Part-time
    Job Title : Uncleared Machine Learning Engineer - Remote.Our Client is at the forefront of Intelligent Exploration and Enterprise AI with their cutting-edge AI Platform. Operating in a dynamic indust...Show moreLast updated: 16 hours ago
    • Promoted
    • New!
    Research and Development Analyst III-Hybrid

    Research and Development Analyst III-Hybrid

    Logix Federal Credit UnionValencia, CA, United States
    Full-time
    Research and Development Analyst III-Hybrid.Research & Development Analyst III.Ensures integrity and accuracy of data gathering and reporting and communicates results in an informative and effectiv...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Digital Dealer Advisor / Consultant - Eastern Region (Boston, outstate NY area)

    Digital Dealer Advisor / Consultant - Eastern Region (Boston, outstate NY area)

    J.D. PowerWestlake Village, CA, United States
    Full-time
    Digital Dealer Advisor / Consultant - P3.Travel - Eastern Region (Boston, outstate NY area).A pioneer in the use of big data, artificial intelligence (AI) and algorithmic modeling capabilities to und...Show moreLast updated: 8 hours ago
    • Promoted
    Researcher

    Researcher

    The Judge GroupLos Angeles, CA, US
    Temporary
    Our Gaming Client has a Research Moderator opportunity!.Job Title : Moderator Contractor – User Research & Playtest Support. As a Moderator Contractor, you will be part of a cross-functional rese...Show moreLast updated: 23 days ago
    • Promoted
    Lead Generation Specialist

    Lead Generation Specialist

    Catalina Integrative SolutionsGarden Grove, CA, US
    Full-time
    We're Hiring : Lead Generation Specialist.Are you a proactive, detail-oriented professional who loves building pipelines and driving business growth? We're looking for a. Research, identify, and qual...Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Research and Development Analyst Senior-Hybrid

    Research and Development Analyst Senior-Hybrid

    Logix Federal Credit UnionValencia, CA, United States
    Full-time
    Research and Development Analyst Senior-Hybrid.Research & Development Senior Analyst.Research & Development, including but not limited to product management activities, analyses of member and / or co...Show moreLast updated: 8 hours ago
    • Promoted
    Sr. Director, Research ($166,300.00 - $248,700.00)

    Sr. Director, Research ($166,300.00 - $248,700.00)

    Irvine CompanyNewport Beach, CA, United States
    Full-time
    Property : 550 NEWPORT CTR (0003).Location : Newport Beach, CA, 92660.Division : Strategic Planning & Analysis (SP&A).As the Head of Research, this Senior Director role leads the team, has executive-l...Show moreLast updated: 3 days ago
    Project Lead - AI

    Project Lead - AI

    Keywords StudiosLos Angeles, CA, US
    Full-time
    Quick Apply
    USA Remote (Prefer PST Time Zone).This exciting new Lead role focuses on the managing of a 50-person team who are accountable for the training of an AI engine and coordinating work / hand-offs to alt...Show moreLast updated: 16 days ago
    • Promoted
    • New!
    Defense Machine Learning Engineer - Remote

    Defense Machine Learning Engineer - Remote

    iO AssociatesLong Beach, CA, United States
    Remote
    Full-time
    Job Title : Uncleared Machine Learning Engineer - Remote.Our Client is at the forefront of Intelligent Exploration and Enterprise AI with their cutting-edge AI Platform. Operating in a dynamic indust...Show moreLast updated: 20 hours ago
    • Promoted
    Project Manager with AI / ML

    Project Manager with AI / ML

    Cynet SystemsWoodland Hills, CA, US
    Full-time
    Responsibilities : Own and manage the full project lifecyclefrom initiation to deliveryacross multiple, concurrent AI product development workstreams. Create and maintain detailed project plans, sche...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Manager, CRM AI Transformation

    Senior Manager, CRM AI Transformation

    EbayBurbank, CA, US
    Full-time
    Senior Manager, CRM AI Transformation.At eBay, we are more than a global ecommerce leader we are changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in ...Show moreLast updated: 9 days ago
    • Promoted
    UX Researcher

    UX Researcher

    Insight GlobalSanta Monica, CA, United States
    Temporary
    This is a short-term contract with a research company, from October until the end of the year.Experience with in-person moderation. Data collection prior experience is preferred (ex : coordinators, i...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Market Research Contributor

    Market Research Contributor

    Prime InsightsSan Marino, California, US
    Full-time
    Join thousands of members already earning with top-paying surveys and offers.Get started today and enjoy competitive rewards, fast payouts with no waiting periods, and the flexibility to participat...Show moreLast updated: less than 1 hour ago
    • Promoted
    Research Director, Gaming

    Research Director, Gaming

    Loaded, LLCSanta Monica, CA, United States
    Full-time
    We Are Looking for a Research Director, Gaming.Open World is a full-service community-minded marketing agency focused on connecting brands and developers with gamers around the world.Our Research &...Show moreLast updated: 24 days ago