Talent.com
Research ScientistEngineer, Model Threat Defense
Research ScientistEngineer, Model Threat DefenseDeepMind • Mountain View, California, USA
Research ScientistEngineer, Model Threat Defense

Research ScientistEngineer, Model Threat Defense

DeepMind • Mountain View, California, USA
1 day ago
Job type
  • Full-time
Job description

Snapshot

Artificial Intelligence could be one of humanitys most useful inventions. At Google DeepMind were a team of scientists engineers machine learning experts and more working together to advance the state of the art in artificial intelligence. We use our technologies for widespread public benefit and scientific discovery and collaborate with others on critical challenges ensuring safety and ethics are the highest priority.

About Us

Model distillation is a key innovation enabling the acceleration of AI turning large general models into small and specialized models used across the industry. However distillation techniques can also be used to steal critical model capabilities representing a significant threat to the intellectual property and integrity of our foundational models.

The Role

As part of the Security & Privacy Research Team at Google DeepMind you will take on a holistic role in securing our AI assets. You will both identify unauthorized distillation attempts and actively harden our models against distillation. This is a unique opportunity to contribute to the full lifecycle of defense for the Gemini family of models. You will be at the forefront detecting threats in the wild and building resilience into our models.

Key Responsibilities

  • Research Defense Strategies : Research techniques to detect distillation and techniques to actively defend against distillation.
  • Deploy Detection & Mitigation Systems : Design and build systems that detect abd mitigate unauthorized capability extraction.
  • Evaluate Impact : Rigorously measure the effectiveness of defense mechanisms balancing the trade-offs between model robustness defensive utility and core model performance.
  • Collaborate and Publish : Work closely with world-class researchers across GDM Google and the industry to publish groundbreaking work establish new benchmarks and set the standard for responsible AI defense.

About You

We are looking for a creative and rigorous research scientist research engineer or software engineer who is passionate about trailblazing the critical field of model defense. You thrive on ambiguity and are comfortable working across the spectrum of securityfrom thinking like an adversary to building proactive protections. You are driven to build robust systems that protect the future of AI development.

Minimum qualifications :

  • Ph.D. in Computer Science or a related quantitative field or a B.S. / M.S. in a similar field with 2 years of relevant industry experience.
  • Demonstrated research or product expertise in a field related to model security adversarial ML post-training or model evaluation.
  • Experience designing and implementing large-scale ML systems or counter-abuse infrastructure.
  • Preferred qualifications :

  • Deep expertise in one or more of the following areas : model distillation model stealing security memorization Reinforcement Learning Supervised Fine-Tuning or Embeddings.
  • Proven experience in Adversarial Machine Learning with a focus on designing and implementing model defenses.
  • Strong software engineering skills and experience with ML frameworks like JAX PyTorch or TensorFlow.
  • A track record of landing research impact or shipping production systems in a multi-team environment.
  • Current or prior US security clearance.
  • The US base salary range for this full-time position is between $166000 - $244000 bonus equity benefits. Your recruiter can share more about the specific salary range for your targeted location during the hiring process.

    At Google DeepMind we value diversity of experience knowledge backgrounds and perspectives and harness these qualities to create extraordinary impact. We are committed to equal employment opportunity regardless of sex race religion or belief ethnic or national origin disability age citizenship marital domestic or civil partnership status sexual orientation gender identity pregnancy or related condition (including breastfeeding) or any other basis as protected by applicable law. If you have a disability or additional need that requires accommodation please do not hesitate to let us know.

    Key Skills

    Laboratory Experience,Machine Learning,Python,AI,Bioinformatics,C / C++,R,Biochemistry,Research Experience,Natural Language Processing,Deep Learning,Molecular Biology

    Employment Type : Full Time

    Experience : years

    Vacancy : 1

    Monthly Salary Salary : 166000 - 244000

    Create a job alert for this search

    Model • Mountain View, California, USA

    Related jobs
    Threat Modeler Lead

    Threat Modeler Lead

    OpenAI • San Francisco, CA, United States
    Full-time
    The Safety Systems team is responsible for various safety work to ensure our best models can be safely deployed to the real world to benefit the society and is at the forefront of OpenAI's mission ...Show more
    Last updated: 11 hours ago • Promoted • New!
    Research Engineer / Scientist, Safety Oversight

    Research Engineer / Scientist, Safety Oversight

    OpenAI • San Francisco, CA, United States
    Full-time
    OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency. The Safety Oversight Research team aims to fundamentally advance...Show more
    Last updated: 30+ days ago • Promoted
    Founding Research Engineer (Security)

    Founding Research Engineer (Security)

    Greylock Partners • Redwood City, CA, United States
    Full-time
    Be among the first 25 applicants.Early-stage, cybersecurity investment (valued over $100M at Seed), founded by a successful serial entrepreneur, is looking to hire a Founding Research with a strong...Show more
    Last updated: 9 days ago • Promoted
    Research Engineer / Research Scientist, Alignment

    Research Engineer / Research Scientist, Alignment

    OpenAI • San Francisco, CA, United States
    Full-time
    Research Engineer / Research Scientist, Alignment | OpenAI.Research Engineer / Research Scientist, Alignment.Apply now (opens in a new window). The Alignment team at OpenAI is dedicated to ensuring ...Show more
    Last updated: 30+ days ago • Promoted
    Research Engineer / Scientist, Interpretability

    Research Engineer / Scientist, Interpretability

    OpenAI • San Francisco, CA, United States
    Full-time
    The Interpretability team studies internal representations of deep learning models.We are interested in using representations to understand model behavior, and in engineering models to have more un...Show more
    Last updated: 30+ days ago • Promoted
    Sr. Research and Development Technician, Advanced Development

    Sr. Research and Development Technician, Advanced Development

    Calyxo, Inc. • Pleasanton, CA, United States
    Full-time
    The company was founded in 2016 to address the profound need for improved kidney stone treatment.Kidney stone disease is a common, painful condition that consumes vast amounts of healthcare resourc...Show more
    Last updated: 30+ days ago • Promoted
    ML Research Scientist & Engineer (Reasoning & Prototyping)

    ML Research Scientist & Engineer (Reasoning & Prototyping)

    Scale AI • San Francisco, CA, United States
    Full-time
    An innovative firm is seeking a Machine Learning Research Scientist / Engineer to join their dynamic team.You will leverage your expertise in large language models and frameworks like PyTorch and Ten...Show more
    Last updated: 3 days ago • Promoted
    Research Scientist / Engineer – Training Infrastructure

    Research Scientist / Engineer – Training Infrastructure

    IntelliPro Group Inc. • Palo Alto, CA, US
    Full-time
    Quick Apply
    Research Scientist / Engineer – Training Infrastructure Position Type : Full time Location : Palo Alto, CA • Remote - US • Remote - International Salary Range : $220,000 - $300...Show more
    Last updated: 30+ days ago
    Research Engineer - ML Sys & Infra

    Research Engineer - ML Sys & Infra

    Storm3 • San Francisco, CA, United States
    Full-time
    This range is provided by Storm3.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Direct message the job poster from Storm3.Research Engineer - M...Show more
    Last updated: 9 days ago • Promoted
    Lead Research Engineer / Scientist, Chemical & Biological Risk

    Lead Research Engineer / Scientist, Chemical & Biological Risk

    OpenAI • San Francisco, CA, United States
    Full-time
    The Safety Systems team is responsible for various safety work to ensure our best models can be safely deployed to the real world to benefit society and is at the forefront of OpenAI's mission to b...Show more
    Last updated: 30+ days ago • Promoted
    Research Engineer / Scientist, Model Welfare

    Research Engineer / Scientist, Model Welfare

    Menlo Ventures • San Francisco, CA, United States
    Full-time
    Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...Show more
    Last updated: 11 days ago • Promoted
    Machine Learning Research Scientist / Research Engineer, Post-Training

    Machine Learning Research Scientist / Research Engineer, Post-Training

    Scale AI, Inc. • San Francisco, CA, United States
    Full-time
    Scale works with the industry's leading AI labs to provide high quality data and accelerate progress in GenAI research.We are looking for Research Scientists and Research Engineers with expertise i...Show more
    Last updated: 30+ days ago • Promoted
    Research Engineer / Scientist, Pretraining Safety

    Research Engineer / Scientist, Pretraining Safety

    OpenAI • San Francisco, CA, United States
    Full-time
    Research Engineer / Scientist, Pretraining Safety.Get AI-powered advice on this job and more exclusive features.The Safety Systems team is responsible for various safety work to ensure our best mod...Show more
    Last updated: 7 days ago • Promoted
    Research Scientist / Engineer

    Research Scientist / Engineer

    Waabi • San Francisco, CA, United States
    Full-time
    Waabi, founded by AI pioneer Raquel Urtasun, is an.AI company building the next generation of self-driving technology.With a world-class team and an innovative approach, Waabi aims to bring self-dr...Show more
    Last updated: 8 days ago • Promoted
    Research Engineer / Research Scientist, RL / Reasoning

    Research Engineer / Research Scientist, RL / Reasoning

    OpenAI • San Francisco, CA, United States
    Full-time
    The RL and Reasoning team drives the core reasoning paradigm and has created groundbreaking innovations such as o1 and o3. They focus on pushing the boundaries of reinforcement learning research, bu...Show more
    Last updated: 30+ days ago • Promoted
    Machine Learning Research Lead, Security & Policy Research Lab

    Machine Learning Research Lead, Security & Policy Research Lab

    Scale AI, Inc. • San Francisco, CA, United States
    Full-time
    As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and systems.Building on this expertis...Show more
    Last updated: 30+ days ago • Promoted
    Research Scientist, Tech Lead Manager, Model Threat Mitigation

    Research Scientist, Tech Lead Manager, Model Threat Mitigation

    Google DeepMind • San Francisco, CA, United States
    Full-time
    Artificial Intelligence could be one of humanity’s most useful inventions.At Google DeepMind, we’re a team of scientists, engineers, machine learning experts and more, working together to advance t...Show more
    Last updated: 9 days ago • Promoted
    Research Engineer / Scientist, Post-Training

    Research Engineer / Scientist, Post-Training

    Letta • San Francisco, CA, United States
    Full-time
    Solving Self-Improving Superintelligence.Today’s AI brains are brittle and rigid.At Letta, we’re building self-improving artificial intelligence : creating agents that continually learn from experie...Show more
    Last updated: 29 days ago • Promoted