Talent.com
No longer accepting applications
Research Engineer / Scientist, Tool Use Safety

Research Engineer / Scientist, Tool Use Safety

The Rundown AI, Inc.San Francisco, CA, United States
10 days ago
Job type
  • Full-time
Job description

About the team

The Tool Use Team within Research is responsible for making Claude the world's most capable, safe, reliable, and efficient model for tool use and agentic applications. The team focuses on the foundational layer - solving core problems such as tool use safety (e.g. prompt injection robustness), tool call accuracy, long horizon & complex tool use workflow, large scale & dynamic tools, and tool use efficiency. These are foundations to the majority of Anthropic’s customers as well as internal teams building specific agentic applications such as Claude for Chrome, Computer Use, Claude Code, Search.

About the role

We're looking for Research Engineers / Scientists to help us advance the frontier of safe tool use. With tool use adoption accelerating rapidly across our platform, the next generation requires even more breakthrough research to enable us to scale responsibly : for example, training Claude to be extremely robust against sophisticated prompt injection, preventing data exfiltration attempts through tool misuse, defending against adversarial attacks in realistic multi-turn agent conversations, and ensuring safety when agents operate autonomously for longer horizons with access to a large number of tools.

You\'ll collaborate with a diverse group of researchers and engineers to advance safe tool use in Claude. You\'ll own the full research lifecycle—from identifying fundamental limitations to implementing solutions that ship in production models. This work is critical for derisking our model’s increasing capabilities and empowering Claude to more autonomously assist users.

Note : For this role, we conduct all interviews in Python.

Responsibilities :

  • Design and implement novel and scalable reinforcement learning methodologies that push the state of the art of tool use safety
  • Define and pursue research agendas that push the boundaries of what\'s possible
  • Build rigorous, realistic evaluations that capture the complexity of real-world tool use safety challenges
  • Ship research advances that directly impact and protect millions of users
  • Collaborate with other safety research (e.g. Safeguards, Alignment Science), capabilities research, and product teams to drive fundamental breakthroughs in safety, and work with teams to ship these into production
  • Design, implement, and debug code across our research and production ML stacks
  • Contribute to our collaborative research culture through pair programming, technical discussions, and team problem-solving

You may be a good fit if you :

  • Passionate about our safety mission
  • Are driven by real-world impact and excited to see research ship in production
  • Have strong machine learning research / applied-research experience, or a strong quantitative background such as physics, mathematics, or quantitative finance research
  • Write clean, reliable code and have solid software engineering skills
  • Communicate complex ideas clearly to diverse audiences
  • Are hungry to learn and grow, regardless of years of experience
  • Strong candidates may also have one or more of the following :

  • Experience with tool use / agentic safety, trust & safety, or security
  • Experience with reinforcement learning techniques and environments
  • Experience with language model training, fine-tuning or evaluation
  • Experience building AI agents or autonomous systems
  • Published influential work in relevant ML areas, especially around LLM safety & alignment
  • Deep expertise in a specialized area (e.g., RL, security, or mathematical foundations), even if still developing breadth in adjacent areas
  • Experience shipping features or working closely with product teams
  • Enthusiasm for pair programming and collaborative research
  • #J-18808-Ljbffr

    Create a job alert for this search

    Research Scientist • San Francisco, CA, United States

    Related jobs
    • Promoted
    Principal Machine Learning Engineer, Trust & Safety

    Principal Machine Learning Engineer, Trust & Safety

    PinterestSan Francisco, CA, United States
    Full-time
    Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we're on a mission to br...Show moreLast updated: 30+ days ago
    • Promoted
    Lead AI Engineer

    Lead AI Engineer

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Lead AI Engineer to architect and deploy machine learning and AI systems across its payments platform. Key Responsibilities Lead the design, development, and deployment ...Show moreLast updated: 30+ days ago
    • Promoted
    Blue Team Security Engineer

    Blue Team Security Engineer

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Security Engineer, Blue Team.Key Responsibilities Conduct security risk assessments of third parties and evaluate supplier security risks Build security tooling and au...Show moreLast updated: 1 day ago
    • Promoted
    Senior Cyber Threat Engineer

    Senior Cyber Threat Engineer

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Senior Cyber Threat Detection Engineer, remote position.Key Responsibilities Lead the development and maintenance of high-fidelity detection rules to identify security ...Show moreLast updated: 30+ days ago
    • Promoted
    Compliance Engineer

    Compliance Engineer

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Compliance Engineer to lead RF certification and regulatory compliance for cellular and connected hardware products. Key Responsibilities Lead and support RF certificati...Show moreLast updated: 19 days ago
    • Promoted
    Sr. Systems Safety Engineer

    Sr. Systems Safety Engineer

    Reliable RoboticsMountain View, CA, United States
    Permanent
    We're building safety-enhancing technology for aviation that will save lives.Automated aviation systems will enable a future where air transportation is safer, more convenient and fundamentally tra...Show moreLast updated: 30+ days ago
    • Promoted
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Senior AI-ML Engineer to lead the design and optimization of AI / ML infrastructure.Key Responsibilities Design, build, and maintain scalable and automated data pipelines...Show moreLast updated: 30+ days ago
    • Promoted
    ML Research Engineer, ML Systems

    ML Research Engineer, ML Systems

    Scale AI, Inc.San Francisco, CA, United States
    Full-time
    Scale's ML platform (RLXF) team builds our internal distributed framework for large language model training and inference. The platform has been powering MLEs, researchers, data scientists and opera...Show moreLast updated: 30+ days ago
    • Promoted
    Usability Researcher

    Usability Researcher

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Usability Researcher to shape the future of a social and communications platform for large enterprises. Key Responsibilities Lead research efforts including usability te...Show moreLast updated: 30+ days ago
    • Promoted
    Senior AI Research Engineer

    Senior AI Research Engineer

    VirtualVocationsHayward, California, United States
    Full-time
    A company is looking for a Senior Generative AI Research Engineer to advance the field of AI computing.Key Responsibilities Design and post-train foundation models for real-world applications Co...Show moreLast updated: 10 days ago
    • Promoted
    Epic Beaker Build Advisor

    Epic Beaker Build Advisor

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Beaker Laboratory Build Advisor for Epic Implementation.Key Responsibilities Evaluate the current Beaker build, workflows, and configuration to identify areas for impro...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Applied AI / ML Engineer

    Applied AI / ML Engineer

    Catalyst LabsMenlo Park, CA, US
    Full-time
    Catalyst Labs is a leading talent agency with a specialized vertical in Applied AI, Machine Learning, and Data Science.We stand out as an agency thats deeply embedded in our clients recruitment ope...Show moreLast updated: 1 hour ago
    • Promoted
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    MeltwaterRedwood City, CA, United States
    Full-time
    Meltwater's Consumer Intelligence AI Team is looking for a.Natural Language Processing or Computer Vision features relying on the literature's state of the art. Those features are meant to be integr...Show moreLast updated: 6 days ago
    • Promoted
    Sr. Staff Engineer

    Sr. Staff Engineer

    Bio-Rad LaboratoriesPleasanton, CA, United States
    Full-time
    You'll drive the development of hardware products that directly impact healthcare innovation and improve lives worldwide. You'll collaborate cross-functionally to.Your expertise in electrical engine...Show moreLast updated: 30+ days ago
    • Promoted
    Senior ML Scientist

    Senior ML Scientist

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Senior ML Scientist to develop automated methods for tagging data collected by autonomous vehicles. Key Responsibilities Design, implement, and deploy machine learning m...Show moreLast updated: 2 days ago
    • Promoted
    Principal AI / ML Engineer, Security AI

    Principal AI / ML Engineer, Security AI

    Cisco Systems, Inc.San Jose, CA, United States
    Full-time
    The Cisco Security AI team delivers AI products and platform for all Cisco secure products and portfolios so businesses around the world can defend against threats and safeguard the most vital aspe...Show moreLast updated: 6 days ago
    • Promoted
    Sr. AI / ML Engineer

    Sr. AI / ML Engineer

    VectraSan Jose, CA, United States
    Full-time
    Vectra is the leader in AI-driven threat detection and response for hybrid and multi-cloud enterprises.The Vectra AI Platform delivers integrated signal across public cloud, SaaS, identity, and dat...Show moreLast updated: 24 days ago
    • Promoted
    Adversary Emulation Engineer

    Adversary Emulation Engineer

    VirtualVocationsHayward, California, United States
    Full-time
    A company is looking for an Adversary Emulation & Defense Engineer.Key Responsibilities : Plan and execute purple team exercises to emulate adversary tactics across the attack lifecycle Develop a...Show moreLast updated: 2 days ago
    • Promoted
    Senior AI MLOps Engineer

    Senior AI MLOps Engineer

    VirtualVocationsHayward, California, United States
    Full-time
    A company is looking for a Senior AI MLOps Engineer, Education Services.Key Responsibilities Develop and deliver interactive training sessions on AI and MLOps platforms Create innovative trainin...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    AI Red Team Engineer

    AI Red Team Engineer

    VirtualVocationsHayward, California, United States
    Full-time
    A company is looking for an AI Red Team Engineer - Dutch.Key Responsibilities Collaborate on adversarial testing of AI systems, including LLMs and multimodal models Craft prompts and scenarios t...Show moreLast updated: 14 hours ago