Talent.com
Responsible AI Data Scientist - AI Red Teamer

Responsible AI Data Scientist - AI Red Teamer

Salesforce, Inc..San Francisco, CA, United States
Hace más de 30 días
Tipo de contrato
  • A tiempo completo
Descripción del trabajo

Salesforce’s Office of Ethical and Humane Use is seeking an experienced responsible AI data scientist with an adversarial approach and experience conducting ethical red teaming to contribute to our ethical red teaming practice. In this role, you will help us gain a deep understanding of how our models and products may be leveraged by malign actors or through unanticipated use to cause harm. In addition to adversarial testing, you will analyze current safety trends, and develop solutions to detect and mitigate risk, while working cross-functionally with security, engineering, data science, and AI Research teams. You will bring technical depth to the assessment of AI products, models, and applications, in order to identify the best technical mitigations to identified risks.

The ideal candidate will have technical experience in generative as well as predictive artificial intelligence and in responsible / ethical AI

Responsibilities :

  • Adversarial Testing

Provide technical leadership in designing, prototyping, and implementing comprehensive adversarial testing strategies, including both automated and manual adversarial testing approaches

  • Mentor and guide collaborator teams on adversarial testing standard processes, helping them develop the skills to conduct their own testing effectively
  • Collaborate with cross-functional teams to integrate OEHU adversarial testing frameworks into the AI development lifecycle
  • Safety and Robustness
  • Contribute to the development of detection models, safety guardrails, and other proactive measures to prevent and mitigate risks posed by bad actors

  • Research and implement innovative techniques for enhancing AI safety and robustness, drawing from both open-source and internal tools
  • Collaborate with Salesforce’s AI Research team on novel approaches to model safety
  • Technical Research and Implementation
  • Write clean, efficient, and well-documented code (primarily in Python) to support research efforts and facilitate the evaluation of AI systems

  • Develop and maintain a repository of reusable code modules and libraries to streamline adversarial testing processes
  • Testing Execution and Collaboration
  • Participate in scoping, documenting, and implementing tests with partner teams, including the implementation of mitigations identified during testing

  • Test for technical vulnerabilities, model vulnerabilities, and harm / abuse including but not limited to bias, toxicity, and inaccuracy
  • Participate in labeling test data in partnership with OEHU and partner teams
  • Reporting, Documentation, and Continuous Learning
  • Write reports covering the goals and outcomes of testing operations, including significant observations and recommendations

  • Continuously monitor and analyze emerging threats and vulnerabilities to inform the development of adaptive safety measures
  • Continue to grow expertise in model safety by keeping up with research in socio-technical systems, privacy, interpretability / explainability, robustness, alignment, and responsible AI
  • Qualifications :

  • 3-5 years of industry experience in Software Engineering, AI ethics, AI research, Applied research, ML, DS, or similar roles
  • Demonstrated ability to think adversarially, ability to anticipate how malicious actors might misuse AI systems and develop corresponding test scenarios
  • Experience creating heuristic-based detection logic and rules for identifying anomalous or suspicious activity in production systems and networks (e.g. log analysis, user behavior analytics)
  • Experience with problem-solving and troubleshooting sophisticated issues with an emphasis on root-cause analysis
  • Experience in analyzing sophisticated, large-scale data sets and communicating findings to technical and non-technical audiences
  • Proven organizational and execution skills within a fast-paced, multi-stakeholder environment
  • Experience working in a technical environment with a broad, cross-functional team to get results, define requirements, coordinate assets from other groups (design, legal, etc.), and deliver key achievements
  • Excellent written and oral communication skills, as well as social skills, including the ability to articulate technical concepts to both technical and non-technical audiences.
  • Works well under pressure, and is comfortable working in a fast-paced, ever-changing environment
  • Experience using SQL and relational databases. Ability to use Python, R, or other scripting languages to perform data analysis at scale
  • A related technical degree required
  • Preferred Qualifications :

  • Industry experience in AI red-teaming, implemented manual, or semi-automated, or automated adversarial testing approach in production system
  • Experienced with specific AI attack methodologies (prompt injection, model extraction, adversarial examples, etc.)
  • In office expectations are 36 days / a quarter to support customers and / or collaborate with their teams.

    #J-18808-Ljbffr

    Crear una alerta de empleo para esta búsqueda

    Data Scientist • San Francisco, CA, United States

    Ofertas relacionadas
    • Oferta promocionada
    Senior Machine Learning Scientist, AI for Drug Discovery (Frontier Research)

    Senior Machine Learning Scientist, AI for Drug Discovery (Frontier Research)

    GenentechSan Francisco, CA, United States
    A tiempo completo
    It’s what drives us to innovate.To continuously advance science and ensure everyone has access to the healthcare they need today and for generations to come. Creating a world where we all have more ...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    Senior Data Scientist - AI Products

    Senior Data Scientist - AI Products

    DishFoster City, CA, United States
    A tiempo completo
    EchoStar is reimagining the future of connectivity.Our business reach spans satellite television service, live-streaming and on-demand programming, smart home installation services, mobile plans an...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    • Nueva oferta
    Senior Data Scientist, AI Products

    Senior Data Scientist, AI Products

    DropboxSan Francisco, CA, United States
    A tiempo completo
    How many times do you get the opportunity to be on the ground floor of a big and important mission? What if you could be one of the top contributors defining the mission, guiding our teams, and inf...Mostrar másÚltima actualización: hace 13 horas
    • Oferta promocionada
    Applied Science Manager, Sales AI

    Applied Science Manager, Sales AI

    AmazonPalo Alto, CA, US
    A tiempo completo
    Are you interested in shaping the future of Advertising and B2B Sales? We are a growing science and engineering team with an exciting charter and need your passion, innovative thinking, and creativ...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    AI Research Scientist

    AI Research Scientist

    HumSan Francisco, CA, United States
    A tiempo completo
    Coastal Carbon is a seed-funded startup on a mission to create positive impact through earth observation and AI.Founded at the University of Waterloo by a team of PhDs and engineers, we’re backed b...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    Data Scientist, Generative AI - IFS Copperleaf

    Data Scientist, Generative AI - IFS Copperleaf

    IFSSan Francisco, CA, US
    A tiempo completo
    IFS is a billion-dollar revenue company with 7000+ employees on all continents.Our leading AI technology is the backbone of our award-winning enterprise software solutions, enabling our customers t...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    Founding Team Lead, AI Research Engineering

    Founding Team Lead, AI Research Engineering

    AdyenSan Francisco, CA, United States
    A tiempo completo
    Founding Team Lead, AI Research Engineering.Adyen is the financial technology platform of choice for leading businesses, providing payments, data, and financial products in a single solution for gl...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    Senior Staff Data Scientist, Research, Search Platforms

    Senior Staff Data Scientist, Research, Search Platforms

    Google Inc.Mountain View, CA, United States
    A tiempo completo
    Senior Staff Data Scientist, Research, Search Platforms.Mountain View, CA, USA ; Cambridge, MA, USA.Experience owning outcomes and decision making, solving ambiguous problems and influencing stakeh...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    AI Data Scientist

    AI Data Scientist

    PeppermillSan Francisco, CA, United States
    A tiempo completo
    Department : Software Development / Engineering.We are looking for a talented and driven AI Data Scientist to join our dynamic team working to make AI accessible to all. In this role, you will help us ...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    Responsible AI Data Scientist - AI Red Teamer

    Responsible AI Data Scientist - AI Red Teamer

    Salesforce, Inc.Palo Alto, CA, United States
    A tiempo completo
    To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job CategoryDataJob Details • • • •About Salesforce • • •...Mostrar másÚltima actualización: hace 1 día
    • Oferta promocionada
    Senior Data Scientist, Research, AI Mode

    Senior Data Scientist, Research, AI Mode

    Google Inc.Mountain View, CA, United States
    A tiempo completo
    Senior Data Scientist, Research, AI Mode.Mountain View, CA, USA; New York, NY, USA.Note : By applying to this position you will have an opportunity to share your preferred working location from the ...Mostrar másÚltima actualización: hace 1 día
    • Oferta promocionada
    AI Researcher

    AI Researcher

    PromiseOakland, CA, US
    Indefinido
    Promise modernizes how government agencies and utilities support people in financial difficulty.We build technology that makes it simple for residents to receive benefits, engage with assistance pr...Mostrar másÚltima actualización: hace 14 días
    • Oferta promocionada
    Data Scientist (Gen AI)

    Data Scientist (Gen AI)

    Proximity WorksPalo Alto, CA, United States
    A tiempo completo
    We’re seeking a highly skilled, execution-focused Data Scientist with 4–10 years of experience to join our team.This role demands hands-on expertise in fine-tuning and deploying generative AI model...Mostrar másÚltima actualización: hace más de 30 días
    • Oferta promocionada
    Founding Fullstack Engineer

    Founding Fullstack Engineer

    Strativ GroupSan Mateo County, CA, US
    A tiempo completo
    F680; Founding Fullstack Engineer (Frontend Leaning) – AI Agent for Data Science.San Mateo, CA (Hybrid, 2–3 days / week onsite). Up to $230,000 + meaningful equity.Seed| ~15-person team | ...Mostrar másÚltima actualización: hace 1 día
    • Oferta promocionada
    Senior Data Scientist, AI Foundations

    Senior Data Scientist, AI Foundations

    Capital One National AssociationSan Jose, CA, United States
    A tiempo completo +1
    Senior Data Scientist, AI Foundations.Data is at the center of everything we do.As a startup, we disrupted the credit card industry by personally personalizing every offer using statistical modelin...Mostrar másÚltima actualización: hace 16 días
    • Oferta promocionada
    Data and AI Engineer

    Data and AI Engineer

    Nue.io CareersSan Mateo, CA, US
    A tiempo completo
    Why you'll love this NUE opportunity!.We’re looking for a highly motivated and enthusiastic.Nue's platform systems and scale them to the next level. Our architecture is proven and robu...Mostrar másÚltima actualización: hace 1 día
    • Oferta promocionada
    Senior Data Scientist - AI / ML Engineer

    Senior Data Scientist - AI / ML Engineer

    Altimate.aiSunnyvale, CA, US
    A tiempo completo
    Altimate AI, founded in 2022 in San Francisco, is revolutionizing enterprise data operations through the power of AI.Our mission is to alleviate the burden on overworked and understaffed enterprise...Mostrar másÚltima actualización: hace 28 días
    • Oferta promocionada
    • Nueva oferta
    Senior Data Scientist, Research, Generative AI Factuality

    Senior Data Scientist, Research, Generative AI Factuality

    Google Inc.Mountain View, CA, United States
    A tiempo completo
    Senior Data Scientist, Research, Generative AI Factuality.Google, Mountain View, CA, USA.Master's degree in Statistics, Data Science, Mathematics, Physics, Economics, Operations Research, Engineeri...Mostrar másÚltima actualización: hace 8 horas
    • Oferta promocionada
    Senior User Researcher & AI Research Operations

    Senior User Researcher & AI Research Operations

    Study.comMountain View, CA, US
    A tiempo completo
    Our mission is to open the door to the life-changing impact of education and help make education accessible for all.As a nimble growth stage start-up, we've emerged as the leading online educat...Mostrar másÚltima actualización: hace 10 días
    • Oferta promocionada
    AI Researcher

    AI Researcher

    Amplifier HealthSan Francisco, CA, US
    A tiempo completo
    Amplifier Health is revolutionizing healthcare by turning the human voice into a vital sign.We're developing the world's first voice-based diagnostic platform that can detect and monitor a ...Mostrar másÚltima actualización: hace más de 30 días