Talent.com
AI Agent Monitoring & Evaluation Scientist
AI Agent Monitoring & Evaluation ScientistDatagrid • San Francisco, California, United States
AI Agent Monitoring & Evaluation Scientist

AI Agent Monitoring & Evaluation Scientist

Datagrid • San Francisco, California, United States
14 days ago
Job type
  • Full-time
Job description

A growing AI technology company in San Francisco is seeking a Data Scientist focused on AI Agent Monitoring & Evaluation. You will build evaluation frameworks and monitoring tools for AI agents, ensuring quality and reliability across multiple systems. The ideal candidate has 3-7 years of experience in data science and is skilled in ML systems and dashboarding practices. A competitive salary range of $125,000 - $185,000 is offered, along with generous benefits and a flexible work environment.

#J-18808-Ljbffr

Create a job alert for this search

Ai Scientist • San Francisco, California, United States

Similar jobs
Principal AI Scientist - Advertiser Growth

Principal AI Scientist - Advertiser Growth

Amazon • San Francisco, CA, United States
Full-time
A leading e-commerce company is looking for a Principal Applied Scientist to lead a team in developing innovative AI solutions for advertisers in San Francisco. This role involves managing a roadmap...Show more
Last updated: 30+ days ago • Promoted
Senior Director, Data and AI Architecture Leader

Senior Director, Data and AI Architecture Leader

Dynavax Technologies • Emeryville, CA, United States
Full-time
This position can be 100% remote, but must be located in the United States.Dynavax is a commercial-stage biopharmaceutical company developing and commercializing novel vaccines to help protect the ...Show more
Last updated: 30+ days ago • Promoted
Aviation Electronics, Electrical & Computer Systems Technician

Aviation Electronics, Electrical & Computer Systems Technician

U.S. Navy • Sausalito, CA, US
Full-time
ABOUT Aviation Electronics, Electrical, and Computer Systems Technicians (AV) work on some of the most advanced aircraft systems in the world. They maintain, diagnose, and repair complex electrical ...Show more
Last updated: 2 hours ago • Promoted • New!
Scientist

Scientist

Bruker • Emeryville, CA, United States
Full-time
At Bruker Cellular Analysis (BCA), we create products using advanced optofluidic technology that enable customers to interrogate and recover individual cells for downstream molecular analysis.Our p...Show more
Last updated: 30+ days ago • Promoted
Senior Data Scientist - AI Evaluation & Equity

Senior Data Scientist - AI Evaluation & Equity

Arena Inteliigence • San Francisco, CA, United States
Full-time
A leading AI evaluation firm is looking for a Senior Data Scientist to explore data that powers AI evaluations.You will analyze complex datasets, conduct experiments, and collaborate with ML resear...Show more
Last updated: 12 days ago • Promoted
Applied Scientist III

Applied Scientist III

Capital Group • San Francisco, CA, United States
Full-time
I can succeed as an Applied Scientist III at Capital Group.As an Applied Scientist III, you will play a pivotal role in shaping the future of AI at Capital Group and help to establish the GenAI str...Show more
Last updated: 30+ days ago • Promoted
Data Science Engineer

Data Science Engineer

Lawrence Berkeley National Laboratory • Berkeley, CA, United States
Full-time
Lawrence Berkeley National Laboratory is hiring a Data Science Engineer within the Scientific Data division.Computational Biosciences Group. CSE2) in the area of multi-modal data modeling and analys...Show more
Last updated: 10 days ago • Promoted
Assistant / Associate Project Scientist - Behavioral Neurophysiology - Helen Wills Neuroscience Institute

Assistant / Associate Project Scientist - Behavioral Neurophysiology - Helen Wills Neuroscience Institute

University of California-Berkeley • Berkeley, CA, United States
Full-time
Assistant Project Scientist, Associate Project Scientist .The UC academic salary scales set the minimum pay determined by rank and step at appointment. See the following table(s) for the current s...Show more
Last updated: 17 days ago • Promoted
Healthcare AI Scientist : LLM Agents & Data Innovation

Healthcare AI Scientist : LLM Agents & Data Innovation

Verily • San Bruno, CA, United States
Full-time
A health technology company is seeking a Data Scientist - AI Agent to support innovations in data-driven healthcare.This hybrid position requires advanced expertise in AI and ML, with responsibilit...Show more
Last updated: 17 days ago • Promoted
Senior Clinical Scientist, Rare Disease (PhD)

Senior Clinical Scientist, Rare Disease (PhD)

CSG Talent • San Mateo County, CA, United States
Full-time
Senior Clinical Scientist, Rare Disease (PhD).Biologics License Application (BLA) submission.Breakthrough Therapy-designated biologic. This role will contribute to late-stage clinical development, s...Show more
Last updated: 19 days ago • Promoted
Founding AI Research Scientist

Founding AI Research Scientist

DimRed • San Francisco, CA, United States
Full-time
DimRed is building a platform to automate the most challenging parts of scaling AI Agents and LLM-based systems.We believe the path forward for AI systems is grounded in reliability and interpretab...Show more
Last updated: 30+ days ago • Promoted
AI Research Scientist — Agentic & Multimodal Systems

AI Research Scientist — Agentic & Multimodal Systems

Salesforce, Inc. • San Francisco, CA, United States
Full-time
A leading technology company is seeking AI Research Scientists / Research Engineers to drive innovation and tackle enterprise-level problems through AI. Successful candidates will have a strong backgr...Show more
Last updated: 13 days ago • Promoted
Research Scientist : AI Agents & LLMs (Hybrid, SF)

Research Scientist : AI Agents & LLMs (Hybrid, SF)

Goliath Partners • San Francisco, CA, United States
Full-time
A leading research firm in San Francisco is looking for a Research Scientist to join their expanding Research Group.The ideal candidate will have a PhD in relevant fields and 2+ years' experience w...Show more
Last updated: 18 days ago • Promoted
Assistant Project Scientist - Functional Genomics and Developmental Biology

Assistant Project Scientist - Functional Genomics and Developmental Biology

InsideHigherEd • Berkeley, California, United States
Full-time
Assistant Project Scientist - Functional Genomics and Developmental Biology - Molecular and Cell Biology.The UC academic salary scales set the minimum pay determined by rank and step at appointment...Show more
Last updated: 1 day ago • Promoted
Research Scientist – Generative AI & Agentic Systems

Research Scientist – Generative AI & Agentic Systems

Salesforce • San Francisco, CA, United States
Full-time
A leading AI technology company is seeking a Research Scientist for their AI Research team.The role involves developing cutting-edge AI technologies and collaborating with engineers on ambitious pr...Show more
Last updated: 1 day ago • Promoted
Remote M&A Associate - AI Trainer ($50-$60 / hour)

Remote M&A Associate - AI Trainer ($50-$60 / hour)

Data Annotation • Redwood City, California
Remote
Full-time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer

Senior Data Engineer

PG Forsta • Emeryville, CA, United States
Full-time
PG Forsta is the leading experience measurement, data analytics, and insights provider for complex industries-a status we earned over decades of deep partnership with clients to help them understan...Show more
Last updated: 30+ days ago • Promoted
Travel Clinical Lab Scientist (CLS) - $2,979 per week

Travel Clinical Lab Scientist (CLS) - $2,979 per week

Amergis Healthcare Staffing, Inc.-Allied • Berkeley, CA, US
Full-time
Amergis Healthcare Staffing, Inc.Allied is seeking a travel Clinical Lab Scientist (CLS) for a travel job in Berkeley, California. Job Description & Requirements.The Medical Technologist / Clinic...Show more
Last updated: 2 days ago • Promoted