Talent.com
Senior AI Evaluation Engineer
Senior AI Evaluation EngineerSentry • San Francisco, California, United States
Senior AI Evaluation Engineer

Senior AI Evaluation Engineer

Sentry • San Francisco, California, United States
19 days ago
Job type
  • Full-time
Job description

A software monitoring firm is seeking a Senior Software Engineer to join its AI / ML team in San Francisco. In this role, you will design evaluation frameworks to measure AI system performance, develop high-quality datasets, and automating testing processes. The ideal candidate should have over 5 years of experience, be proficient in Python and TypeScript, and enjoy working cross-functionally. Sentry offers competitive compensation between $240,000 to $280,000 along with comprehensive benefits including equity grants and health insurance.

#J-18808-Ljbffr

Create a job alert for this search

Senior AI Evaluation Engineer • San Francisco, California, United States

Similar jobs
Applied AI Research Engineer — RAG & Evaluation

Applied AI Research Engineer — RAG & Evaluation

Drata • San Francisco, CA, United States
Full-time
A leading compliance software company in San Francisco is seeking an Applied AI Engineer to innovate compliance automation through applied research and evaluation. This role emphasizes experimentati...Show more
Last updated: 22 days ago • Promoted
AI Evaluation Engineer - Enterprise GenAI Systems

AI Evaluation Engineer - Enterprise GenAI Systems

Scale AI • San Francisco, CA, United States
Full-time
A leading technology company in San Francisco is seeking an AI Research Engineer to join their Enterprise Evaluations team. In this pivotal role, you will contribute to the industry's premier GenAI ...Show more
Last updated: 30+ days ago • Promoted
Senior Research Engineer, LLM Evaluation and Behavioral Analysis

Senior Research Engineer, LLM Evaluation and Behavioral Analysis

Together AI • San Francisco, CA, United States
Full-time
Senior Research Engineer, LLM Evaluation and Behavioral Analysis.Together AI is building the fastest, most capable open‑source‑aligned LLMs and inference stack in the world.As part of the Turbo org...Show more
Last updated: 30+ days ago • Promoted
Senior AI Solutions Engineer (Forward Deployed)

Senior AI Solutions Engineer (Forward Deployed)

Intercom • San Francisco, CA, United States
Full-time
A customer service technology company is seeking a Senior Forward Deployed Engineer to drive adoption of their AI solutions within strategic customer engagements in San Francisco.You will work clos...Show more
Last updated: 30+ days ago • Promoted
AI Research Engineer, Enterprise Evaluations

AI Research Engineer, Enterprise Evaluations

Scale AI, Inc. • San Francisco, CA, United States
Full-time
Scale AI is seeking a technically rigorous and driven.This high-impact role is critical to our mission of delivering the industry's leading. You will be a hands-on contributor to the core systems th...Show more
Last updated: 30+ days ago • Promoted
AI Engineer, Agents & Evaluation

AI Engineer, Agents & Evaluation

Guild.ai • San Francisco, CA, United States
Full-time
AI Engineer, Agents & Evaluation.We’re looking for our first AI Engineer focused on agents and evaluation—a foundational hire who will shape how we build, measure, and scale intelligent systems.Hel...Show more
Last updated: 30+ days ago • Promoted
Senior AI Engineer

Senior AI Engineer

ZS • South San Francisco, CA, United States
Full-time
As a management consulting and technology firm focused on improving life and how we live it, we transform ideas into impact by bringing together data, science, technology and human ingenuity to del...Show more
Last updated: 3 days ago • Promoted
Applied Research Engineer - AI & LLM Evaluation

Applied Research Engineer - AI & LLM Evaluation

Mercor • San Francisco, CA, United States
Full-time
An innovative AI company in San Francisco is seeking a Research Engineer to contribute to the advancement of AI models.The role involves working on post-training and evaluation tasks, designing exp...Show more
Last updated: 30+ days ago • Promoted
Senior Engineer, AI Evaluation & Reliability (Agentic AI)

Senior Engineer, AI Evaluation & Reliability (Agentic AI)

Anomali • Redwood City, California, US
Full-time
Job Description Job Description Company : Anomali is headquartered in Silicon Valley and is the Leading AI-Powered Security Operations Platform that is modernizing security operations.At the cente...Show more
Last updated: 3 days ago • Promoted
GenAI Evaluations Engineer : Build Trusted AI Platforms

GenAI Evaluations Engineer : Build Trusted AI Platforms

Apple Inc. • San Francisco, CA, United States
Full-time
A leading technology company in California is seeking a Software Engineer for the Generative AI Evaluations team.You will design robust evaluation frameworks, analyze AI applications, and collabora...Show more
Last updated: 30+ days ago • Promoted
Senior AI Eval Engineer : Build Trusted Metrics

Senior AI Eval Engineer : Build Trusted Metrics

Sentry.io • San Francisco, CA, United States
Full-time
A leading software monitoring company is seeking a Senior Software Engineer for their AI / ML team.This role focuses on building evaluation infrastructure to ensure the accuracy and performance of AI...Show more
Last updated: 28 days ago • Promoted
Senior ML Engineer for Real-World AI Evaluation

Senior ML Engineer for Real-World AI Evaluation

LMArena • San Francisco, California, United States
Full-time
A leading AI evaluation platform in San Francisco is seeking a Senior Machine Learning Engineer to shape the core infrastructure for real-world AI evaluation. In this role, you will architect data a...Show more
Last updated: 19 days ago • Promoted
Remote Research Engineer : Agentic AI Evaluations

Remote Research Engineer : Agentic AI Evaluations

HUD • San Francisco, CA, United States
Remote
Full-time
A technology startup in San Francisco seeks a research engineer to build evaluation environments for AI systems.The candidate should have proficiency in Python, Docker, and Linux.Experience with LL...Show more
Last updated: 30+ days ago • Promoted
Senior Applied AI Engineer

Senior Applied AI Engineer

Quizlet • San Francisco, CA, US
Full-time
At Quizlet, our mission is to help every learner achieve their outcomes in the most effective and delightful way.Our $1B+ learning platform serves tens of millions of students every month, in...Show more
Last updated: 30+ days ago • Promoted
Senior Software Engineer, Data & Evaluation

Senior Software Engineer, Data & Evaluation

Waymo • San Francisco, California, United States
Full-time
Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...Show more
Last updated: 19 days ago • Promoted
Senior AI & Search Engineer

Senior AI & Search Engineer

GoFundMe • San Francisco, California, United States
Full-time
A prominent crowdfunding platform is seeking a Senior Search Engineer to design and implement next-generation search systems and machine learning technologies. This role emphasizes collaboration wit...Show more
Last updated: 30+ days ago • Promoted
Senior AI Engineer

Senior AI Engineer

AlphaSense, Inc. • San Francisco, CA, United States
Full-time
The world's most sophisticated companies rely on AlphaSense to remove uncertainty from decision-making.With market intelligence and search built on proven AI, AlphaSense delivers insights that matt...Show more
Last updated: 12 days ago • Promoted
Senior AI Developer Productivity Engineer

Senior AI Developer Productivity Engineer

Zoox • Foster City, California, US
Full-time
Job Description Job Description Zoox is developing state-of-the-art autonomous vehicle software for our purpose-built vehicle. We believe that developing the end-to-end product will get us to mark...Show more
Last updated: 3 days ago • Promoted