Talent.com
No longer accepting applications
Python Developer for AI Tools

Python Developer for AI Tools

VirtualVocationsConcord, California, United States
6 hours ago
Job type
  • Full-time
Job description

A company is looking for a MCP & Tools Python Developer - Agent Evaluation Infrastructure.

Key Responsibilities

Developing and maintaining MCP-compatible evaluation servers

Implementing logic to check agent actions against scenario definitions

Creating or extending tools for testing agents used by writers and QAs

Required Qualifications

4+ years of Python development experience, ideally in backend or tools

Solid experience building APIs, testing frameworks, or protocol-based interfaces

Understanding of Docker, Linux CLI, and HTTP-based communication

Ability to integrate new tools into existing infrastructures

Familiarity with how LLM agents are prompted, executed, and evaluated

Create a job alert for this search

Python Developer • Concord, California, United States

Related jobs
  • Promoted
AI Engineer (Core - Platform)

AI Engineer (Core - Platform)

BUILDSan Francisco, CA, United States
Full-time
As a Engineer, you will be instrumental in shaping the technical direction and core product at Build.You'll work alongside the founders & early team to build state-of-the-art AI agents and the plat...Show moreLast updated: 2 days ago
  • Promoted
Sr. Python Developer AI / ML

Sr. Python Developer AI / ML

Robotics Prcocess Automation, LLCSan Francisco, CA, United States
Permanent
We are seeking a highly motivated and skilled Python Developer with a strong background in Azure cloud services and hands-on experience in developing and deploying AI / ML solutions, particularly lev...Show moreLast updated: 3 days ago
  • Promoted
  • New!
Sr. Python Developer AI / ML

Sr. Python Developer AI / ML

AI Technologies LLC.San Francisco, CA, United States
Permanent
We are seeking a highly motivated and skilled Python Developer with a strong background in Azure cloud services and hands-on experience in developing and deploying AI / ML solutions, particularly lev...Show moreLast updated: 20 hours ago
  • Promoted
Senior Software Engineer - Python / JavaScript

Senior Software Engineer - Python / JavaScript

Discover InternationalSan Francisco, CA, US
Full-time
Be a key player in a fast-growing startup, shaping a top-tier AI product.Work with large-scale applications and collaborate with a talented team. Knowledge of GenAI model APIs, LangChain, LlamaIndex...Show moreLast updated: 2 days ago
  • Promoted
Distinguished AI Engineer

Distinguished AI Engineer

Capital OneRichmond, CA, United States
Part-time
Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 8 years of experience developing AI and ML algorithms or technologies, or a ...Show moreLast updated: 23 days ago
  • Promoted
Principal AI Software Engineer, Product

Principal AI Software Engineer, Product

MonographSan Francisco, CA, United States
Full-time
Gusto is a modern, online people platform that helps small businesses take care of their teams.On top of full-service payroll, Gusto offers health insurance, 401(k)s, expert HR, and team management...Show moreLast updated: 30+ days ago
  • Promoted
  • New!
Seed Stage, AI Automation Fintech, Backend Engineer / MLops

Seed Stage, AI Automation Fintech, Backend Engineer / MLops

MediumSan Francisco, CA, United States
Full-time
AI-driven fintech startup in Montreal, founded in 2024 by Forbes 30 Under 30 alumni.Set to transform financial negotiations using cutting-edge AI technology. Join a small but impactful team where yo...Show moreLast updated: 20 hours ago
  • Promoted
Senior Software Engineer - Python / JavaScript (San Francisco)

Senior Software Engineer - Python / JavaScript (San Francisco)

Discover InternationalSan Francisco, CA, US
Part-time
Be a key player in a fast-growing startup, shaping a top-tier AI product.Work with large-scale applications and collaborate with a talented team. Knowledge of GenAI model APIs, LangChain, LlamaIndex...Show moreLast updated: 4 days ago
  • Promoted
SRE & Data Engineer for Cloud Native AI SAAS

SRE & Data Engineer for Cloud Native AI SAAS

SherlockTalentSan Francisco, CA, United States
Full-time
Job Title : SRE & Data Engineer.Location : Bay Area, CA, 3 days a week onsite.Job Type : Founding Level SWE, Full Time.Salary : Founders-level equity and $200K-$250K+. Establish and maintain the foundat...Show moreLast updated: 19 days ago
Python Curriculum Developer

Python Curriculum Developer

Mission BitSan Francisco, CA, US
Full-time +2
Quick Apply
Mission Bit is a San Francisco-based nonprofit that inspires youth of color to explore the world of STEM with project-based computer science education that embraces their identities.We offer a vari...Show moreLast updated: 4 days ago
  • Promoted
Director of Software Engineering - Geospatial / Satellite Data / Python / AWS (Remote / Hybrid)

Director of Software Engineering - Geospatial / Satellite Data / Python / AWS (Remote / Hybrid)

AttisSan Francisco, CA, United States
Remote
Full-time +1
A pioneering technology company at the forefront of geospatial intelligence is seeking a Director of Software Engineering in San Francisco, CA. This is a hands-on leadership role for an individual p...Show moreLast updated: 4 days ago
  • Promoted
  • New!
Health Tech & AI Startup : Founding ML Engineer

Health Tech & AI Startup : Founding ML Engineer

MediumSan Francisco, CA, United States
Full-time
Backed by First Minute Capital, Maverick and Top Harvest Capital, along with high-profile angel investors including the founders of Datadog, Okin, and Front. ML / NLP, graphRAG, RAG, spaCy, MedBert.Be...Show moreLast updated: 20 hours ago
  • Promoted
AI Solutions Engineer

AI Solutions Engineer

ButterflyMX, Inc.San Francisco, California, US
Full-time
ButterflyMX is on a mission to empower people to open and manage doors & gates from a smartphone.Our products are installed in more than 20,000+ multifamily, commercial, gated communities, and ...Show moreLast updated: 2 days ago
  • Promoted
Quantitative Developer - AI Implementation

Quantitative Developer - AI Implementation

WorldQuantSan Francisco, CA, United States
Full-time +1
Quantitative Developer - AI Implementation.Quantitative Developer - AI Implementation.WorldQuant develops and deploys systematic financial strategies across a broad range of asset classes and globa...Show moreLast updated: 30+ days ago
  • Promoted
Lead AI Engineer (Gen AI Platform Services, Python, Kubernetes)

Lead AI Engineer (Gen AI Platform Services, Python, Kubernetes)

Capital OneSan Francisco, CA, United States
Part-time
You love to build systems, take pride in the quality of your work, and also share our passion to do the right thing.You want to work on problems that will help change banking for good.Passion for s...Show moreLast updated: 27 days ago
Gen AI Architect

Gen AI Architect

Shrive Technologies LLCFremont, CA, United States
Full-time
Quick Apply
MessageBody"> Skills : Hands-on experience with Langfuse (including v3 features) and integrations.Experience with other GenAI observability tools (e.Knowledge of Retriev...Show moreLast updated: 5 days ago
  • Promoted
Principal AI Software Engineer, Payroll New Denver, CO;San Francisco, CA;New York, NY

Principal AI Software Engineer, Payroll New Denver, CO;San Francisco, CA;New York, NY

GustoSan Francisco, CA, United States
Full-time
Denver, CO; San Francisco, CA; New York, NY.Gusto is a modern, online people platform that helps small businesses take care of their teams. On top of full-service payroll, Gusto offers health insura...Show moreLast updated: 30+ days ago
  • Promoted
AI Engineer (Core - Data & Tooling)

AI Engineer (Core - Data & Tooling)

BUILDSan Francisco, CA, United States
Full-time
As a Engineer, you will be instrumental in shaping the technical direction and core product at Build.You'll work alongside the founders & early team to build state-of-the-art AI agents and the plat...Show moreLast updated: 2 days ago
  • Promoted
Backend Software Architect - Python

Backend Software Architect - Python

EchoSan Francisco, CA, United States
Full-time
Echo Neurotechnologies is an exciting new startup in the Brain-Computer Interface (BCI) space, driving innovation through advanced hardware engineering and AI solutions. Our mission is to deliver cu...Show moreLast updated: 30+ days ago
  • Promoted
Backend Software Engineer - Python

Backend Software Engineer - Python

EchoSan Francisco, CA, United States
Full-time
Echo Neurotechnologies is an exciting new startup in the Brain-Computer Interface (BCI) space, driving innovation through advanced hardware engineering and AI solutions. Our mission is to deliver cu...Show moreLast updated: 30+ days ago