Delivery Director

TuringSan Francisco, CA, United States

9 days ago

Job type

Full-time

Job description

Join to apply for the Delivery Director role at Turing

This range is provided by Turing. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$170,000.00 / yr - $200,000.00 / yr

Additional compensation types

RSUs

Overview

We are seeking a seasoned, techno-functional leader to drive the development and execution of large-scale LLM training programs. This role is deeply technical and client-facing, with significant emphasis on dataset creation, annotation workflows, and high-quality data pipelines for foundational model training. The ideal candidate combines deep technical understanding of the LLM training lifecycle, strong operational rigor, and exceptional cross-functional leadership.

Key Responsibilities

Lead the generation and delivery of high-quality, scalable LLM training datasets with a focus on SFT, RLHF, Reasoning, and agentic workflows.
Oversee the end-to-end data lifecycle from client intake to delivery, including collaboration with the clients for defining the data requirements, writing down the data annotation steps / workflow, quality metrics, review workflows, and delivery setup.
Serve as the primary client contact for large enterprise engagements; manage stakeholder expectations, requirements gathering, and delivery timelines.
Collaborate with engineering, product, research, and delivery teams to ensure technical feasibility and alignment across workstreams.
Develop, document, and refine best practices for prompt evaluation, data schema design, evaluation metrics (e.g., win rate, pairwise preference), and human-in-the-loop QA.
Recruit, manage, and mentor engineering leads and program managers working across multiple AI training pods.
Operate as a strategic business partner to our clients; provide insight on tradeoffs, resourcing, and performance metrics.
Build internal capability by harvesting reusable assets and contribute in continued improvements across data quality, tools and processes.

Required Qualifications

10+ years of experience building and leading large scale technical delivery teams

Proven ability to lead large cross functional teams (100+) by building strong operations

Bachelor’s degree in Engineering, Computer Science or equivalent practical experience leading large-scale technical initiatives.

Demonstrated experience managing large-scale dataset generation or annotation for LLMs, ideally with experience in RLHF or SFT pipelines.

Strong understanding of quality review mechanisms including prompt win rate, agreement metrics, inter-annotator consistency, and preference modeling.

Experience with human data generation across at least one of the modalities (Text, Image, Video, Audio)

Technical fluency in Python, cloud infrastructure, data platforms, machine learning concepts and modern Machine Learning tooling (e.g., HuggingFace, LangChain, Weights & Biases).

Strong communication skills with experience presenting to executive stakeholders, managing client escalations, and aligning delivery with strategic goals.

Preferred Qualifications

Prior experience at AI Data Platform companies

Past experience with retrieval augmented generation (RAG), fine-tuning, and human evaluation workflows.

Familiarity with fine-tuning LLMs, prompt engineering at scale, and instruction dataset design.

Familiarity with bench marks (SWE Bench, MMMLU, or equivalent)

Location

SF Bay Area (Remote / Hybrid but must be in the SF Bay Area)

Compensation

$170,000 to $200,000 OTE + Equity

Seniority level

Director

Employment type

Full-time

Job function

Information Technology and Strategy / Planning

Industries

Software Development and IT Services and IT Consulting

#J-18808-Ljbffr

Create a job alert for this search

Director Delivery • San Francisco, CA, United States