Talent.com
US Tech Solutions
Human Evaluation & Content Quality Vendor Operations ManagerUS Tech Solutions • Mountain View, CA
No longer accepting applications
Human Evaluation & Content Quality Vendor Operations Manager

Human Evaluation & Content Quality Vendor Operations Manager

US Tech Solutions • Mountain View, CA
30+ days ago
Job type
  • Full-time
Job description

Location: Mountain View, CA (Hybrid)
Duration: months contract

Job Description:
  • As a Human Evaluation & Content Quality Vendor Operations Manager, you will play a key role in scaling and optimizing our global human evaluation ecosystem — the backbone of GenAI product quality. You’ll partner with cross-functional teams and vendor partners to enhance data quality, improve rater accuracy, and streamline evaluation workflows that shape how our AI models learn and perform.
  • This role blends operational rigor, quality management, and strategic vendor partnership to deliver measurable improvements in human evaluation outcomes and operational efficiency.

Responsibilities:
. Drive Quality Improvements
  • Partner with global vendors to design and implement strategies that raise quality scores across human evaluation workflows.
  • Conduct root-cause analysis to uncover quality drivers and pilot innovative methodologies that go beyond traditional training approaches.
  • Hold vendors accountable for sustained performance improvement through structured governance and ongoing enablement.
. Support Rating & Calibration Programs
  • Collaborate with the Rater Operations and Human Evaluation teams to organize and maintain rating question taxonomies and calibration materials.
  • Lead or support calibration discussions with vendors to ensure consistent interpretation of rating guidelines and alignment with evolving model evaluation criteria.
  • Facilitate feedback loops that enhance evaluator understanding and maintain output consistency across vendor sites.
. Optimize Capacity Management
  • Monitor and analyze vendor performance metrics to proactively identify bottlenecks and inefficiencies.
  • Work with vendors to optimize rater availability and scheduling, ensuring adequate coverage for business needs while maintaining throughput and quality.
  • Partner with internal teams on forecasting, backlog reduction, and operational readiness initiatives.
. Performance Management & Reporting
  • Track and report on key vendor KPIs (quality, timeliness, utilization, throughput).
  • Analyze performance data to identify trends, highlight improvement areas, and communicate insights to internal stakeholders.
  • Contribute to quarterly business reviews and strategic planning with vendor partners.

Experience:
  • + years of experience in Vendor Operations, Business Operations, or Program Management, ideally within a tech, AI, or content evaluation environment.
  • Proven success managing and improving performance across multiple vendor partners.
  • Strong analytical and problem-solving skills, with experience using data to drive operational decisions.
  • Excellent communication and negotiation skills, with the ability to influence external partners and cross-functional stakeholders.
  • Highly organized with a proactive approach to issue identification and resolution.

Skills:
  • Human Evaluation
  • Vendor Operations
  • Content
  • Root-cause
  • Rater Operations

Education:
  • Bachelor’s degree.

About US Tech Solutions:
US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit .

US Tech Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Create a job alert for this search

Human Evaluation & Content Quality Vendor Operations Manager • Mountain View, CA

Similar jobs

Campaign Content Operations Manager

UrsusPleasanton, CA, United States
Full-time

Content Operations Project Manager.The Campaigns Content Operations team drives the program management workstream across Global Marketing's Campaigns Center of Excellence (CCOE).Our team's passion ... Show more

 • Promoted

User Operations Specialist

Think Academy USSan Jose, CA, United States
Full-time

We are looking for a User Operations Specialist for our English Language Arts program who can translate trends in English education into content and activities that resonate with U.You will work cl... Show more

 • Promoted

Human Evaluation & Content Quality Vendor Operations Manager

US Tech SolutionsMountain View, CA, United States
Temporary

Human Evaluation & Content Quality Vendor Operations Manager.Location: Mountain View, CA (Hybrid) Duration: 5 months contract.As a Human Evaluation & Content Quality Vendor Operations Manager, you ... Show more

 • Promoted

Product Operations Manager

PeblPalo Alto, CA, United States
Full-time

Pebl puts a world of talent at your fingertips.With our AI-powered Global Work Platform, companies can hire, pay, and manage employees in 185+ countriesremoving risk, red tape, and guesswork from g... Show more

 • Promoted

Consumer Opinion Research Participant

GL IncRio del Mar, California
$15.00 hourly
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Vendor Compliance Auditor

Capstone LogisticsFremont, CA, United States
Full-time

Position: Vendor Compliance Auditor $800/Paid weekly.This role is responsible for auditing the quality of incoming loads, ensuring compliance with established standards, and identifying any deviati... Show more

 • Promoted

Operations Manager III

Pinnacle Technical ResourcesCupertino, CA, US
Full-time

Position: Senior Fraud Operations Specialist Location: Cupertino, California Duration: Contract Job ID: 171030 Job Overview: As a Senior Operations Specialist, candidate will lead initiatives aimed... Show more

 • Promoted

Work-From-Home Product Quality Assurance - $45 per hour

Great LionCapitola, California
$45.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Security Account Manager - Biopharmaceutical

Allied UniversalAptos, CA, United States
Full-time

Company Overview: Allied Universal®, North America's leading security and facility services company, offers rewarding careers that provide you a sense of purpose.While working in a dynamic, welcom... Show more

 • Promoted

Security Account Manager - Biopharmaceutical

Allied Universal SecurityRio Del Mar, CA, United States
Full-time

Company Overview: Allied Universal, North America's leading security and facility services company, offers rewarding careers that provide you a sense of purpose.While working in a dynamic, welcomi... Show more

 • Promoted

Data Center OFCI Quality Manager

CoreWeaveSunnyvale, CA, United States
Full-time

Data Center OFCI Quality Manager.Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA CoreWeave is The Essential Cloud for AI.Built for pioneers by pioneers, CoreWeave delivers a platform o... Show more

 • Promoted

Operations Trainer

MetapropHayward, CA, United States
Full-time

Vesta Home (operating as Showroom Group) is revolutionizing the home marketing and furniture sales industries.Our full-service offeringswhich include interior design, luxury staging, elevated furni... Show more

 • Promoted

Travel CT Tech - $2808 / Week

Ventura MedStaffSanta Cruz, CA, US
Full-time

Ventura MedStaff is seeking an experienced CT Tech for an exciting Travel Allied job in Santa Cruz, CA.Shift: 5x8 hr flex Start Date: 08/17/2026 Duration: 13 weeks Pay: $2808 / Week.Founded in 2018... Show more

 • Promoted

Business Development Manager

Slice Merchant ServicesSoquel, CA, US
Full-time

Excellent opportunity to join a leading, national credit card processing company that has over a decade of industry experience.Slice Merchant Services offers innovative payment processing solutions... Show more

 • Promoted

Human Resources Manager - Onsite

Goodwin RecruitingSanta Cruz, CA, United States
Full-time

Seeking an experienced HR Manager to join our client' s growing team onsite.Human Resources Manager Requirements:Bachelor' s degree in HR, Business Administration, or a similar background 5 years o... Show more

 • Promoted • New!

E-commerce Operation Specialist

TenergyFremont, CA, United States
Full-time

E-commerce Operation Specialist.Located in the heart of Silicon Valley, Tenergy is a total power solution provider in the rechargeable battery and renewable energy industry.With more than 20 years ... Show more

 • Promoted

Quality Manager, Supplier Quality

Veeco Instruments IncSan Jose, CA, United States
Full-time

Quality Manager, Supplier Quality.At Veeco, we build advanced technologies that enable the world's next generation of innovationcome be part of what's next.Veeco is seeking a bold, strategic Suppli... Show more

 • Promoted

Manager, Consumer Experience

Torani (R. Torre & Co.)San Leandro, CA, United States
Full-time

We're looking for a Consumer Experience Manager to lead our Consumer Experience function and serve as the voice of our valued consumer across the business.In this role, your leadership of the team ... Show more

 • Promoted

Operations Manager

AmazonSan Leandro, CA, United States
Full-time

Description This position qualifies for a $15,000 internal launch bonus.Eligibility Requirements: Candidates are ineligible to receive more than one Launch Bonus within a calendar year.In addition... Show more

 • Promoted

Quality Operations Manager

PhilipsFremont, CA, United States
Full-time

The Operations Quality Manager will manage the Quality Operations team and coordinates, designs and executes activities for multiple Quality Operations projects, effectively ensuring alignment with... Show more