Talent.com
AI Evaluation Engineer (QA) Manager
AI Evaluation Engineer (QA) ManagerPwC • San Jose, CA, United States
AI Evaluation Engineer (QA) Manager

AI Evaluation Engineer (QA) Manager

PwC • San Jose, CA, United States
5 days ago
Job type
  • Full-time
Job description

Specialty / Competency : Data Science

Industry / Sector : Not Applicable

Time Type : Full time

Travel Requirements : Up to 20%

At PwC, we are at the forefront of data and analytics engineering, leveraging advanced technologies to create robust data solutions. We empower businesses to transform raw data into actionable insights, enabling informed decision-making and driving growth.

As part of our data science and machine learning team, you will harness advanced analytics and cutting-edge machine learning techniques to derive insights from extensive datasets and guide data-driven decisions. You'll contribute to developing predictive models, statistical analyses, and impactful data visualizations tailored to address complex business challenges.

In this leadership role, you will motivate, develop, and inspire your team to deliver exceptional quality. You will coach team members, leveraging their unique strengths and ensuring performance aligns with client expectations. Your expanding business acumen will help you identify opportunities that contribute to the success of our firm. Leading with integrity, you will embody our purpose and values, embracing technology and innovation to enhance service delivery and inspire others to do the same.

Key Responsibilities Include :

Analyze and identify linkages and interactions within comprehensive systems.

Take ownership of projects, ensuring successful planning, budgeting, execution, and completion.

Collaborate with team leadership to ensure collective accountability for quality, timelines, and deliverables.

Encourage skill development beyond comfort zones for yourself and your team.

Mentor others effectively to enhance their growth.

Utilize work reviews to deepen team members' expertise.

Address conflicts or issues, engaging in difficult conversations with clients and team members while escalating as needed.

Uphold professional and technical standards, including specific PwC guidelines and the Firm’s code of conduct.

The Opportunity

You will lead teams in delivering governed Generative AI solutions, designing testing strategies, evaluation frameworks, and governance controls to ensure reliable, ethical, and scalable AI agents. As a Manager, you will supervise teams, manage client accounts, and apply leading practices across AI platforms, data pipelines, and integrations while upholding PwC's values and professional standards. This role offers a unique opportunity to drive innovation in AI technology while fostering a collaborative environment that empowers team members and enhances client relationships.

What You Must Have : Bachelor's Degree

At least 6 years of experience in AI / ML engineering, data engineering, or software engineering

If you lack a Bachelor's Degree, you must have an additional three years of specialized training or progressively responsible work experience in technology for each missing year of college.

What Will Set You Apart :

Master's Degree preferred.

Proven experience leading AI solution teams.

Understanding of LLMs and agent architectures.

Experience with Microsoft Power Platform.

Prior consulting or professional services experience.

Establishing testing and validation standards for AI agents.

Managing and coaching teams for continuous development.

Building trusted client relationships and translating requirements effectively.

Designing and overseeing automated testing frameworks for AI solutions, including low-code workflows and data integrations.

Leading governance of AI pipelines and data flows to ensure data quality, lineage, and accuracy.

PWC is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, age, disability, or any status protected by law. Applications will be accepted until the position is filled or the posting is removed.

The salary range for this position is : $73,500 - $212,280. Compensation will depend on the individual's skills, experience, and qualifications. All hired individuals are eligible for an annual discretionary bonus, and PwC offers a wide range of benefits, including medical, dental, vision, 401k, holiday pay, and more.

#LI-Remote

#LI-Hybrid

Create a job alert for this search

AI Evaluation Engineer QA Manager • San Jose, CA, United States

Similar jobs
Senior AI / ML Engineer

Senior AI / ML Engineer

VirtualVocations • Hayward, California, United States
Full-time
A company is looking for a Lead AI / ML Engineer to architect and build agentic AI frameworks for web and mobile platforms. Key Responsibilities : Gather, clean, and prepare structured and unstructur...Show more
Last updated: 25 days ago • Promoted
AI / ML Engineer

AI / ML Engineer

TechDigital Corporation • San Jose, CA, United States
Full-time
We are seeking a highly skilled and experienced Data Engineer with a strong background in AI / ML to design, build, and optimize robust data pipelines and infrastructure on the Google Cloud Platform ...Show more
Last updated: 10 hours ago • Promoted • New!
Senior Applied ML Engineer — Build High-Impact AI Systems

Senior Applied ML Engineer — Build High-Impact AI Systems

X, The Moonshot Factory • Mountain View, CA, United States
Full-time
A leading technology innovation company in Mountain View is seeking a Senior Applied Research Engineer to build AI systems that achieve unprecedented levels of performance.This role requires strong...Show more
Last updated: 21 days ago • Promoted
AIML - Machine Learning Engineer (MLOps), Evaluation

AIML - Machine Learning Engineer (MLOps), Evaluation

Apple • Santa Clara, CA, United States
Full-time
We are seeking a highly experienced Machine Learning Engineer to build, deploy, and optimize Large Language Model (LLM)-based applications, with a strong emphasis on MLOps / LLMOps and scalable produ...Show more
Last updated: 19 days ago • Promoted
AI Engagement Manager

AI Engagement Manager

Adobe Inc. • San Jose, CA, United States
Full-time
Changing the world through digital experiences is what Adobe's all about.We give everyone-from emerging artists to global brands-everything they need to design and deliver exceptional digital exper...Show more
Last updated: 30+ days ago • Promoted
AI Engagement Manager

AI Engagement Manager

Adobe • San Jose, CA, United States
Full-time
Changing the world through digital experiences is what Adobe’s all about.We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital exper...Show more
Last updated: 30+ days ago • Promoted
Responsible AI ML Engineer – Safety & Evaluation

Responsible AI ML Engineer – Safety & Evaluation

Apple Inc. • Cupertino, CA, United States
Full-time
A leading technology company in Cupertino seeks a Machine Learning Engineer focused on Responsible AI.You'll work on developing evaluations for safety and fairness in generative AI applications, co...Show more
Last updated: 30+ days ago • Promoted
AIML - Machine Learning Engineer, Retrieval and Ranking Quality Siri & Information Intelligence

AIML - Machine Learning Engineer, Retrieval and Ranking Quality Siri & Information Intelligence

Apple • Santa Clara, CA, United States
Full-time
We are looking for a Senior Machine Learning engineering with a passion for using machine learning to create intelligent and personalized search applications. Our team researches and implements nove...Show more
Last updated: 24 days ago • Promoted
Machine Learning Engineer - AI Trainer

Machine Learning Engineer - AI Trainer

DataAnnotation • San Jose, California, US
Full-time
Join the DataAnnotation team and contribute to developing cutting-edge AI systems, while enjoying the flexibility of remote work and setting your own schedule. Ensure you read the information regard...Show more
Last updated: 2 hours ago • Promoted • New!
Product Manager, AI Agents

Product Manager, AI Agents

Hippocratic AI • Palo Alto, CA, United States
Full-time
As a Product Manager for AI Agents at Hippocratic AI, you will shape and optimize the behavior of intelligent healthcare agents built atop cutting-edge language models. You'll work closely with engi...Show more
Last updated: 9 hours ago • Promoted • New!
Senior AI / ML Engineer – Generative AI & Autonomous Agents (9746)

Senior AI / ML Engineer – Generative AI & Autonomous Agents (9746)

Extreme Networks, Inc. • San Jose, CA, United States
Full-time
Over 50,000 customers globally trust our end-to-end, cloud-driven networking solutions.They rely on our top-rated services and support to accelerate their digital transformation efforts and deliver...Show more
Last updated: 30+ days ago • Promoted
Senior ML Engineer, Applied Research — Remote

Senior ML Engineer, Applied Research — Remote

Pinterest • Palo Alto, CA, United States
Remote
Full-time
A leading social media platform is seeking a Machine Learning Engineer to build personalized experiences.Applicants should have over 4 years of experience in machine learning methods and big data t...Show more
Last updated: 30+ days ago • Promoted
Senior Manager, Generative AI Models & Apps

Senior Manager, Generative AI Models & Apps

Advanced Micro Devices • San Jose, CA, United States
Full-time
A leading technology company is seeking a Senior Manager for AI Models and Applications in San Jose, CA.The role involves leading a team to innovate in Generative AI training and inference.The idea...Show more
Last updated: 24 days ago • Promoted
Senior ML Engineer : Generative AI for Cloud Observability

Senior ML Engineer : Generative AI for Cloud Observability

Cisco Systems, Inc. • San Jose, CA, United States
Full-time
A leading technology company is seeking an experienced engineer to build the intelligent backbone of its Observability Cloud. This role requires applying advanced AI and collaboration with product t...Show more
Last updated: 30+ days ago • Promoted
Senior Data Platform Engineer — Experimentation & Evaluation

Senior Data Platform Engineer — Experimentation & Evaluation

TikTok • San Jose, CA, United States
Full-time
A leading social media platform is seeking a Senior Software Engineer to join their Experimentation & Evaluation team in San Jose, California. You will develop a state-of-the-art A / B testing platfor...Show more
Last updated: 30+ days ago • Promoted
Senior Product Manager, Research Engagement & AI

Senior Product Manager, Research Engagement & AI

23andMe • Palo Alto, CA, United States
Full-time
A pioneering genetics company is seeking a Senior Product Manager in Palo Alto to lead innovative approaches in research participation. In this full-time role, you'll engage users through experiment...Show more
Last updated: 30+ days ago • Promoted
Applied AI Engineer

Applied AI Engineer

Qualified Health • Palo Alto, CA, US
Full-time
At Qualified Health, we're redefining what's possible with Generative AI in healthcare.Our infrastructure provides the guardrails for safe AI governance, healthcare-specific agent creation,...Show more
Last updated: 30+ days ago • Promoted
AI Models Product Manager Inference & Open-Source

AI Models Product Manager Inference & Open-Source

CEREBRAS SYSTEMS INC. • Sunnyvale, CA, United States
Full-time
A leading AI technology company in Sunnyvale, California is seeking a Senior Product Manager to join their Inference team. In this role, you will be responsible for driving the models portfolio, col...Show more
Last updated: 9 hours ago • Promoted • New!