Talent.com

Program evaluation Jobs in Seattle, WA

Create a job alert for this search

Program evaluation • seattle wa

Last updated: 15 hours ago

Applied Scientist, Support Agent Intelligence and Evaluation

Amazon.com Services LLCSeattle, Washington, USA
Full-time

Amazon Advertising is one of Amazon's fastest growing and most profitable businesses.Amazon's advertising portfolio helps merchants, retail vendors, and brand owners succeed via native advertising,... Show more

Program Coordinator

University Of WashingtonSeattle, WA, United States
$36.00 hourly
Full-time +1

The Pediatric Care Center has an outstanding opportunity for a Program Coordinator to join their team.The Pediatric Care Center at UWMC Roosevelt provides primary care to patients in the greater Se... Show more

Program Manager

RIT SolutionsSeattle, WA, United States
Full-time

Location Details: -Location: 1st Choice is Seattle.The team is primarily based in Seattle and San Fran.This position is an opportunity to be part of the Engagement Experiences and Platforms organiz... Show more

Program Manager

Veterans Sourcing GroupSeattle, WA, United States
Full-time

The Program Manager will lead high-visibility, enterprise-wide strategic initiatives, partnering across business and technology teams to drive transformation.This role is responsible for planning, ... Show more

Program Manager

KaavSeattle, WA, United States
Full-time

Retail Technology Hardware Program Manager.The Retail Technology Hardware (RTH) and New Store Openings (NSO) team plays a pivotal role within our organization, ensuring that our retail locations ar... Show more

Senior Program Officer, Measurement, Learning, & Evaluation (9 month LTE)

Gates FoundationSeattle, WA
$173,000.00 yearly
Full-time

We are the largest nonprofit fighting poverty, disease, and inequity around the world.Founded on a simple premise: people everywhere, regardless of identity or circumstances, should have the chance... Show more

Program Manager

ApolisSeattle, WA, United States
Full-time

We are seeking an experienced Program Manager to lead a large-scale enterprise program in a multi-shore delivery environment.The ideal candidate will have extensive experience managing Agile progra... Show more

Program Manager

Omni InclusiveSeattle, WA, United States
Full-time

The main function of a non-IT program manager is to plan, direct, or coordinate activities in such fields as engineering, research and development, financial systems and product roll-out, etc or an... Show more

Program Analyst

US Government JobsSeattle, WA, United States
Permanent

Tege - Tax Exempt/Government Entities.A description of the business units can be found at:.This job/announcement is open to current permanent IRS competitive service employees in TEGE - Tax Exempt/... Show more

Head of Intake & Evaluation

The Advocates - Driggs, Bills & DaySeattle, WA, United States
Full-time

The Advocates are a rapidly growing personal injury law firm with branches across the United States.We are dedicated to representing victims of accidents with professionalism and respect.Our team g... Show more

Senior Program Officer, Measurement, Learning, & Evaluation (9 month LTE)

GatesSeattle, WA, United States
$173,000.00 yearly
Full-time

Senior Program Officer, Measurement, Learning, and Evaluation (MLE).The Foundation is the largest nonprofit fighting poverty, disease, and inequity around the world.Founded on a simple premise: peo... Show more

 • New!

Evaluation and Process Improvement Strategic Advisor

Seattle StaffingSeattle, WA, United States
$56.57 hourly
Full-time

Strategic Advisor, Evaluation & System Improvement.Aging and Disability Services (ADS) works to ensure that older adults and adults with disabilities can live safely, independently, and with dignit... Show more

Program Coordinator

Peregrine TeamSeattle, WA, United States
Full-time

Program Operations Coordinator.We are seeking a highly organized and detail-oriented professional to support program operations and community initiatives.This role plays a key part in ensuring effi... Show more

Program Manager

PEMCOSeattle, WA, United States
$154,845.00 yearly
Full-time +1

At PEMCO we're all about people our customers, our employees, and the community.We're a mutual insurance company owned by our Northwest policyholders.We provide auto, home, renters, and boat cover... Show more

Program Manager

SamprasoftSeattle, WA, United States
Full-time

Retail Technology Hardware Program Manager.The Retail Technology Hardware (RTH) and New Store Openings (NSO) team plays a pivotal role within our organization, ensuring that our retail locations ar... Show more

Program Manager

BrightSpring Health ServicesSeattle, WA, United States
$77,976.00 yearly
Full-time

Operations Management focuses on efficiently meeting the needs of our clients across various lines of business.If your passion is managing and developing staff to ensure quality care to help our cl... Show more

Program Coordinator

Bellevue Boys & Girls ClubBellevue, WA, United States
$24.00 hourly
Full-time

Schedule: MondayFriday, typically between 10:00 AM and 6:30 PM; schedule may vary slightly based on Club needs.Compensation: $24 - $27, depending on experience.For nearly 70 years, Boys & Girls Clu... Show more

Program Manager

ITL USABellevue, WA, US
Full-time

A visionary leader responsible for driving transformation and service delivery programs by establishing integrated delivery & governance for the leading global clients.The successful Program Manage... Show more

Program Manager

ActalentSeattle, WA, United States
$85.00 hourly
Full-time

Program Manager Decarbonization Standards & Sustainability Advocacy.The Program Manager will lead and coordinate decarbonization standards and sustainability advocacy initiatives across global car... Show more

Program Manager

Software Technology, Inc.Seattle, WA, United States
Full-time

Manage holistic program progress, budget, milestones, communications, risks, issues, and dependencies.Lead development and execution of program management documentation.Collaborate with internal an... Show more

People also ask
The cities near Seattle, WA that boast the highest number of program evaluation jobs are:
The highest-paying jobs are:
Applied Scientist, Support Agent Intelligence and Evaluation

Applied Scientist, Support Agent Intelligence and Evaluation

Amazon.com Services LLCSeattle, Washington, USA
8 days ago
Job type
  • Full-time
Job description
Amazon Advertising is one of Amazon's fastest growing and most profitable businesses. Amazon's advertising portfolio helps merchants, retail vendors, and brand owners succeed via native advertising, which grows incremental sales of their products sold through Amazon. The primary goals are to help shoppers discover new products they love, be the most efficient way for advertisers to meet their business objectives, and build a sustainable business that continuously innovates on behalf of customers.

Millions of advertisers rely on Amazon's self-service support experience to resolve issues, unblock campaigns, and grow their business. Our Support Agents team is building the science behind intelligent, conversational support — systems that understand advertiser intent, retrieve the right knowledge, generate accurate answers, and know when to escalate. We serve ~2M monthly active advertisers across dozens of locales and languages, and every percentage point of improvement in resolution quality translates directly into advertiser success and retention.

We are seeking an Applied Scientist to help enhance and scale our support agent capabilities. You will build and improve models that power advertiser-facing interactions, contribute to our evaluation framework, and work alongside senior scientists and engineers to ship science into production.

A day in the life
1. Enhance support agent capabilities across the broad suite of Amazon Advertising products — expanding coverage, depth of resolution, and advertiser task completion across Sponsored Products, Sponsored Brands, DSP, AMC, and more
2. Design and own the evaluation framework for agent quality — including automated LLM-based scoring of answer correctness, confidence calibration, and conversation-level resolution signals
3. Develop novel metrics that capture whether advertisers actually got the help they needed (beyond surface-level deflection rates)
4. Build and improve retrieval and generation models that power real-time advertiser interactions under strict latency SLAs
5. Drive multilingual science — improve non-English resolution rates through cross-lingual retrieval, translation quality modeling, and locale-aware evaluation
6. Partner with product, engineering, and business teams to productize research and inform roadmap decisions with data

About the team
This role sits within Amazon Advertising's broader Agentic Intelligence organization — a community of multiple Applied Science and Engineering teams building the next generation of AI-powered experiences for advertisers. You'll have access to Principal Engineers and Principal Applied Scientists to pressure-test ideas and elevate your work. The team is cross-functional — scientists and engineers work shoulder-to-shoulder, from problem framing through production deployment.

BASIC QUALIFICATIONS

- 3+ years of building models for business application experience
- PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience
- Experience in patents or publications at top-tier peer-reviewed conferences or journals
- Experience programming in Java, C++, Python or related language
- Experience in any of the following areas: algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high-performance computing

PREFERRED QUALIFICATIONS

- Experience using Unix/Linux
- Experience in professional software development
- Experience in advertising

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers.