Judge Jobs in USA

Sr AI Technical Product Manager

At T-Mobile, we invest in YOU! Our Total Rewards Package ensures that employees get the same big love we give our customers. All team members receive a competitive base salary and compensation package - this is Total Rewards. Employees enjoy multiple wealth-building opportunities through our annual stock grant, employee stock purchase plan, 401(k), and access to free, year-round money coaches. That's how we're UNSTOPPABLE for our employees!

This is not a remote position. T-Mobile is a hybrid work environment requiring work in the office three (3) days per week. The successful candidate will be located in either Seattle, Washington or Frisco, Texas areas.

Job Overview

The Sr AI Technical Product Manager is a product leader, customer evangelist, and execution driver responsible for taking T-Mobile's AI products from concept through beta, General Availability, and scale. This role owns product strategy and delivery for one or more AI products or platform capabilities, working in a fast-paced, entrepreneurial environment within T-Mobile's AI Commercialization team. The Sr AI Technical Product Manager combines customer empathy, product judgment, and hands-on technical execution with deep expertise in AI evaluation, including agentic testing and LLM-as-judge methods, so that every product meets carrier-grade standards for accuracy, latency, safety, and customer experience before and after launch. The role works closely with cross-functional teams to validate, build, and launch AI-powered solutions that create new revenue streams and differentiated customer experiences.

This role manages the end-to-end delivery of complex technical AI products to meet specific business objectives and customer needs. It involves defining product vision, strategy, and roadmaps for an assigned product area while collaborating with cross-functional teams to deliver technical solutions. The role requires analyzing market data, customer insights, product telemetry, and evaluation results to prioritize product features, quality investments, and innovations. Success is measured by product performance, beta-to-GA conversion, customer satisfaction, production quality and evaluation scores, and alignment with business goals. The work impacts organizational growth and enhances customer experiences through effective product delivery and technical leadership.

Vision & Strategy for AI Products

• Owns strategy, roadmap, and lifecycle for one or more AI products or reusable AI capabilities within an assigned product area, aligned to the broader AI portfolio strategy.
• Accountable for measurable outcomes for assigned products, including adoption, retention, revenue contribution, automation impact, production quality, and customer experience improvement.
• Owns the product lifecycle for complex technical solutions, ensuring alignment with business objectives and customer needs.
• Defines success metrics, including quality and evaluation metrics, and tracks progress against growth and quality targets.
• Conducts analysis of quantitative and qualitative data, including evaluation results and production telemetry, to identify product innovation opportunities or root cause of issues, and assess opportunity size and impact. Works with data scientists to answer complex questions or identify meaningful insights from data.
• Leverages rapid hypothesis-driven testing methodologies and experiments (i.e. paper prototype, A/B testing, offline evaluation, etc.) to inform direction and prioritize investment.
• Works with stakeholders and follows enterprise process to secure and maintain product funding.
• Maintains current understanding of AI and technology trends, including agentic systems, evaluation methods, and competitive moves, and assesses how they impact the roadmap or create opportunity for innovation.
• Owns product feature set or technical improvements to improve customer experience.

Customer Evangelist

• Leads customer discovery and validation activities for new AI features and products.
• Writes detailed product requirements, user stories, and acceptance criteria for AI-powered features, including measurable quality and evaluation criteria.
• Designs and executes rapid prototyping and MVP development cycles.
• Conducts user testing and iteration based on customer feedback.
• Owns launch readiness validation, confirming a product meets quality, performance, and customer experience criteria before General Availability, and runs cross-functional readiness reviews with Care, Retail, Marketing, and Engineering.
• Ensures AI products deliver measurable customer value and exceptional user experience.
• Advocates for customer needs throughout the development process.
• Leverages customer insights for product vision, strategy, roadmap, and priorities.
• Creates, manages, and fosters an active VOC feed for self and team.
• Actively looks for opportunities to delight customers or meet unmet needs.
• Tests ideas with real customers to ensure that the product delivers the desired benefit.

Product Execution & Technical Delivery

• Collaborates with Technical Architects to ensure AI solutions are technically feasible and scalable.
• Works with engineering teams (both internal and matrixed) to deliver products on time and within scope.
• Coordinates with GTM and commercialization teams to develop launch strategies.
• Drives resolution of technical and business challenges that arise during development.
• Translates product strategy by writing detailed features and user stories consumable by Dev teams for high-complexity products with multiple transactions and touchpoints across teams. This work may include creation of prototypes.
• Partners with PM and Dev leaders to organize effective Agile delivery teams within the Agile Release Train and Agile Teams.
• Scopes and ensures alignment on the prioritization of activities based on business and customer impact.
• Brings strong product and technical fluency in applied AI, including LLM-based and agentic experiences, model selection, retrieval-augmented generation (RAG), tool and API orchestration, experimentation, and production AI constraints such as latency, cost, and safety, with deep expertise in evaluation frameworks.
• Collaborates with Architecture and Dev teams to ensure technical debt and long-term technical investment are factored into the roadmap.
• Ensures existing production defects are factored into regular backlog prioritization for resolution based on priority.
• In scaled teams, holds regular meetings and coordination activities with other PMs and Product Owners (if applicable) to ensure parallel work is in sync and dependencies are known.
• Supports sales, marketing, and other stakeholder teams with product or technical knowledge and additional documentation.
• Anticipates and communicates technical challenges to stakeholders and makes educated trade-off decisions with the team.
• Accountable for product quality and performance in the production environment. Accountable for product and Dev team response in the event of a critical or high-impact defect, including communications to stakeholders at all levels.
• Drives root cause analysis and resolution for production incidents, including AI behavior issues escalated through Care and operations teams, in collaboration with platform and product engineering.
• Supports core agile practices and tenets: efficient just-in-time flow, lean practices, elimination of waste, and DevOps CI/CD.

AI Evaluation, Agentic Testing & LLM-as-Judge

• Builds scenario libraries and simulated-user test suites covering varied personas, languages, noisy conditions, interruptions, and adversarial inputs, exercises agents end to end before release, and replays sampled production interactions to detect drift.
• Designs LLM-as-judge evaluation: writes judge rubrics and prompts, calibrates judge scores against human ratings, monitors judge agreement and drift, and controls for known judge biases before judge scores are used as release gates.
• Runs structured human-in-the-loop validation that reviews model and agent output for accuracy, conversational behavior, accessibility, and safety, and uses the results to calibrate automated judges and expand golden datasets.
• Defines production quality standards for carrier-grade AI, including accuracy thresholds, latency budgets, task success rates, safety guardrails, and customer experience baselines that products must meet to ship and remain in production.
• Builds and maintains evaluation pipelines that span multiple model providers, enabling objective model comparisons and a quality scorecard that informs model selection, retention, and renewal decisions.
• Owns the quality feedback loop with model providers and engineering partners, including structured benchmarks, defect reports, and improvement requests grounded in production data.
• Monitors production quality for AI-specific regressions through alerting, dashboards, and on-call protocols, in partnership with platform and product engineering.

Relationship & People, Professional Development

• Builds strong relationships with Network, IT, Business, Marketing, Care, and other organizations.
• Negotiates priorities and resources with stakeholder groups within the product area.
• Communicates product roadmaps, launches, and quality results to