AI Applied Scientist - PhD Intern, Evaluation Systems and Metrics

Job Description

About the teamAre you passionate about building rigorous evaluation frameworks that advance AI systems? The Zillow AI Applied Science team develops next-generation evaluation methodologies for generative AI, computer vision, and agentic systems. We work at the intersection of research and production, designing evaluation frameworks that assess current AI capabilities and adapt as technology advances.

About the role

We are seeking remote PhD interns for Summer 2026!

As an intern, you will help develop cutting-edge evaluation methodologies for AI systems. Your research will focus on creating robust, scalable metrics and frameworks to assess the quality, consistency, and performance of generative models across multiple modalities. You may contribute in one or more of the following areas :

Novel Evaluation Metrics : Develop innovative assessment methodologies for emerging AI capabilities, focusing on consistency and quality across complex multi-modal outputs

Self-Improving Assessment : Design evaluation systems that learn and adapt from feedback, automatically discovering new evaluation criteria and improving assessment quality over time

Privacy-Preserving Evaluation : Design frameworks that incorporate domain-specific implementations of differential privacy to protect sensitive user information while maintaining utility for model training and assessment.

Ethical Fair Housing Evaluation : Develop scalable methodologies for assessing agentic systems, ensuring compliance with fair housing standards and promoting ethical, responsible AI deployment

This role has been categorized as a Remote position. “Remote” employees do not have a permanent corporate office workplace and, instead, work from a physical location of their choice, which must be identified to the Company. U.S. employees may live in any of the 50 United States, with limited exceptions.

In California, Connecticut, Maryland, Massachusetts, New Jersey, New York, Washington state, and Washington DC the standard base pay range for this role is $104,000.00 - $166,000.00 annually. This base pay range is specific to these locations and may not be applicable to other locations.\n\nIn Colorado, Hawaii, Illinois, Minnesota, Nevada, Ohio, Rhode Island, and Vermont the standard base pay range for this role is $104,000.00 - $166,000.00 annually. The base pay range is specific to these locations and may not be applicable to other locations.

Who you are

Currently enrolled as a PhD student in computer science, machine learning, computer vision, or a related field, with strong publication record

Candidates should have a background in one or more of the following areas :

Evaluation methodologies for AI / ML systems

Computer vision metrics and 3D consistency assessment

Generative model evaluation (text, image, video, 3D)

Multi-modal assessment and automated feedback systems

Knowledge of data privacy methods (e.g., differential privacy, federated learning, secure ML) and their application.

Single agent or multi-agent system evaluations

Familiarity with modern deep learning frameworks (e.g., PyTorch, Hugging Face Transformers)

Strong research mindset, with motivation to publish

Interest in applying AI to complex, multi-stakeholder domains

A record of publication in conferences, workshops, or journals is a plus

​Here at Zillow - we value the experience and perspective of candidates with non-traditional backgrounds. We encourage you to apply if you have transferable skills or related experiences.

Get to know us

Zillow is reimagining real estate to make home a reality for more and more people.

As the most-visited real estate website in the United States, Zillow® and its affiliates help movers find and win their home through digital solutions, first class partners, and easier buying, selling, financing and renting experiences. Millions of people visit Zillow Group sites every month to start their home search, and now they can rely on Zillow to help make it easier to move. The work we do helps people get home and no matter what job you're in, you will play a critical role in making home a reality for more and more people.

Our efforts to streamline the real estate transaction are supported by a deep-rooted culture of innovation, our passion to redefine the employee experience, a fundamental commitment to Equity and Belonging, and world-class benefits. These benefits include comprehensive medical, dental, vision, life, and disability coverages as well as parental leave, family benefits, retirement contributions, and paid time off. We’re also setting the standard for work experiences of the future, where our employees are supported in doing their best work and living a flexible, well-balanced life. But don’t just take our word for it. Read recent reviews on Glassdoor and recent recognition from multiple organizations, including : the 100 Best Companies to Work For, Glassdoor Employees’ Choice Award, Bloomberg Gender-Equality Index, Human Rights Campaign (HRC) Corporate Equity Index, and TIME 100 Most Influential Companies list.

Zillow Group is an equal opportunity employer committed to fostering an inclusive, innovative environment with the best employees. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please contact your recruiter directly.

Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable state and local law.

Applicants who receive job offers from Zillow Group will be asked to sign a Proprietary Rights Agreement which includes confidentiality, intellectual property assignment, customer and employee non-solicitation, and non-competition provisions. If you are contacted for a role at Zillow Group and wish to review a copy of the Proprietary Rights Agreement prior to receiving an offer, you may request a copy from your Recruiter.