Talent.com
Senior Data Scientist, Research, Generative AI Factuality

Senior Data Scientist, Research, Generative AI Factuality

Google Inc.Mountain View, CA, United States
12 hours ago
Job type
  • Full-time
Job description

Senior Data Scientist, Research, Generative AI Factuality

Google, Mountain View, CA, USA

Master's degree in Statistics, Data Science, Mathematics, Physics, Economics, Operations Research, Engineering, a related quantitative field, or equivalent practical experience.

  • 5 years of work experience using analytics to solve product or business problems, coding (e.g., Python, R, SQL), querying databases or statistical analysis, or 3 years of work experience with a PhD degree.

Preferred qualifications :

8 years of work experience using analytics to solve product or business problems, coding (e.g., Python, R, SQL), querying databases or statistical analysis, or 6 years of work experience with a PhD degree.

  • Experience with LLM evaluation, including autoraters and log analysis.
  • About the job

    In this role, you will help evaluate and improve the quality of tools and products that apply AI to improve access to accurate and helpful information.

    The team is responsible for Gemini factuality and quality on info-seeking prompts. The goal is to ensure that models are as accurate as possible without compromising on any other response quality aspect, and ensuring that response structure and organization are helpful.

    The team is also responsible for factuality evaluations in Gemini, including defining factuality metrics, eval templates, and building high-quality autoraters. This role partners with various Gemini verticals : Factuality, Quality, Multi-Turn, Multilinguality, and Model Behavior.

    Responsibilities

  • Collaborate with stakeholders in cross-projects and team settings to identify and clarify business or product questions to answer, and provide feedback to translate and refine business questions into tractable analysis, evaluation metrics, or mathematical models.
  • Use custom data infrastructure or existing data models as appropriate, and design and evaluate models to mathematically express and solve defined problems with limited precedent.
  • Gather information, business goals, priorities, and organizational context around the questions to answer, as well as the existing and upcoming data infrastructure.
  • Own the process of gathering, extracting, and compiling data across sources via relevant tools (e.g., SQL, R, Python). Format, re-structure, or validate data to ensure quality, and review the dataset to ensure it is ready for analysis.
  • Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity / expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law.

    #J-18808-Ljbffr

    Create a job alert for this search

    Senior Data Scientist • Mountain View, CA, United States

    Related jobs
    • Promoted
    Associate Director, AI Data Scientist

    Associate Director, AI Data Scientist

    Jazz PharmaceuticalsPalo Alto, CA, United States
    Full-time
    If you are a current Jazz employee please apply via the Internal Career site.Jazz Pharmaceuticals is a global biopharma company whose purpose is to innovate to transform the lives of patients and ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - Data Science

    Senior Data Engineer - Data Science

    LinkedInSunnyvale, CA, United States
    Full-time
    LinkedIn is the worlds largest professional network, built to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover excit...Show moreLast updated: 3 days ago
    • Promoted
    Data Scientist II

    Data Scientist II

    VirtualVocationsHayward, California, United States
    Full-time
    A company is looking for a Data Scientist II to support product, leadership, and clinical teams through data analysis and optimization methods. Key Responsibilities Gather business requirements an...Show moreLast updated: 30+ days ago
    • Promoted
    Arizona AI Data Specialist

    Arizona AI Data Specialist

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for an AI Data Specialist to support the improvement of AI-generated content in English.Key Responsibilities Perform data collection, evaluation, and annotation Conduct pair...Show moreLast updated: 2 days ago
    • Promoted
    Senior AI Engineer

    Senior AI Engineer

    VirtualVocationsSanta Clara, California, United States
    Full-time
    A company is looking for a Senior AI Engineer.Key Responsibilities Design, build, and own LLM-powered services and orchestration for reliable, low-latency experiences Develop prompts, retrieval ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Director of AI

    Senior Director of AI

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Senior Director, Artificial Intelligence.Key Responsibilities Develop and execute the enterprise AI strategy and governance framework Identify and incubate innovative ...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Scientist, Analytics - Ads Product and GTM

    Senior Data Scientist, Analytics - Ads Product and GTM

    King River Capital GroupSan Francisco, CA, United States
    Full-time
    Senior Data Scientist, Analytics - Ads Product and GTM.Discord is used by over 200 million people every month for many different reasons, but there’s one thing that nearly everyone does on our plat...Show moreLast updated: 1 day ago
    • Promoted
    R&D Senior Data Scientist

    R&D Senior Data Scientist

    Division5Palo Alto, CA, United States
    Full-time
    In this role, you’ll own the end-to-end lifecycle of advanced ML / DL systems—from research and data strategy to deployment—while shaping our technical roadmap and mentoring peers.If you are passiona...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Scientist, Search and Recommender Systems- VenturaOS

    Senior Data Scientist, Search and Recommender Systems- VenturaOS

    The Trade DeskSan Jose, CA, United States
    Full-time
    We're a small, high-impact team building the next-generation TV operating system.Our flexible structure gives engineers direct influence over product direction-an opportunity rarely found in larger...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Bioinformatics Scientist

    Senior Bioinformatics Scientist

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Senior Bioinformatics Scientist.Key Responsibilities Lead data analysis and interpretation of complex biological datasets, including next-generation sequencing and meta...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Scientist, Research, AI Mode

    Senior Data Scientist, Research, AI Mode

    Google Inc.Mountain View, CA, United States
    Full-time
    Senior Data Scientist, Research, AI Mode.Mountain View, CA, USA; New York, NY, USA.Note : By applying to this position you will have an opportunity to share your preferred working location from the ...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Scientist, AI Foundations

    Senior Data Scientist, AI Foundations

    Capital One National AssociationSan Jose, CA, United States
    Full-time +1
    Senior Data Scientist, AI Foundations.Data is at the center of everything we do.As a startup, we disrupted the credit card industry by personally personalizing every offer using statistical modelin...Show moreLast updated: 16 days ago
    • Promoted
    Data Scientist

    Data Scientist

    VirtualVocationsHayward, California, United States
    Full-time
    A company is looking for a Data Scientist, Watchlist.Key Responsibilities Design, develop, and implement machine learning models and statistical algorithms for fraud detection and identity verifi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Scientist, Analytics

    Senior Data Scientist, Analytics

    King River Capital GroupSan Francisco, CA, United States
    Full-time
    Discord is used by over 200 million people every month for many different reasons, but there’s one thing that nearly everyone does on our platform : . Over 90% of our users play games, spending a comb...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Research Engineer

    Senior Research Engineer

    VirtualVocationsSan Jose, California, United States
    Full-time
    A company is looking for a Senior Research Engineer - Multimodal & Video Foundation Model.Key Responsibilities Pioneer multimodal and video-centric research, contributing to usable prototypes and...Show moreLast updated: 10 days ago
    • Promoted
    Senior Data Scientist - AI / ML Engineer

    Senior Data Scientist - AI / ML Engineer

    Altimate.aiSunnyvale, CA, US
    Full-time
    Altimate AI, founded in 2022 in San Francisco, is revolutionizing enterprise data operations through the power of AI.Our mission is to alleviate the burden on overworked and understaffed enterprise...Show moreLast updated: 28 days ago
    • Promoted
    Senior Data Scientist

    Senior Data Scientist

    VirtualVocationsSan Jose, California, United States
    Full-time
    A company is looking for a Senior Data Scientist to join their Data team in the Product organization.Key Responsibilities Identify growth opportunities and analyze patient behaviors to inform pro...Show moreLast updated: 30+ days ago
    • Promoted
    Director of Data Science

    Director of Data Science

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Director of Data Science.Key Responsibilities Define and execute a data science strategy aligned with business objectives Recruit, mentor, and develop a high-performin...Show moreLast updated: 30+ days ago