Talent.com
Director, Engineering, TPU Performance

Director, Engineering, TPU Performance

GoogleSunnyvale, CA, US
7 days ago
Job type
  • Full-time
Job description

Director, Engineering, TPU Performance

Google's future is AI, and our team is responsible for powering the transformation. Core ML supports the AI infrastructure used by every part of Google, from DeepMind to Search, YouTube, Ads, and more. We also enable Google Cloud users and Open Source communities to join this revolution, creating the tools to access and use the world's most powerful AI supercomputers (Tensor Processing Units and the latest GPUs).

As the Engineering Director for the TPU Performance team, you will lead an organization dedicated to maximizing the efficiency and performance of Google's machine learning workloads. You will be at the forefront of AI / ML innovation, driving the strategy and execution for optimizing large-scale model training and serving on our cutting-edge accelerator hardware.

The ML, Systems, & Cloud AI (MSCA) organization at Google designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services (Search, YouTube, etc.) and Google Cloud. Our end users are Googlers, Cloud customers and the billions of people who use Google services around the world.

We prioritize security, efficiency, and reliability across everything we do - from developing our latest TPUs to running a global network, while driving towards shaping the future of hyperscale computing. Our global impact spans software and hardware, including Google Cloud's Vertex AI, the leading AI platform for bringing Gemini models to enterprise customers.

The US base salary range for this full-time position is $294,000-$414,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google.

Minimum Qualifications :

  • Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience.
  • 15 years of professional experience in software development, with a focus on performance analysis, distributed systems, or a related area.
  • 5 years of experience in a leadership role, managing engineering teams and driving cross-functional projects.
  • Experience with machine learning frameworks (e.g., JAX, PyTorch, TensorFlow).
  • Experience with machine learning model architectures, algorithmic performance, large-scale pretraining, low-latency serving, etc.
  • Experience with hardware accelerators (e.g., TPUs, GPUs) and their programming models.

Preferred Qualifications :

  • Master's degree or PhD in Computer Science or a related field.
  • Excellent communication skills, with the ability to influence and align senior leaders and stakeholders across the company.
  • Strong business acumen and the ability to make strategic decisions that balance technical trade-offs with business needs.
  • Proven track record of delivering significant performance and efficiency improvements in large-scale systems.
  • Deep expertise in computer architecture, compilers, and performance analysis tools.
  • Responsibilities :

  • Lead and grow a large, globally distributed team of software engineers and technical leaders, fostering a culture of innovation, collaboration, and inclusivity.
  • Develop and execute a long-term technical vision and strategy for ML performance and efficiency, aligning with Google's broader AI / ML and business objectives.
  • Drive the successful delivery of large-scale, business-critical projects, including the optimization of flagship models like Gemini and the continuous improvement of fleet-wide TPU utilization.
  • Build and maintain strong relationships with senior leadership and key stakeholders across product areas like GDM / Gemini, Search, YouTube, Ads, and Cloud / Vertex.
  • Provide technical guidance and oversight on complex performance challenges, from low-level hardware optimizations to high-level algorithmic and system-wide improvements.
  • Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google's Applicant and Candidate Privacy Policy.

    Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity / expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy, Know Your Rights : Workplace Discrimination Is Illegal, Belonging at Google, and How We Hire.

    If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form.

    Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.

    To all recruitment agencies : Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.

    Create a job alert for this search

    Director Engineering • Sunnyvale, CA, US

    Related jobs
    • Promoted
    Director, Engineering - Clinical Products

    Director, Engineering - Clinical Products

    HeartFlow, IncSan Francisco, CA, United States
    Full-time
    Heartflow is a medical technology company advancing the diagnosis and management of coronary artery disease, the #1 cause of death worldwide, using cutting-edge technology.The flagship product—an A...Show moreLast updated: 30+ days ago
    • Promoted
    Sr. Director Engineering

    Sr. Director Engineering

    UniphorePalo Alto, CA, United States
    Full-time
    Uniphore is one of the largest B2B AI-native companies—decades-proven, built-for-scale and designed for the enterprise.The company drives business outcomes across multiple industry verticals and en...Show moreLast updated: 30+ days ago
    • Promoted
    Director, Engineering

    Director, Engineering

    Otsuka Pharmaceutical Co., LtdPalo Alto, CA, United States
    Full-time
    Director, Engineering page is loaded## Director, Engineeringremote type : Onsitelocations : Palo Altotime type : Full timeposted on : Posted 2 Days Agojob requisition id : R10061At Recor Medic...Show moreLast updated: 30+ days ago
    • Promoted
    America's Engineering Ops Director

    America's Engineering Ops Director

    Utah StaffingSan Jose, CA, US
    Full-time
    America's Engineering Ops Director.As a CBRE Engineering Ops Director, you will manage the team responsible for managing the performance of MEP (mechanical, electrical, and plumbing systems) and ma...Show moreLast updated: 1 day ago
    • Promoted
    Director Engineering, Mobile

    Director Engineering, Mobile

    Intuit Inc.Mountain View, CA, United States
    Full-time
    Are you ready to redefine mobile for millions of small businesses? Intuit is putting mobile at the forefront, and we're seeking a visionary. Director of Engineering, QuickBooks Mobile.It's an opport...Show moreLast updated: 30+ days ago
    • Promoted
    Director, Platform Engineering

    Director, Platform Engineering

    ConductorSan Francisco, CA, United States
    Full-time
    We are open to NYC or San Francisco based candidates.The rise of generative AI is fundamentally changing how people search for information and discover brands online. Conductor is the only end-to-en...Show moreLast updated: 26 days ago
    • Promoted
    Sr. Director Engineering

    Sr. Director Engineering

    Uniphore Technologies Inc.Palo Alto, CA, United States
    Full-time
    Director Engineering page is loaded## Sr.Director Engineeringlocations : USA - CA - Palo Altotime type : Full timeposted on : Posted Todayjob requisition id : JR100662Uniphore is one of the lar...Show moreLast updated: 21 days ago
    • Promoted
    Director of Engineering - Platform

    Director of Engineering - Platform

    RipplingSan Francisco, CA, United States
    Full-time
    Rippling gives businesses one place to run HR, IT, and Finance.It brings together all of the workforce systems that are normally scattered across a company, like payroll, expenses, benefits, and co...Show moreLast updated: 19 days ago
    • Promoted
    Sr. Director, Engineering

    Sr. Director, Engineering

    DigitalOceanSan Francisco, CA, United States
    Full-time
    Get AI-powered advice on this job and more exclusive features.Dive in and do the best work of your career at DigitalOcean. Journey alongside a strong community of top talent who are relentless in th...Show moreLast updated: 26 days ago
    • Promoted
    Director, Engineering

    Director, Engineering

    Recor MedicalPalo Alto, CA, United States
    Full-time
    At Recor Medical, we are pioneering Ultrasound Renal Denervation (uRDN) therapy to treat hypertension, the leading cardiovascular risk factor in the world. With our Paradise uRDN System, we’re on a ...Show moreLast updated: 30+ days ago
    • Promoted
    Director, Application Engineering

    Director, Application Engineering

    Klaviyo Inc.San Francisco, CA, United States
    Full-time
    At Klaviyo, we value the unique backgrounds, experiences and perspectives each Klaviyo (we call ourselves Klaviyos) brings to our workplace each and every day. We believe everyone deserves a fair sh...Show moreLast updated: 30+ days ago
    • Promoted
    Director, Engineering Management - (M6)

    Director, Engineering Management - (M6)

    Applied MaterialsSanta Clara, CA, US
    Full-time
    Etch Service Business Unit (SBU) FSO Focal Director.This leadership role leads all aspects of service operations for the Etch and SRP Service Business Unit (SBU) supporting the after-market busines...Show moreLast updated: 30+ days ago
    • Promoted
    Director, Solutions Engineering

    Director, Solutions Engineering

    BetterUp, Inc.San Francisco, CA, United States
    Full-time
    Let’s face it, a company whose mission is human transformation better have some fresh thinking about the employer / employee relationship. We can’t cram it all in here, but you’ll start noticing it fr...Show moreLast updated: 17 days ago
    • Promoted
    Director, Facilities Engineering

    Director, Facilities Engineering

    Analog DevicesSan Jose, CA, United States
    Full-time
    Director, Facilities Engineering.Be among the first 25 applicants.Director, Facilities Engineering.NASDAQ : ADI) is a global semiconductor leader that bridges the physical and digital worlds to enab...Show moreLast updated: 30+ days ago
    • Promoted
    Director, Engineering, TPU Performance

    Director, Engineering, TPU Performance

    Google Inc.Sunnyvale, CA, United States
    Full-time
    Google place Sunnyvale, CA, USA bar_chart Director+.Bachelor’s degree in Computer Science, a related technical field, or equivalent practical experience. Experience with machine learning frameworks ...Show moreLast updated: 3 days ago
    • Promoted
    Engineering Director

    Engineering Director

    Jibe VenturesSan Francisco, CA, United States
    Full-time
    We’re a Bay Area Cyber AI startup (with support for working remotely).We’ve raised funding from top tier investors.We’re a small team of researchers and engineers with a deep focus in cyber and AI....Show moreLast updated: 30+ days ago
    • Promoted
    Engineering Director

    Engineering Director

    AdyenSan Francisco, CA, United States
    Full-time
    Adyen provides payments, data, and financial products in a single solution for customers like Facebook, Uber, H&M, and Microsoft - making us the financial technology platform of choice.At Adyen, ev...Show moreLast updated: 26 days ago
    • Promoted
    Engineering Operations Director

    Engineering Operations Director

    Cadence Design SystemsSan Jose, CA, United States
    Full-time
    Engineering Operations Director page is loaded## Engineering Operations Directorlocations : SAN JOSEtime type : Full timeposted on : Posted Todayjob requisition id : R51673## • •At Cadence, we h...Show moreLast updated: 1 day ago