Talent.com
Senior Data Engineer
Senior Data EngineerSpotify • New York, NY, US
Senior Data Engineer

Senior Data Engineer

Spotify • New York, NY, US
21 hours ago
Job type
  • Full-time
Job description

Job Description

Job Description

Our mission on the Advertising Product & Technology team is to build a next generation advertising platform that aligns with our unique value proposition for audio and video. We work to scale the user experience for hundreds of millions of fans and hundreds of thousands of advertisers. This scale brings unique challenges as well as tremendous opportunities for our artists and creators.

Within Spotify’s Advertising mission, the Audiences team is building products right in the heart of our business. We own Rolodex, a system that powers targeting and is key to respecting privacy and feeding other crucial systems. We are looking for a Senior Data Engineer, eager to work on critical data pipelines and infrastructure that power the current and next generation audience products ensuring they are reliable, scalable and deliver high-quality data.

What You'll Do

  • Design, develop and maintain robust, scalable batch and streaming pipelines using Scio, GCP (BigQuery, Dataflow, GCS), and our orchestration stack including Flyte and Styx.
  • Build and optimize high-throughput, low-latency pipelines for exciting projects such as Contextual Targeting, Custom Website (ie Pixel-based) Audiences, Artist Affinity audiences and more.
  • Collaborate closely with Machine Learning and Staff engineers to design and build strategic products such as the ML-driven 1st party Audiences and the next generation of Lookalike Audiences.
  • Take charge of the architecture and development of upcoming key projects such as Pre and Post Campaign Insights, and the creation of Audiences based on the unique data we have about our users.
  • Champion scalability, testability, maintainability, reliability and high-quality code, ensuring we follow Spotify’s Golden Path technologies.
  • Work in a T-shaped environment, collaborating with engineers, product managers, and other stakeholders, embracing learning and leadership opportunities daily.
  • Lead on data architecture and design decisions when needed, while also being comfortable executing on plans, pair-programming and debugging with your teammates.

Who You Are

  • Proven experience working with distributed, high-volume production data pipelines and services, and heterogeneous data and tools such as BigQuery and BigTable
  • Strong programming skills in Java and / or Scala, with hands-on experience in frameworks like Scio
  • Commitment to agile software processes, data-driven development, reliability, and responsible experimentation
  • Hands-on experience with orchestration tools like Flyte and Styx
  • Excellent problem-solving and communication skills
  • Strong interest in, and ideally some experience with, either machine learning or backend development
  • Where You'll Be

  • We offer you the flexibility to work where you work best! For this role, you can be within the North American region as long as we have a work location.
  • This team operates within the EST time zone for collaboration.
  • The United States base range for this position is $160,091- $228,702 plus equity. The benefits available for this position include health insurance, six month paid parental leave, 401(k) retirement plan, monthly meal allowance, 23 paid days off, 13 paid flexible holidays, paid sick leave. These ranges may be modified in the future.

    Spotify is an equal opportunity employer. You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens.

    At Spotify, we are passionate about inclusivity and making sure our entire recruitment process is accessible to everyone. We have ways to request reasonable accommodations during the interview process and help assist in what you need. If you need accommodations at any stage of the application or interview process, please let us know - we’re here to support you in any way we can.

    Spotify transformed music listening forever when we launched in 2008. Our mission is to unlock the potential of human creativity by giving a million creative artists the opportunity to live off their art and billions of fans the chance to enjoy and be passionate about these creators. Everything we do is driven by our love for music and podcasting. Today, we are the world’s most popular audio streaming subscription service.

    We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

    Create a job alert for this search

    Senior Data Engineer • New York, NY, US

    Related jobs
    Senior Sales Engineer

    Senior Sales Engineer

    VirtualVocations • Yonkers, New York, United States
    Full-time
    A company is looking for a Senior Sales Engineer in SoCal (OC / LA).Key Responsibilities Understand customer business drivers and connect technology solutions to measurable outcomes Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Data Engineer

    Cloud Data Engineer

    VirtualVocations • Newark, New Jersey, United States
    Full-time
    A company is looking for a Cloud Data Engineer to join the Data Office Team in modernizing enterprise analytics.Key Responsibilities Design and develop data pipelines and ELT processes to integra...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    New York Blood Center • Rye, NY, United States
    Full-time
    NYBC is part of New York Blood Center Enterprises (NYBCe), which spans 17+ states and delivers one million blood products to 400+ U. NYBCe additionally delivers cellular therapies, specialty pharmac...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocations • Astoria, New York, United States
    Full-time
    A company is looking for a Senior Software Engineer, Data Engineering.Key Responsibilities : Design, develop, and implement scalable and secure data solutions Create and maintain logical and phys...Show more
    Last updated: 30+ days ago • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    Argonaut Management Services, Inc • New York, NY, United States
    Full-time
    Argo Group International Holdings, Inc.American National, US based specialty P&C companies, (together known as BP&C, Inc. Brookfield Wealth Solutions, Ltd.BWS"), a New York and Toronto-listed public...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer Lead

    Data Engineer Lead

    VirtualVocations • Bronx, New York, United States
    Full-time
    A company is looking for a Data Engineer Lead to support and enhance their AWS cloud analytical environment.Key Responsibilities Monitor system performance and ensure optimal operation of the AWS...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    The Computer Merchant, LTD. • Newark, NJ, US
    Full-time
    JOB TITLE : DATA ENGINEER JOB LOCATION : NEWARK, NJ (HYBRID) WAGE RANGE • : 60.PER HOUR JOB NUMBER : SAIJP00038347 REQUIRED EXPERIENCE : Ingest data from SAP, Salesforce, Google Analytics, OKTA, and othe...Show more
    Last updated: 4 days ago • Promoted
    Professional Data Engineer

    Professional Data Engineer

    VirtualVocations • Jamaica, New York, United States
    Full-time
    A company is looking for a Data Engineer who will be responsible for building operational reporting solutions and integrating data sources for data-driven decision-making.Key Responsibilities Col...Show more
    Last updated: 2 days ago • Promoted
    ETL Data Engineer

    ETL Data Engineer

    VirtualVocations • Paterson, New Jersey, United States
    Full-time
    A company is looking for a Data Engineer for a contract role.Key Responsibilities Develop Ab Initio jobs and workflows within the existing metadata-driven framework Review requirements and sourc...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    VirtualVocations • Paterson, New Jersey, United States
    Full-time
    A company is looking for a Data Engineer (AML).Key Responsibilities Design and build reliable data load processes and utilities for data transformation Implement data solutions using.NET, SSIS, ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Cloud Data Engineer

    Senior Cloud Data Engineer

    VirtualVocations • Elizabeth, New Jersey, United States
    Full-time
    A company is looking for a Senior Cloud Data Engineer.Key Responsibilities Design and build scalable ETL pipelines in Databricks using PySpark and Spark SQL Migrate legacy ETL processes to cloud...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data and AI Engineer

    Senior Data and AI Engineer

    VirtualVocations • Newark, New Jersey, United States
    Full-time
    A company is looking for a Senior Data and AI Systems Engineer to lead the integration of data and AI systems for a digital assistant in the K-12 education sector. Key Responsibilities Design and ...Show more
    Last updated: 1 day ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocations • Yonkers, New York, United States
    Full-time
    A company is looking for a Lead Data Engineer (Remote).Key Responsibilities Lead the design, implementation, and management of Data Integration Frameworks Develop and maintain infrastructure sys...Show more
    Last updated: 30+ days ago • Promoted
    Senior DataOps Engineer

    Senior DataOps Engineer

    VirtualVocations • Flushing, New York, United States
    Full-time
    A company is looking for a Senior DataOps Engineer to build and optimize its data infrastructure.Key Responsibilities Build, scale, and optimize the data platform using tools like Databricks and ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Analytics Engineer

    Senior Analytics Engineer

    VirtualVocations • Flushing, New York, United States
    Full-time
    A company is looking for a Senior Analytics Engineer.Key Responsibilities : Build analytical models to drive app design and enhance student understanding Architect data warehouse schemas and SQL ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer II

    Data Engineer II

    VirtualVocations • Elizabeth, New Jersey, United States
    Full-time
    A company is looking for a Data Engineer II - Data Platform (REMOTE).Key Responsibilities Supports end users in designing and building data pipelines using platforms like Snowflake, Databricks, a...Show more
    Last updated: 30+ days ago • Promoted
    Data Analytics Engineer

    Data Analytics Engineer

    VirtualVocations • Elizabeth, New Jersey, United States
    Full-time
    A company is looking for a Data Analytics Engineer to work with operational and customer stakeholders on data acquisition, processing, and analysis. Key Responsibilities Collaborate with data engi...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer - Databricks

    Data Engineer - Databricks

    VirtualVocations • Paterson, New Jersey, United States
    Full-time
    A company is looking for a Technical Consultant specializing in Databricks.Key Responsibilities Design, develop, and maintain ETL / ELT pipelines and Databricks notebooks for data ingestion, transf...Show more
    Last updated: 2 days ago • Promoted
    Senior Software Engineer - Data Platform

    Senior Software Engineer - Data Platform

    Relativity • Newark, NJ, United States
    Full-time
    Join our team as we reimagine and modernize the core of Relativity's data architecture.You'll play a pivotal role in transforming the Document Data Model (DDM)-a foundational component of our platf...Show more
    Last updated: 30+ days ago • Promoted
    Principal Data Engineer

    Principal Data Engineer

    VirtualVocations • Paterson, New Jersey, United States
    Full-time
    A company is looking for a Principal Data Engineer to join their Data Engineering team.Key Responsibilities Design, implement, and maintain data models, pipelines, and architecture for healthcare...Show more
    Last updated: 30+ days ago • Promoted