Talent.com
Senior Data Engineer, Scala

Senior Data Engineer, Scala

MagniteNew York, NY, US
11 hours ago
Job type
  • Full-time
Job description

Senior Data Engineer, Scala

New York City, NY

Boston, MA

At Magnite, we cultivate an environment of continuous growth and collaboration. Our work impacts what millions of people read, watch, and buy, and we're looking for people to help us tackle that responsibility with creativity and focus. Magnite (NASDAQ : MGNI) is the world's largest independent sell-side advertising platform. Publishers use our technology to monetize their content across all screens and formats including CTV / streaming, online video, display, and audio. Our tech fuels billions of transactions per day!

Magnite conducts 400+ billion ad request auctions daily carrying $450+ million of revenue annually. To stand out among competitors, Magnite strategically focuses on being the most efficient, highest scale independent exchange.

About this team :

The Streaming Organization's Data Engineering team owns the applications and infrastructure that make up the Streaming Org's data pipeline, handling ~40 billion events per day at an average of 400-500 thousand per second. This data underpins the Streaming business - including client reporting, internal data science, account managers, and product + business teams - and as such we need to build systems that remain scalable and efficient at this volume of data while also ensuring data consistency and reliability. We value communication, discussion, and sharing of ideas to come to the best technical solutions to our large-scale data challenges. We are looking for people who want to get things done and value open collaboration (including constructive feedback when brainstorming). Our end-to-end ownership of the data world includes both typical data-engineering type problems (think Spark pipelines, ETL processing, etc) and more general software-engineering tech as well (think Java applications, API design, etc).

In this role you will :

Get to work on handling internet-scale data problems

Help architect and build systems to process our data volume to empower all consumers

Join in on full end-to-end ownership of the team's data pipeline and related systems for data delivery

Be a part of and promote our culture of collaboration and mentorship

Typical challenges we face in this role include :

Highly-scalable infrastructure : Our traffic has patterns with peak- and off-peak times and seasonal shifts, and our data infrastructure needs to be able to respond accordingly

Cost optimization : Improving profit margins by lowering the infrastructure cost basis through building efficient systems

Technical architecture considerations given various SLAs for data delivery

We're looking for someone :

With 4+ years of software development experience with a BS / MS Computer Science or equivalent work experience

Who wants to take ownership. We are responsible for the entire software development lifecycle, from requirements gathering to production support

To engage in critical and creative thinking. We expect engineers to present and discuss tradeoffs to solve the problems we face

With either existing experience designing and building systems that work with large-scale data volumes and data ingestion systems at scale in a cloud-first setting, OR established technical excellence with a desire to learn and crush the data engineering world

Our current tech stack :

Java or Scala for core application development

Spark (batch + streaming) for data pipeline development, currently based on Databricks

Terraform, Docker, Jenkins for CI / CD / infra / application deployment

Airflow for job orchestration

AWS-based cloud infrastructure including RDS, EC2, S3, Kinesis, ECS

Comprehensive Perks and Benefits :

Comprehensive Healthcare Coverage for You and Your Family from Day One

Generous Time Off

Holiday Breaks, Summer Fridays and Quarterly Wellness Days

Equity and Employee Stock Purchase Plan

Family-Focused Benefits and Parental Leave

401k Retirement Savings Plan with Employer Match

Disability and Life Insurance

Cell Phone Subsidy

Fitness and Wellness Reimbursement

Company Culture :

Community Service and Volunteer Events

Company-Matched Charitable Contributions

Wellness Coach and Mental Health Support

Career Development Initiatives and a Career Growth Framework

Culture and Inclusion Programs

Bonusly Peer-to-Peer Recognition Program

About Us

The world's leading agencies and brands trust our platform to access brand-safe, high-quality ad inventory and execute billions of advertising transactions each month. Anchored in bustling New York City, sunny Los Angeles, mile high Denver, historic London, and down under in Sydney, Magnite has offices across North America, EMEA, LATAM, and APAC.

The base salary range for this position, across all United States geographies, is $150,000 - $170,000 per year. The upper portion of the salary range is typically reserved for existing employees who demonstrate strong performance over time.

Magnite is an Equal Opportunity Employer and does not discriminate against applicants due to race, color, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, sexual orientation or any other federal, state or local protected class.

Our Commitment : We aim to incorporate a wide range of voices into our Magnite culture, cultivating an environment where employees feel welcomed, cared for, and encouraged to freely share ideas. We are committed to employee growth, collaboration, inclusion, and innovation. We invest in Magnite's local communities. We seek talent from all backgrounds to champion corporate values of seeing the big picture and being catalysts of change.

Want to learn more about us?

Check out our

blog

for Magnite announcements and Ad Tech industry news!

Recruiting Agency Notice

Magnite does not accept agency resumes and is not responsible for any fees related to unsolicited resumes.

J-18808-Ljbffr

Create a job alert for this search

Senior Data Engineer • New York, NY, US

Related jobs
  • Promoted
Data Engineer II

Data Engineer II

VirtualVocationsBronx, New York, United States
Full-time
A company is looking for a Data Engineer II.Key Responsibilities Designing, developing, and maintaining software applications that process large volumes of data Collaborating with cross-function...Show moreLast updated: 30+ days ago
  • Promoted
Data Engineer I

Data Engineer I

VirtualVocationsPaterson, New Jersey, United States
Full-time
A company is looking for a Data Engineer I to develop and operationalize data pipelines for improved health outcomes.Key Responsibilities Design and implement standardized data management procedu...Show moreLast updated: 30+ days ago
  • Promoted
Senior Data Management Engineer

Senior Data Management Engineer

VirtualVocationsElizabeth, New Jersey, United States
Full-time
A company is looking for a Senior Data Management Engineer.Key Responsibilities Utilize expertise in Data Lineage, Cataloging, and Reconciliation technologies to enhance customer operations Coll...Show moreLast updated: 9 days ago
  • Promoted
Senior Data Engineer

Senior Data Engineer

VirtualVocationsNewark, New Jersey, United States
Full-time
A company is looking for a Senior Data Engineer to lead the development of scalable data processing and enrichment pipelines. Key Responsibilities Design and implement scalable AI-powered data pro...Show moreLast updated: 30+ days ago
  • Promoted
Sr. Data Engineer

Sr. Data Engineer

Argonaut Management Services, IncNew York, NY, United States
Full-time
Argo Group International Holdings, Inc.American National, US based specialty P&C companies, (together known as BP&C, Inc. Brookfield Wealth Solutions, Ltd.BWS"), a New York and Toronto-listed public...Show moreLast updated: 30+ days ago
  • Promoted
Principal Data Engineer

Principal Data Engineer

VirtualVocationsNewark, New Jersey, United States
Full-time
A company is looking for a Principal Data Engineer with extensive experience in high-transaction e-commerce environments. Key Responsibilities Develop and maintain ETL / ELT pipelines in Python and ...Show moreLast updated: 30+ days ago
  • Promoted
GCP Data Engineer

GCP Data Engineer

VirtualVocationsYonkers, New York, United States
Full-time
A company is looking for a GCP Data Engineer to design and implement scalable data pipelines on Google Cloud Platform.Key Responsibilities Build and maintain streaming and batch data pipelines us...Show moreLast updated: 30+ days ago
  • Promoted
Azure Data Engineer

Azure Data Engineer

VirtualVocationsBronx, New York, United States
Full-time
A company is looking for an Azure Developer-Data Engineer.Key Responsibilities Design, develop, and deploy scalable Azure-based data ingestion, transformation, and curation pipelines Implement d...Show moreLast updated: 30+ days ago
  • Promoted
Senior Databricks Engineer

Senior Databricks Engineer

VirtualVocationsYonkers, New York, United States
Full-time
A company is looking for a Senior Databricks Engineer / Cloud Data Engineer (Remote).Key Responsibilities Design, build, and optimize data pipelines using Databricks, Apache Spark, and Delta Lake...Show moreLast updated: 2 days ago
  • Promoted
Data Engineer III

Data Engineer III

VirtualVocationsBronx, New York, United States
Full-time
A company is looking for a Data Engineer III to design, develop, and maintain data pipelines and systems.Key Responsibilities Design, develop, and maintain data pipelines and infrastructure using...Show moreLast updated: 30+ days ago
  • Promoted
Data Engineer

Data Engineer

VirtualVocationsJamaica, New York, United States
Full-time
A company is looking for a Data Engineer to design, construct, and maintain scalable data management systems.Key Responsibilities Develop and maintain data architectures, including databases and ...Show moreLast updated: 30+ days ago
  • Promoted
Data Engineer Contractor

Data Engineer Contractor

VirtualVocationsPaterson, New Jersey, United States
Full-time
A company is looking for an Independent Contractor, Data Engineer, Business Operations.Key Responsibilities Build and maintain a scalable Databricks lakehouse for business operations data Design...Show moreLast updated: 2 days ago
  • Promoted
Senior Data Platform Engineer

Senior Data Platform Engineer

VirtualVocationsBronx, New York, United States
Full-time
A company is looking for a Senior Data Platform Engineer.Key Responsibilities Enhance and improve the performance and reliability of existing Data Platform Services Design and build self-service...Show moreLast updated: 30+ days ago
  • Promoted
Senior Data Insights Engineer

Senior Data Insights Engineer

VirtualVocationsNewark, New Jersey, United States
Full-time
A company is looking for a Senior Data Insights Engineer.Key Responsibilities Design, develop, and maintain scalable data models for reporting and analytics Develop and maintain dashboards using...Show moreLast updated: 1 day ago
  • Promoted
Senior Data Engineer - Data & Analytics

Senior Data Engineer - Data & Analytics

PROGYNYNew York, NY, United States
Full-time
Thank you for considering Progyny!.Data is the lifeblood of healthcare, and Progyny as a company depends on the accurate, timely, and secure management of data to achieve our company mission at the...Show moreLast updated: 30+ days ago
  • Promoted
Senior Data Infrastructure Engineer

Senior Data Infrastructure Engineer

VirtualVocationsNew York, New York, United States
Full-time
A company is looking for a Senior Data Infrastructure Engineer to enhance its core data infrastructure and support advanced applications. Key Responsibilities Own and maintain data pipeline archit...Show moreLast updated: 30+ days ago
  • Promoted
Lead Data Engineer

Lead Data Engineer

VirtualVocationsNewark, New Jersey, United States
Full-time
A company is looking for a Lead Data Engineer to architect and scale their data platform and analytics stack.Key Responsibilities Refine and evolve the AWS data platform to enhance analytical cap...Show moreLast updated: 30+ days ago
  • Promoted
Staff Data Engineer

Staff Data Engineer

VirtualVocationsElizabeth, New Jersey, United States
Full-time
A company is looking for a Staff Data Engineer - Hybrid.Key Responsibilities Design, build, and maintain scalable data models and ETL / ELT pipelines for enterprise analytics and reporting Develop...Show moreLast updated: 30+ days ago
  • Promoted
Senior Data Analytics Engineer

Senior Data Analytics Engineer

VirtualVocationsBronx, New York, United States
Full-time
A company is looking for a Senior Data Analytics Engineer.Key Responsibilities Design and implement advanced data models and analytics solutions Develop and optimize scalable data pipelines and ...Show moreLast updated: 30+ days ago
  • Promoted
Senior Software Engineer - Data Platform

Senior Software Engineer - Data Platform

RelativityNewark, NJ, United States
Full-time
Join our team as we reimagine and modernize the core of Relativity's data architecture.You'll play a pivotal role in transforming the Document Data Model (DDM)-a foundational component of our platf...Show moreLast updated: 30+ days ago