Senior Data Engineer

A company is looking for a Senior Data Engineer to enable efficient data ingestion and delivery systems.

Key Responsibilities

Explore, analyze, and onboard data sets for processing and consumption

Develop and maintain scalable data pipelines for data collection and integration

Optimize data pipeline performance and implement quality control mechanisms

Required Qualifications

3+ years of experience in data engineering, including data modeling and ETL pipelines

Proficient in SQL for querying and processing data

Experience in Python and Spark for data processing

Familiarity with cloud-based tools and infrastructure management using Terraform and Kubernetes

Ability to design and maintain large-scale, reliable data pipeline systems