Sr Data Engineer

Position Overview

The Senior Data Engineer will be instrumental in reshaping how data is collected, processed, and leveraged throughout the organization. This role centers on breaking down data silos, automating processes, and ensuring reliable data delivery to support critical business decisions. The engineer will lead initiatives to enhance data pipelines, strengthen infrastructure, and improve overall data quality, scalability, and performance.

Operating in an Agile environment, this position requires close collaboration with cross-functional teams to design and implement innovative, data-driven solutions. The ideal candidate will possess strong technical expertise in Databricks, ETL development, and automated data workflows, with the ability to build and manage large-scale, high-efficiency data systems.

Responsibilities

• Design, build, and maintain data pipelines and ETL processes using Databricks, SQL, and Python.
• Develop and optimize batch ETL workflows and integrate Kafka streaming solutions.
• Participate in Agile sprints to deliver scalable, mission-aligned data capabilities.
• Enhance data quality, governance, and consistency across multiple domains.
• Create, test, and deploy automated solutions for extracting, transforming, and loading data between systems.
• Engage in backlog refinement, sprint planning, and technical reviews to ensure alignment with business objectives.
• Drive continuous improvements in data infrastructure and analytics enablement.
• Build subject matter expertise in assigned business areas.
• Collaborate with developers to assess operational and reporting impacts throughout the SDLC.

Requirements