EV Senior Data Engineer

Overview

We are seeking a highly skilled Senior Data Engineer to join our dynamic team and lead the migration of our existing datamarts from Amazon Redshift and Microsoft SQL Server to Snowflake. This pivotal role is essential to modernizing our data infrastructure, ensuring scalable, reliable, and efficient data platforms that empower business intelligence and analytics. The ideal candidate will bring deep expertise in data engineering, data modeling, ETL / ELT processes, and cloud data platforms, working collaboratively within an Agile environment to deliver high-quality data solutions that drive strategic decision-making.

Responsibilities

• Lead the migration of existing datamarts currently hosted on Amazon Redshift and Microsoft SQL Server to Snowflake, ensuring minimal disruption and optimized performance.
• Plan and execute the decommissioning of legacy datamarts post-migration, ensuring data integrity and continuity.
• Design and implement robust, scalable data models tailored for Snowflake's architecture to support efficient querying and analytics.
• Rework and optimize existing ingestion and transformation pipelines, transitioning from traditional ETL to modern ELT paradigms where appropriate.
• Develop and maintain orchestration workflows using tools such as Apache Airflow to automate data ingestion, transformation, and pipeline execution.
• Establish and enforce data quality standards and validation processes to ensure accuracy, consistency, and reliability of data across platforms.
• Implement continuous integration and continuous deployment (CI / CD) practices for data pipelines to accelerate development cycles and improve deployment reliability.
• Work closely with cross-functional teams including data engineers, software engineers, data analysts, and business stakeholders in an Agile environment to deliver iterative improvements and meet project goals.
• Proactively identify bottlenecks and inefficiencies in data workflows and propose innovative solutions to enhance system performance and scalability.
• Maintain comprehensive documentation of data models, pipelines, and processes, and share knowledge to foster team growth and best practices.

Requirements

Must-Have Skills

Expertise in Snowflake data warehousing platform, including schema design, performance tuning, and leveraging Snowflake's unique features such as micro-partitioning, zero-copy cloning, and time travel to optimize data storage and retrieval.

Strong experience with Amazon Redshift, including understanding of its architecture, query optimization, and migration challenges when transitioning to Snowflake.

Proficiency in Microsoft SQL Server for managing legacy datamarts, writing complex SQL queries, stored procedures, and understanding relational database concepts.

Advanced SQL skills for data querying, transformation, and troubleshooting across multiple database platforms.

Ability to design normalized and denormalized data models that support efficient analytics and reporting, tailored specifically for cloud data warehouses like Snowflake.

Experience designing and managing data pipeline orchestration workflows to automate and monitor ETL / ELT processes, ensuring reliability and scalability.

Deep understanding of ETL and ELT methodologies, with hands-on experience in redesigning and optimizing data ingestion and transformation jobs to improve performance and maintainability.

Proven track record in integrating diverse data sources, transforming raw data into usable formats, and orchestrating complex data workflows.

Strong focus on implementing data validation, error handling, and monitoring mechanisms to maintain high data quality and integrity throughout the data lifecycle.

Experience applying CI / CD pipelines to data engineering projects, using tools such as Jenkins, Bitbucket, or similar, and working effectively within Agile teams to deliver incremental value.

Excellent analytical and problem-solving skills combined with the ability to collaborate effectively with engineers, analysts, and business stakeholders to achieve shared goals.

Nice-to-Have Skills

This role offers a unique opportunity to shape the future of our data infrastructure by leveraging cutting-edge cloud data technologies and best practices. If you are a motivated Senior Data Engineer passionate about data migration, pipeline optimization, and delivering scalable data solutions, we encourage you to apply and join our innovative team.

J-18808-Ljbffr