Lead Data Engineer

Must have skill : Snowflake SQL, Data warehouse, Python, AWS-Lambda, ETL / ELT

Job Description : Required Skills :

6-8 years+ experience on Snowflake SQL - advanced SQL expertise

6-8 years+ experience on data warehouse experiences - hands on knowledge with the methods to identify, collect, manipulate, transform, normalize, clean, and validate data, star schema, normalization / denormalization, dimensions, aggregations etc.,

6-8 years+ experience working in reporting and analytics environments - development, data profiling, metric development, CICD, production deployment, troubleshooting, query tuning, Atlassian Bitbucket and Bamboo, etc.,

6 years+ on Python - advanced Python expertise

6 years+ on any cloud platform - AWS preferred

Hands on experience on AWS on Lambda , S3, SNS / SQS, EC2 is a bare minimum,

6 years+ on any ETL / ELT tool - Informatica, Fivetran, DBT, Airflow etc. - Must

6 years+ with developing functional metrics in any specific business

Responsibilities :

• Lead data warehouse development activities for a team, leading more than one project in parallel.
• Assign data warehouse development tasks to team of 1-6 developers (Onsite / Offshore).
• Be a subject-matter expert (SME) in Data Warehouse domain and relevant business function.
• Work with minimal supervision and provide status updates and escalation to leadership as appropriate.
• Provides application support as part of an on-call rotation to work on resolving outages and user questions.
• Review project objectives and determine best technology to apply.
• Design and build large scale datasets for a wide range of consumer needs.
• Build, test and implement highly efficient data pipelines using a variety of technologies.
• Develop best practice standards for solution design and data structures.
• Analyze new data sources to understand quality, availability, and content.
• Write technical design documentation.
• Conducts peer code reviews.
• Create and executes unit tests.
• Supports QA team during testing.
• Mentor less experienced members of the development team.