Information Technology_USA - USA_Technical Lead

Location : EDEN PRAIRIE, MN

Competencies : Digital : Databricks - 6-8+ years experience

Must Have :

8+ years of experience in data engineering with Databricks and Spark

Strong knowledge of Databricks architecture, tools and capabilities

Experience in Design, develop, and optimize ETL / ELT data pipelines using Databricks on AWS.

Good understanding of AWS native services S3, DataSync, DMS, Lambda, SNS, SQS.

SQL and PySpark : strong command over querying databases and proficiency in PySpark.

Experience with Delta Lake and building data lakes.

Familiarity with CI / CD pipelines using tools such as Gitlab.

Good communication and presentation skills

Agile trained and knowledge of JIRA

Good to Have : Databricks Certified

Knowledge in On-Prem(Teradata, SQL Server etc.) and Cloud Data Platforms(RDS, Redshift etc.)

Knowledge in Data Warehousing concepts

Knowledge in AWS cloud

Experience in Retail & Supply Chain domain

Responsibility of / Expectations from the Role

Work as a Technical lead for medium to large complex project / feature enhancements

Accountable for the design and development

Work with the Product Management team, Project Management, Business and User Experience teams

to identify and prioritize initiatives and features

Participate in all grooming and priority setting sessions and accountable for project sizing and estimation

Work closely with other development teams across organization to troubleshoot issues, performance

tuning and identify opportunities for seamless integrations across systems

Works closely with the Production Support team to train, guide and troubleshoot production issues

Provides coaching and technical guidance for Software Engineers at different levels of experience

Additional Sills : Skills :

Category

Name

Required

Importance

Experience

SkillCategoryTest1_MN

Digital : Azure Databricks

Yes

4-7 years