Information TechnologyUSA USATechnical Lead

Location : EDEN PRAIRIE MN

Competencies : Digital : Databricks - 6-8 years experience

Must Have :

8 years of experience in data engineering with Databricks and Spark

Strong knowledge of Databricks architecture tools and capabilities

Experience in Design develop and optimize ETL / ELT data pipelines using Databricks on AWS.

Good understanding of AWS native services S3 DataSync DMS Lambda SNS SQS.

SQL and PySpark : strong command over querying databases and proficiency in PySpark.

Experience with Delta Lake and building data lakes.

Familiarity with CI / CD pipelines using tools such as Gitlab.

Good communication and presentation skills

Agile trained and knowledge of JIRA

Good to Have : Databricks Certified

Knowledge in On-Prem(Teradata SQL Server etc.) and Cloud Data Platforms(RDS Redshift etc.)

Knowledge in Data Warehousing concepts

Knowledge in AWS cloud

Experience in Retail & Supply Chain domain

Responsibility of / Expectations from the Role

Work as a Technical lead for medium to large complex project / feature enhancements

Accountable for the design and development

Work with the Product Management team Project Management Business and User Experience teams

to identify and prioritize initiatives and features

Participate in all grooming and priority setting sessions and accountable for project sizing and estimation

Work closely with other development teams across organization to troubleshoot issues performance

tuning and identify opportunities for seamless integrations across systems

Works closely with the Production Support team to train guide and troubleshoot production issues

Provides coaching and technical guidance for Software Engineers at different levels of experience

Additional Sills : Skills :

Category

Name

Required

Importance

Experience

SkillCategoryTest1MN

Digital : Azure Databricks

Yes

4-7 years

Key Skills

Administrative Skills,Facilities Management,Biotechnology,Creative Production,Design And Estimation,Architecture

Employment Type : Full Time

Experience : years

Vacancy : 1