Big Data Engineer

Role : Big Data Engineer

Location : NYC(Onsite)

Experience Level : 10+ years

Note : Only on W2

Job Description :

ETL Pipelines using python from scratch ability to independently write efficient and reusable code for ETL Pipelines Expert pipelines expert in OOP Principles and concepts Expert in Data modelling Concepts such as Schemas and entity relationships Expert at Analysing and developing quires in SQL in Various dialects (SQL Server, DB2, Oracle) familiarity with Airflow understands how to develop DAGs Expert in Data ware houses Big Query Data Bricks Delta Lake house and how to programmatically ingest, Cleanse govern and report data out of the familiarity with spark is a plus.