Job Title : Software Engineer
Location : Jersey City, NJ (Hybrid M, Wed and Thurs)
Duration : 6months
Need USC / GC
Must Have : Databricks, Python and Spark, AWS Glue, AWS eco system.
ETL Pipeline, SQS, SNS, Data Mess, Data Catalog.
Writing ETL and Data Platform and Data Catalog. Tableau or any BI Tools nice to have.
Job Description :
strong understanding of data management principles, governance frameworks and best practices.Experience with data cataloging tools and systems (e.g., Collibra, Alation, Informatica, Atlan, Databricks Unity Catalog)Full-stack development, debugging, and maintaining code in a large enterprise with one or more modern programming languages (e.g. Java / SpringBoot, Python / Flask)Solid understanding of SDLC practices, Unit / Regression Testing, Application Resiliency, Security, Agile Methodologies, and CI / CD.Excellent analytical and problem-solving skillsAbility to work independently as well as in a team environment.Responsibilities : Work on project milestones for metadata identification, standardization, and updates within their respective data lake house tables.Develop and publish metrics for metadata completeness and data catalog usage, fostering its wider adoption.Serve as a subject matter expert for data catalog, create training materials and educate users as needed.Execute software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems.Required qualifications, capabilities, and skills :Strong understanding of data management principles, governance frameworks and best practices.Experience with data cataloging tools and systems (e.g., Collibra, Alation, Informatica, Atlan, Databricks Unity Catalog)Full-stack development, debugging, and maintaining code in a large enterprise with one or more modern programming languages (e.g. Java / SpringBoot, Python / Flask)Solid understanding of SDLC practices, Unit / Regression Testing, Application Resiliency, Security, Agile Methodologies, and CI / CD.