Azure Data Engineer -NJ

We are seeking an experienced Senior Data Engineer with a strong background in Databricks, Apache Spark, Azure, and ETL processes . The ideal candidate will have hands-on experience with large-scale data platforms, financial datasets, and compliance-driven environments. This role requires advanced technical expertise, problem-solving skills, and the ability to work in a fast-paced, collaborative setting.

Key Responsibilities

• Design, develop, and optimize ETL pipelines for large-scale data processing
• Build and maintain data models to support business reporting and analytics
• Develop and manage workflows in Databricks and Apache Spark
• Implement and maintain data integration solutions using Azure Data Factory and Synapse Analytics
• Write and optimize complex SQL / HiveQL queries for large datasets
• Automate workflows and processes using Unix Shell scripting
• Ensure data quality, governance, and compliance with financial industry regulations
• Collaborate with cross-functional teams including Data Scientists, Analysts, and Business Stakeholders

Required Skills & Qualifications

Work Arrangement