DATA ENGINEER

Job Description

Job Description

SUMMARY :

We are seeking a highly skilled Data Engineer with deep expertise in the Microsoft data ecosystem and experience working within CPG, production, supply chain, and ERP-driven environments. The ideal candidate will possess strong data modeling abilities, business process understanding, and technical acumen to design scalable data solutions while also maintaining and improving existing data infrastructure. This role supports analytical modernization, AI readiness, and enterprise reporting through high-quality engineering practices.

KEY RESPONSIBILITIES :

• Build and support data integration processes and orchestrations to ingest diverse data from external systems including Rest APIs, Oracle, SAP, ADF, Dataverse, SQL Server, Snowflake, SFTP / FTP.
• Build and support high‑performance, scalable data pipelines within Azure Synapse Analytics for end‑to‑end data processing.
• Build and support Azure Data Factory, Azure Databricks, Synapse Analytics, and Microsoft Fabric ETLs to deliver secure, efficient cloud‑native data solutions for Ad-hoc and Enterprise reporting.
• Build and support scalable transformation processes using Spark (Scala or PySpark) and SQL to manage large‑scale data within a Lakehouse framework.
• Build and support robust, scalable data models and storage solutions for an Enterprise Data Warehouse using Synapse tables and Lakehouse patterns in Azure SQL Server.
• Build and support Power BI semantic models and dashboards, leveraging advanced DAX to deliver actionable business insights.
• Prepare structured, high-quality datasets that fuel AI, machine learning, and predictive analytics initiatives.
• Collaborate with data scientists and architects to productionize and operationalize models.
• Monitor, troubleshoot, and tune Synapse pipelines, compute, and storage environments to ensure enterprise‑level reliability and speed.
• Apply expert‑level T‑SQL and PL / SQL for sophisticated data modeling and complex query optimization across the Azure ecosystem.
• Implement Azure governance and security best practices using Azure Monitor, Key Vault, Managed Identities, and Role-Based Access Control (RBAC).
• Work closely with business stakeholders across manufacturing, logistics, procurement, demand planning, and finance to understand real-world workflows.
• Translate business requirements into detailed technical specifications and scalable data solutions.
• Document data flows, data dictionaries, lineage, and governance processes.

QUALIFICATIONS & EDUCATION :