Senior Data Architect
Senior ADF Engineer / consultant with Microsoft Fabric / ETL Background
Location : Irving, TX-ONSITE
Salary as per market standard
Interview mode Face to Face (followed by video call)
Mode of Work : All 5 days onsite
Start date Immediate.
Summary
We are seeking a highly skilled and experienced Senior ADF Engineer / Architect to join our team and play a key role in developing and maintaining our Azure Data Factory (ADF) pipelines.
The ideal candidate will have a strong understanding of Microsoft Fabric / ETL concepts and experience in designing, implementing, and monitoring ADF pipelines for data integration and transformation.
Responsibilities
Design, develop, and maintain ADF pipelines for ingesting, transforming, and loading data from various sources into Azure Data Lake Storage (ADLS) and other data destinations.
Utilize ADF's built-in connectors and activities to perform data extraction, transformation, and loading (ETL) operations.
Implement data cleansing, transformation, and filtering logic within ADF pipelines.
Develop and maintain documentation for ADF pipelines, including design documents, user guides, and code comments.
Monitor and troubleshoot ADF pipelines to ensure efficient and reliable data processing.
Collaborate with data engineers, data scientists, and other stakeholders to understand data requirements and design effective data solutions.
Stay up-to-date with the latest advancements in ADF and related Azure data services.
Should have done end to end implementation of data platform development and delivery in offshore and nearshore development teams.
Should have a good understanding of all the concepts of data lake, data Lakehouse and modern data platform build.
Qualifications
Proven experience as a Senior ADF Engineer or similar role for 7-15 years
In-depth knowledge of Azure Data Factory (ADF) concepts, functionalities, and best practices.
Solid understanding of Microsoft Fabric / ETL principles and practices.
Experience with data integration and transformation techniques, including data cleansing, transformation, and filtering.
Experience with SQL and other scripting languages (e.g., Python, Windows Shell Script) for data manipulation.
Familiarity with cloud computing concepts and experience working with Azure cloud services is a plus.
Excellent communication, collaboration, and problem-solving skills.
Strong attention to detail and a commitment to delivering high-quality work.