Databricks Engineer

DETAILED RESPONSIBILITIES :

• Design and develop software solutions to implement innovative features and support existing applications.
• Ingest and integrate data from various source systems into the Azure Analytics Platform using Azure Databricks and Azure Data Factory.
• Construct robust Azure Data Factory (ADF) pipelines to facilitate efficient data ingestion and transformation processes.
• Collaborate with the technical team to provide design and coding support, ensuring project deliverables are met.
• Engage with clients to gather and interpret business requirements, translating them into actionable solutions.

SKILL REQUIREMENTS :

OTHER REQUIREMENTS (OPTIONAL) :

Skill or Category Mandatory / Non-Mandatory Evaluation Focus Microsoft Azure Stack Mandatory Evaluate technical proficiency in T-SQL, SSIS, SSAS, and SSRS zure Data Factory Mandatory ssess ability to construct robust ADF pipelines for data ingestion and transformation zure Databricks Mandatory Experience in ingesting and integrating data into the Azure Analytics Platform zure Synapse Analytics Mandatory Capability to optimize Azure solutions for enhanced decision-making zure DevOps Mandatory Evaluate experience in using Azure DevOps for project deliverables zure Storage / Data Lake Mandatory Proficiency in managing data storage solutions ETL Processes Mandatory Experience with ETL processes and report development Relational Databases and SQL Mandatory Proficiency in relational databases and SQL language Python Scripting and Spark APIs Non-Mandatory ssess experience with Python scripting and Spark APIs Client-Facing Experience Non-Mandatory Evaluate previous client engagement experience gile Development Methodologies Non-Mandatory Familiarity with agile development practices Bachelor's Degree Mandatory Possession of a degree in Computer Science, Information Technology, or related field