Lead Databricks Engineer
ait global • Chicago, IL, United States
7 hours ago
Job type
- Full-time
- Quick Apply
Job description
Job Title: Lead Databricks Engineer
Location: Irving, TX OR Chicago, IL - Hybrid
Qualifications:
- 8+ years of professional data engineering experience, with proven technical leadership.
- Deep understanding of Azure tech stack (Databricks, ADF, Key Vault, ASQL, ADLS Gen2, Service Principles etc.)
- Deep experience with Databricks WHEN SUBMITTING let me know what feature/components of Databricks they have worked with
- Hands-on experience with ETL tools such as Azure Data Factory.
- Experience working with API calls and Ingesting data from external source systems
- Experience with SQL, Python and PySpark
- Experience with building dynamic and scalable solutions for data ingestion and curation
- Experience in data engineering and MS SQL Server and T-SQL development.
- Strong understanding of data lake/delta lake architectures and modern data pipelines.
- Strong understanding of medallion architectures and design patterns.
- Strong understanding of data modeling techniques.
- Experience handling large-scale data volumes, Big data tools and Iac