Databricks Engineer - Azure
AcunorColumbus, Ohio Metropolitan Area, United States3 hours ago
Job type
- Full-time
Job descriptionCollaborate with business analysts and reporting teams to define logical and physical data models supporting analytical and operational needs. Implement data warehousing and lakehouse solutions using Azure Data Lake and Delta Lake . Optimize data structures for query performance, cost efficiency, and reusability. Design and implement robust data quality checks and validation mechanisms to maintain integrity across sources and transformations. Automate repetitive processes using scripts, parameterized pipelines, and reusable frameworks. Conduct periodic audits and compliance checks aligned with governance policies. Contribute to metadata management, documentation, and lineage tracking. 7–12 years of experience in Data Engineering with proven expertise in Databricks and Azure Cloud ecosystems. Strong hands-on experience in PySpark , Python , and SQL for data transformation, validation, and performance tuning. Solid understanding of Delta Lake architecture , ETL / ELT frameworks , and data warehousing principles. Proficiency with Azure services including Data Factory (ADF) , Data Lake (ADLS) , and Databricks Notebooks . Experience with Delta Live Tables , Unity Catalog , and Autoloader for batch and streaming data processing. Strong background in data modeling , performance optimization , and automation scripting . Familiarity with Agile methodologies and DevOps-based deployment practices (Git, CI / CD preferred). Strong analytical, communication, and problem-solving skills to collaborate effectively across diverse teams. Preferred : Exposure to insurance, healthcare, or financial services data ecosystems. Experience in data migration projects (on-prem to cloud or multi-cloud). Familiarity with Delta Sharing , Databricks SQL Warehouses , or MLflow for advanced use cases. Experience with data cataloging, lineage, or quality frameworks such as Purview, Collibra, or Great Expectations. Exposure to BI / reporting tools like Power BI or Tableau for end-to-end integration understanding.
Job Title : Data Engineer – (Databricks + Azure)
Client : One of our Consulting Clients (Global Analytics & Digital Transformation Firm)
Location : Columbus, OH (Remote / Hybrid)
Duration : Full-Time
About the Role
We are seeking a highly skilled Data Engineer with deep expertise in Databricks and Azure Cloud to join a decision analytics and data engineering team within one of our global consulting clients. The role involves building, optimizing, and maintaining large-scale data pipelines that fuel enterprise analytics, reporting, and AI-driven insights—primarily supporting clients in the insurance and financial services domains .
Key Responsibilities
Data Pipeline Development & Optimization
- Design, build, and enhance ETL / ELT data pipelines using Azure Data Factory , Databricks (PySpark, SQL, Python) , and related services.
- Develop and manage Delta Live Tables , Autoloader , and Unity Catalog within the Databricks ecosystem for structured, incremental data processing.
- Implement data ingestion, transformation, and validation frameworks that ensure high performance, scalability, and reliability.
- Monitor data pipelines, troubleshoot issues, and ensure optimal system performance and SLA adherence.
Data Modeling & Architecture
Data Quality, Governance & Automation
Required Skills & Experience
Nice to Have
Create a job alert for this search
Azure Engineer • Columbus, Ohio Metropolitan Area, United States
Related jobs
Top 100 business advisory & accounting firm providing our clients services in tax, accounting, and business consulting.We have a ‘People First’ culture and we focus on our employees’ well-being...Show moreLast updated: 23 days ago
As a CBRE Project Management Manager, you’ll manage a team responsible for providing basic management services to achieve the company's strategic business objectives.
This job is part of the Project...Show moreLast updated: 3 hours ago
Job Title : Kafka Developer with Python.Location : (Plano, TX / NJ / Houston, TX / Columbus OH).We are seeking a highly skilled Kafka Developer with strong Python expertise to join our team.Strong ...Show moreLast updated: 15 days ago
RESPONSIBILITIES : Kforce's client in Baltimore, MD is seeking an experienced Azure Data Engineer with solid Databricks experience to join their team on a long term contract.Gen AI ex...Show moreLast updated: 6 days ago Job Title : Technical BA / Product Owner Location : Columbus, OH Fulltime / Contractual : Long Term contract Duration : Long Term contract Job Description ...Show moreLast updated: 5 days ago Top 100 business advisory & accounting firm providing our clients services in tax, accounting, and business consulting.We have a ‘People First’ culture and we focus on our employees’ well-being...Show moreLast updated: 19 days ago 
Position : SnowFlake Developer .Location : Dublin , OH .Must have played Snowflake Lead Developer role.Should have development experience in Snowflake Cloud Data...Show moreLast updated: 7 days ago
Contentsquare is the all-in-one experience intelligence platform designed to be easily used by anyone who cares about digital journeys.
With our flexible and scalable platform, organizations quickly...Show moreLast updated: 8 days ago
RRD is a leading global provider of marketing, packaging, print, and supply chain solutions that elevate engagement across the complete customer journey.
The company offers the industry's most trust...Show moreLast updated: 30+ days ago
McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare.We are known for delivering insights, products, and services that make quality care more accessibl...Show moreLast updated: 22 hours ago
Our client is a leader in the Mechanical Construction + Construction Services industry, bringing talented Mechanical, Electric and Plumbing resources to large-scale construction projects (i.They...Show moreLast updated: 10 days ago
Focus on the core content of the job post, removing all unnecessary metadata, navigation links, and extraneous details.The goal is to present a clean, beautiful, and high-signal-to-noise-ratio job ...Show moreLast updated: 7 days ago
Role : AI Engineer (OpenAI Models / LLM / Azure Platform) Location : Cleveland, OH Type : Fulltime Show moreLast updated: 2 days ago
Honda is seeking a Software Integration Engineer with strong experience in Code Base Management, Automotive Systems, CI / CD, and ALM tools.
The ideal candidate will play a key role in managing softwa...Show moreLast updated: 3 hours ago Job Title : Grafana Developer with Python.Location : (Plano, TX / Columbus OH).We are looking for a skilled Grafana Developer with Python expertise to join our team.
Strong experience with Grafana in...Show moreLast updated: 15 days ago 
A client of Innova Solutions is immediately hiring for a.Pega LSA Developer / Lead Pega Consultant.Pega LSA Developer / Lead Pega Consultant,.
The ideal candidate will have : .Should have extensive ex...Show moreLast updated: 12 days ago
Baker Job Description Template.We are searching for skilled, creative Bakers who strive to provide excellent baked items and service in an efficient, professional manner.
The Baker will design, exec...Show moreLast updated: 5 days ago
SAP Process Integration consultant We are seeking a highly skilled and experienced SAP PI / PO consultant to join our team The ideal candidate will possess deep knowledge...Show moreLast updated: 4 days ago
Senior Data and Automation Developer
ReaOH, USRemote
Full-time
Quick Apply
- Promoted
- New!
Project Manager - Data Centers
CBRENew Albany, OH, United StatesFull-time
Kafka Developer with Python
Axiom Software Solutions LimitedColumbus, OH, USFull-time
Quick Apply
Senior Data Engineer
OpenkyberOH, United StatesTemporary
Quick Apply
Business Systems Analyst
OpenkyberOH, United StatesFull-time
Quick Apply
BI Data Analyst
ReaOH, USRemote
Full-time
Quick Apply
SnowFlake Developer
GovServicesHubDublin, OH, usFull-time
Quick Apply
AI Senior Fullstack Engineer
ContentsquareLondon, Ohio, United States, 43140Full-time
- Promoted
Mailing Database Coordinator
RR DonnelleyLancaster, OH, USFull-time
- Promoted
- New!
Sr Databricks Platform Engineer
RXC RxC Acquisition CompanyColumbus, OH, United StatesFull-time
- Promoted
Data & Analytics Architect / Engineer
Martineau Recruiting TechnologyColumbus, OH, USFull-time
- Promoted
Manager, Datacenter Research
Vertiv HoldingsDelaware, OH, USFull-time
AI Engineer (OpenAI Models / LLM / Azure Platform)
AcestackOH, United StatesFull-time
Quick Apply
- Promoted
- New!
System Integration Specialist
Global Connect TechnologiesMarysville, OH, United StatesFull-time
Grafana Developer with Python
Axiom Software Solutions LimitedColumbus, OH, USFull-time
Quick Apply
- Promoted
Pega LSA (Lead Developer)
Innova SolutionsNew Albany, OH, USFull-time +1
- Promoted
New req
Lots of BeansLancaster, OH, USFull-time
PI / PO Consultant with Integration suite
Apptad IncMarysville, OH, United StatesFull-time
Quick Apply