Lead Databricks Data Engineer

Pay Rate : $54 - $58 / Hour

Lead Databricks Data Engineer

We are seeking a skilled and experienced Lead Data Engineer to join our team and take a pivotal role in building, optimizing, and maintaining our data platform. As a technical leader, you will leverage your expertise in cloud technologies and data engineering to ensure high performance and scalability of our data solutions. This position requires a passion for data, a commitment to innovation, and a focus on delivering efficient and effective solutions.

Key Responsibilities :

• Lead a team of data engineers in the development and maintenance of scalable data pipelines for the platform.
• Optimize data capture, ingestion, and processing workflows to enable advanced analytics, data science, and operational intelligence.
• Collaborate with Data Platform Architects and ML Engineers to integrate feature stores, manage model deployment, and implement data preparation workflows.
• Ensure data engineering processes are designed for high performance, scalability, and resource efficiency.
• Provide technical leadership and mentorship to team members, fostering an environment of continuous improvement and innovation.
• Design and maintain data pipelines for streaming data, batch processing, and real-time analytics.
• Implement secure and scalable data capture and ingestion workflows.
• Support data preparation, exploration, and visualization to facilitate data-driven decision-making.
• Work closely with other engineering teams to ensure data pipelines are secure, efficient, and aligned with business requirements.

Qualifications :