Mandatory Skills : Databricks Developer, and DataBric Admin ,and Databricks Support.
8+ years of experience in data engineering, with at least 3 years on Databricks.
- Strong proficiency in PySpark, SQL, and Delta Lake.
- Hands-on experience with GCP Dataproc.
- Responsibilities :
1.
AdministrationLead the installation and configuration of Databricks on GCP cloud platforms.Monitor platform health, performance, and cost optimization.Implement governance, logging, and auditing mechanisms.2.
Development / EnhancementsDesign and develop scalable ETL / ELT pipelines using PySpark, SQL, and Delta Lake.Collaborate with data engineers and analysts to enhance data workflows and models.Optimize existing notebooks and jobs for performance and reliability.3.
Operations, Support & TroubleshootingProvide L2 / L3 support for Databricks-related issues and incidents.Troubleshoot cluster failures, job errors, and performance bottlenecks.Maintain technical documentation for platform setup, operations, and development standards