Overview :
Our client in the oil and gas industry is seeking an experienced Databricks Architect to design and implement scalable data solutions leveraging the Databricks platform. This role will focus on building robust data pipelines, optimizing performance, and enabling advanced analytics and machine learning capabilities.
Responsibilities :
- Architect and deploy Databricks solutions for data engineering and analytics.
- Design and optimize ETL workflows and data pipelines.
- Integrate Databricks with cloud services (Azure, AWS, or GCP).
- Ensure security, governance, and compliance across data environments.
- Collaborate with data scientists and business stakeholders to deliver insights.
Requirements :
5+ years' experience with Databricks architecture and implementation.Strong knowledge of Spark, Python, and SQL.Expertise in cloud platforms (Azure, AWS, or GCP).Familiarity with Delta Lake, MLflow, and data governance best practices.Excellent problem-solving and communication skills.