DataBrick EngineerShrive Technologies LLC • Irving, Texas, USA
DataBrick Engineer
Shrive Technologies LLC • Irving, Texas, USA
9 hours ago
Job type
- Full-time
Job descriptionAdministration Lead the installation and configuration of Databricks on GCP cloud platforms. Monitor platform health performance and cost optimization. Implement governance logging and auditing mechanisms. Development / Enhancements Design and develop scalable ETL / ELT pipelines using PySpark SQL and Delta Lake. Collaborate with data engineers and analysts to enhance data workflows and models. Optimize existing notebooks and jobs for performance and reliability. Operations Support & Troubleshooting Provide L2 / L3 support for Databricks-related issues and incidents. Troubleshoot cluster failures job errors and performance bottlenecks. Maintain technical documentation for platform setup operations and development standards
Mandatory Skills : Databricks Developer and DataBric Admin and Databricks Support.
8 years of experience in data engineering with at least 3 years on Databricks.
- Strong proficiency in PySpark SQL and Delta Lake.
- Hands-on experience with GCP Dataproc.
- Responsibilities :
1.
2.
3.
Key Skills
ASP.NET,Health Education,Fashion Designing,Fiber,Investigation
Employment Type : Full Time
Experience : years
Vacancy : 1
Create a job alert for this search
Engineer • Irving, Texas, USA