Job Summary
We are seeking a highly experienced Lead GCP Data Engineer to design, build, and optimize scalable data engineering solutions on Google Cloud Platform. The ideal candidate will take ownership of building robust data pipelines, ensuring best practices, and leading engineering teams to deliver high-quality data solutions for analytics, reporting, and business operations.
Key Responsibilities
- Lead the design, development, and deployment of data pipelines and data integration workflows on GCP.
- Build and optimize data ingestion, transformation, and storage using tools such as Dataflow, Dataproc, Pub / Sub, Composer, BigQuery, Cloud Storage, and Cloud Functions.
- Collaborate with data architects, analysts, and business teams to translate requirements into technical solutions.
- Develop and maintain ETL / ELT frameworks, ensuring scalability, performance, and reliability.
- Implement and enforce best practices around data quality, data validation, metadata management, and documentation.
- Conduct performance tuning for BigQuery, Dataflow, Spark jobs, and data pipelines.
- Drive cost optimization strategies for GCP data workloads.
- Ensure compliance with data security, governance, and access control policies.
- Provide technical leadership, mentoring, and code reviews for the data engineering team.
- Contribute to architecture discussions and technology strategy for cloud data platforms.