Google Cloud Data Migration Lead

Position : Google Cloud Data Migration Data Migration Team Lead

Location : Remote

Duration : Long term contract

Job Summary :

Seeking a Google Cloud data engineer to design, build, and maintain scalable and efficient data processing systems on the Google Cloud platform. This engineer will be responsible for the entire data lifecycle, from ingestion and storage to processing, transformation, and analysis. Their work will enable client organizations to make data-driven decisions by providing clean, high-quality data to business intelligence tools, AI systems, analysts and data scientists.

Key Responsibilities :

• Serve as Data Migration team leader for a large data and application migration to the Google Cloud platform.
• As Data Migration team leader, this individual will be responsible for our team's endto-end data architecture and migration planning to support the migration effort as well as future-state client efforts on the Google Cloud platform.
• As Data Migration team leader, this individual will collaborate closely with the overall Google Cloud migration team leadership, working to deliver a successful application and data migration.
• Design and build data pipelines : Develop and maintain reliable and scalable batch and real-time data pipelines using GCP tools such as Cloud Dataflow (based on Apache Beam), Cloud Pub / Sub, and Cloud Composer (for Apache Airflow).
• Create and manage data storage solutions : Implement data warehousing and data lake solutions using GCP products like BigQuery, Cloud Storage, and other transactional or NoSQL databases such as CloudSQL or Bigtable.
• Ensure data quality and integrity : Develop and enforce procedures for data governance, quality control, and validation throughout the data pipeline to ensure data is accurate and reliable.
• Optimize performance and cost : Monitor data infrastructure and pipelines to identify and resolve performance bottlenecks, ensuring that all data solutions are cost-effective and scalable.
• Collaborate with other teams : Work closely with data scientists, analysts, and business stakeholders to gather requirements and understand data needs, translating them into technical specifications.
• Automate and orchestrate workflows : Automate data processes and manage complex workflows using tools like Cloud Composer.
• Implement security : Design and enforce data security and access controls using GCP Identity and Access Management (IAM) and other best practices.
• Maintain documentation : Create and maintain clear documentation for data pipelines, architecture, and operational procedures.

Required Skills & Qualifications :

Google Cloud Platform : Hands-on experience with key GCP data services is essential, including :