Job Posting : GCP Data Engineer
We are seeking an experienced GCP Data Engineer with a strong background in data engineering, cloud technologies, and optimization. The ideal candidate will have expertise in Google BigQuery, specifically in data ingestion, performance optimization, and data modeling. A deep understanding of cloud services such as Cloud Data Flow, Pub / Sub, and data orchestration tools like Apache Airflow is essential.
Key Responsibilities :
Design, develop, and maintain efficient data pipelines and workflows in Google Cloud Platform (GCP).
Optimize data ingestion processes and enhance performance in BigQuery.
Implement and manage real-time data streaming using Pub / Sub and Cloud Data Flow.
Develop and automate workflows using Apache Airflow.
Collaborate with cross-functional teams to design scalable and reliable cloud solutions.
Utilize Python and other tools for scripting and automation of data processes.
Apply DevOps principles for continuous integration and deployment (CI / CD) using GitHub and related tools.
Requirements :
Proven expertise in Google BigQuery, including data modeling and performance optimization.
Strong experience with Cloud Data Flow, Pub / Sub, and Apache Airflow.
Proficient in Python for data engineering tasks.
Familiarity with DevOps practices and CI / CD pipelines.
Experience using GitHub for version control and automation.
Strong problem-solving and communication skills, with the ability to work in a fast-paced, collaborative environment.
Gcp Data Engineer • Jersey City, NJ, New Jersey, USA