Search jobs > Houston, TX > Big data engineer

Senior Big Data Engineer Airflow Oozie

VirtualVocations
Houston, Texas, United States
Full-time

A company is looking for a Senior Big Data Engineer specializing in Airflow and Oozie on GCP.Key Responsibilities : Develop scalable code for batch processing systems using technologies like Hadoop, Oozie, Pig, Hive, Map Reduce, Spark, Python, and HbaseManage and optimize data workflows with Oozie and Airflow in the Apache Hadoop ecosystemLeverage GCP for scalable big data processing and storage solutionsRequired Qualifications : Experience with GCP managed services and cloud-based batch processing systemsProficiency in Oozie, Airflow, Map Reduce, Java, Python, Pig, and SQLGoogle Associate Cloud Engineer Certification or other Google Cloud Professional level certificationTechnical degree in Computer Science, software engineering, or related field10+ years of experience in customer-facing software / technology or consulting

17 days ago
Related jobs
Promoted
VirtualVocations
Houston, Texas

A company is looking for a Senior Big Data Engineer. Key Responsibilities:Research and develop innovative algorithms for information retrieval, processing, and rankingTake ownership of Machine Learning-based distributed data systemsInteract with cross-functional teams to understand business problems...

Promoted
ENGIE North America Inc.
Houston, Texas

As our Senior AWS Data Engineer in Houston, Texas, you will work with Data Analysts to ensure enterprise data is cataloged in accordance with data governance standards through design, development and maintaining data solutions leveraging the power and flexibility of AWS. Previous experience developi...

Promoted
VirtualVocations
Houston, Texas

A company is looking for a Senior Data Platform Engineer. ...

Promoted
EMW Staffing Solutions LLC
Houston, Texas
Remote

Data Engineers analyze and develop on-premises and/or cloud data and ETL solutions to solve the client’s challenges. Data migrations and conversions to the cloud and to cloud data warehouse services. Knowledge of distributed databases such as Redshift, Snowflake, Azure Synapse, and BigQuery. Open to...

Promoted
VirtualVocations
Houston, Texas

Key Responsibilities:Contribute to the development, optimization, and productionization of data processing platformBuild self-serve capabilities for customers to adopt the data processing platformDesign, implement, and test scalable distributed data systems in the cloudRequired Qualifications:Experi...

Promoted
Virtual
Houston, Texas

This position demands a blend of systems engineering, data integration, and data analytics skills to enhance a company’s data capabilities, supporting advanced analytics, machine learning projects, and real-time data processing needs. We have the following Senior Data Engineer role that plays a cruc...

Promoted
Plains All American Pipeline
Houston, Texas

Data Integration and ETL: Develop and maintain advanced Data Engineering processes and patterns using Spark, Python, Scala, Databricks, Azure Data Factory and other relevant tools to integrate data from various sources. Reporting to the Data Engineering Manager, the Sr Data Engineer is a software en...

Plains Marketing LP
Houston, Texas

Data Integration and ETL: Develop and maintain advanced Data Engineering processes and patterns using Spark, Python, Scala, Databricks, Azure Data Factory and other relevant tools to integrate data from various sources. Reporting to the Data Engineering Manager, the Sr Data Engineer is a software en...

Analog Devices
Tollway, Dallas, TX, US

Scope key business challenges, identify the right data and provide direction to data analysts, data analytics product managers, data scientists, data engineers and business stakeholders. As a Senior Data Engineer, you be responsible for the design and development of data pipelines, automation, and v...

Resource Data
Houston, Texas

As a Senior Software Engineer, Machine Learning/AI at Resource Data, you will play a pivotal role in interacting directly with clients to understand their business needs and develop customized AI solutions that drive real value. This role specifically will partner with the team to provide ...