Senior Data Engineer

Our Midstream Oil and Gas client is seeking a skilled Data Engineer to design, build, and maintain scalable data infrastructure that supports advanced analytics and business intelligence initiatives. You will work closely with data scientists, analysts, and software engineers to ensure data availability, quality, and reliability across the organization.

Key Responsibilities

• Design, develop, and maintain data pipelines and ETL / ELT processes for collecting, transforming, and storing data from multiple sources
• Build and optimize data models , data warehouses , and data lakes for analytics and reporting.
• Collaborate with stakeholders to define data architecture and ensure data integrity, consistency, and security
• Implement and maintain data quality frameworks , monitoring, and alerting systems.
• Work with cloud platforms (AWS, Azure, or GCP) to deploy scalable data infrastructure
• Support the integration of real-time streaming data using tools like Kafka, Kinesis, or Spark Streaming
• Automate workflows using orchestration tools such as Airflow, Prefect, or Dagster
• Ensure compliance with data governance , security , and privacy standards (e.g., GDPR, HIPAA).
• Troubleshoot data-related issues and optimize performance of queries and pipelines

Required Qualifications