Senior Data Pipeline Engineer

Job Type

Full-time

Description

As a Senior Data Pipeline Engineer, you will play a crucial role in designing, building, and maintaining robust data pipelines for our customers. Your expertise will drive efficient collection, storage, processing, and transformation of large-scale data sets in support of the U.S. Army's energy and water use metering program. The total solution is considered a system-of-systems with developed applications integrating with the Army enterprise cloud and data environment. You will work closely with cross-functional teams to ensure seamless integration and optimal performance.

Responsibilities :

Pipeline Development :

• Design, develop, and optimize end-to-end data pipelines for efficient data extraction, transformation, and loading (ETL) processes.
• Collaborate with cross-functional teams to understand data requirements and translate them into scalable pipeline solutions.
• Implement best practices for data integration, ensuring high performance, reliability, and scalability.

Data Transformation and Quality :

Performance Optimization :

Collaboration and Leadership :

#qf

#qg

Requirements

REQUIRED QUALIFICATIONS :

QBE is an equal opportunity / affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender, gender-identity and / or expression, age, disability, Veteran status, genetic information, pregnancy (including childbirth, lactation, or other related medical conditions), marital-status, neurodivergence, ethnicity, ancestry, caste, military / uniformed service-member status, or any other characteristic protected by applicable federal, state, local, or international law.