Job Description
Data Engineer I A Data Engineer I works alongside senior Data Engineers, Information Architects, Data Scientists, and other stakeholders to design and maintain small to moderate data models. The Data Engineer I is responsible for day-to-day monitoring and maintaining small to medium-scale databases that support web applications and other digital services. The Data Engineer I is responsible for supporting reports that provide accurate and timely data for internal and external clients. The incumbent will assist with advancing a data infrastructure that powers our ability to make timely and data-driven decision. This role requires an entry-level familiarity of data architecture and extraction & manipulation of data sets of small to medium sizes.
Position Responsibilities: Design and Methodology - Perform day-to-day monitoring of critical business flows and take ownership of triaging incidents.
- Create and maintain data tables in data analysis tools (, Informatica, Snowflake).
- Utilize data from multiple cloud sources and develop/maintain dashboards.
- Review existing code to ensure performance and reliability of data extraction and processing.
- Review data products for analytics and Data Scientist team members to improve their productivity.
- Update and optimize local and metadata models.
- Document and test small to moderate data systems that bring together data from disparate sources.
- Manage existing pipelines from a variety of sources (relational, XML, etc.)
- Review and maintain solutions to track data quality, stabilize data pipeline, etc. to ensure reliable operations.
- Test data processes including performance of through data validation and verification.
Technical Consulting - Work with development teams to create conceptual data models and data flows.
- Review modifications of existing systems for cross-compatibility.
- Evaluate implemented data systems for variances, discrepancies, and efficiency.
- Participate in data quality initiatives and troubleshooting.
- Participate in sprint planning meetings as needed.
- Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions.
- Optimize support for ad-hod analysis across various data sources.
Planning & Organizing - Ensure best practices are followed across architecture, codebase, and configuration.
- Review and make recommendations for ongoing reporting and analysis processes, automating or simplifying self-service modeling and production support for customers.
- In collaboration with the senior level Data Engineers, contribute to the exploration and understanding of new tools and techniques for improvements to the data pipeline.
Risk Management - Review and are familiar with automated processes for performance and fault tolerance.
- Review functional and technical designs to build familiarity of risk and any missing requirements.
- Review security measures to protect data from unauthorized access or misuse.
- In collaboration with senior level Data Engineers, design backup and recovery procedures to ensure data integrity is maintained.
Administration/Support - Keeps management informed of status of on activities through accurate, timely, and appropriate reporting.
- Contribute to Data Governance, system documentation and sharing of data asset knowledge.
- Actively participates in committees representing the department and/or planning unit.
- Keeps abreast of leading-edge technologies in the Data Engineering space.