Job Description : JOB SUMMARY
The Senior Data Engineer will design, build, and implement data integration solutions, including data pipelines, data API's, and ETL jobs, to meet the data needs of applications, services, micro services, data assets, and business intelligence and analytical tools. Working with data architects, application development teams, data analytics teams, business analytics, product managers, and the data governance COE, the Senior Data Engineer will design and develop interfaces between applications, databases, data assets, external partners, and third-party systems in a combination of cloud and on-premise platforms.
- Develops and maintains scalable data pipelines and builds out new integrations to support continuing increases in data volume and complexity
- Designs and develops scalable ETL packages for point to point integration of data between source systems, extraction and integration of data into various data assets, including data warehouse and fit for purpose data repositories, both on prem and cloud
- Designs and develops scalable data APIs to provide data as a service to microservices, applications, and analytical tools
- Designs and develops data migrations in support of enterprise application and system implementations from legacy systems
- Writes functional specifications for data pipelines and APIs and writes and performs unit / integration tests
- Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
- Assists in planning, coordinating, and executing engineering projects
- Supports and collaborates with other Engineers through evaluation, design analysis, and development phases
- Maintains knowledge, ensures competency and compliance with policies and procedures, in order to be the technical expert while collaborating with cross-functional teams
- This list is not all-inclusive and you are expected to perform other duties as requested or assigned
ESSENTIAL DUTIES
Develops and maintains scalable data pipelines and builds out new integrations to support continuing increases in data volume and complexityDesigns and develops scalable ETL packages for point to point integration of data between source systems, extraction and integration of data into various data assets, including data warehouse and fit for purpose data repositories, both on prem and cloudDesigns and develops scalable data APIs to provide data as a service to microservices, applications, and analytical toolsDesigns and develops data migrations in support of enterprise application and system implementations from legacy systemsWrites functional specifications for data pipelines and APIs and writes and performs unit / integration testsPerforms data analysis required to troubleshoot data related issues and assist in the resolution of data issues.Assists in planning, coordinating, and executing engineering projectsSupports and collaborates with other Engineers through evaluation, design analysis, and development phasesMaintains knowledge, ensures competency and compliance with policies and procedures, in order to be the technical expert while collaborating with cross-functional teamsThis list is not all-inclusive and you are expected to perform other duties as requested or assigned5+ w / Bachelors degree
Skills / Experience :
Meet with the Product Owner to gather requirementsExperience building ETL for analytical modelsDesign and Develop Matillion orchestration jobs to integrate the data and Compare the results of the Data integration between the Source and TargetExperience in implementing frame work solutions for data reconciliationEvaluate Results and discuss discrepancies with the Product Owner and Business and bring closure to the discrepancyDeploy code to ProductionMatillion and Snowflake are the key requirements
Base Pay Information
The national base pay range below is a good-faith estimate of what Delta Dental may pay for new hires. Actual pay may vary based on Delta Dentals assessment of the candidates knowledge, skills, abilities (KSAs), related experience, education, certifications and ability to meet required minimum job qualifications. Other factors impacting pay include prevailing wages in the work location and internal equity.$74,000 - $170,900