Senior Data Engineer

Job Description

:

Position Description :

Designs and develops data warehouse enterprise applications for reporting and analytics, using SQL, Java .Net, and Python. Creates and migrates Extract, Transform, Load (ETL) code and workflow mappings in Informatica to Amazon Web Services (AWS) Data Lake and Wherescape Red ETL. Develops OBIEE reports and configures Business Intelligence (BI) scheduler. Deploys code and services to AWS by establishing Continuous Integration and Continuous Delivery (CI/CD) pipelines using Cloud-based data platforms — Oracle, NoSQL, Snowflake, and Graph databases (for analytics data hosting). Supports and maintains software applications in DEV and SIT environments.

Primary Responsibilities:

• Builds, enhances, and supports data and analytics software solutions.
• Writes complex SQL queries on Oracle (PL/SQL).
• Performs optimization and SQL tuning.
• Designs and develops complex applications using large data sets and ETL strategies.
• Distributes applications using Java, .Net, and Python.
• Implements Software as a Service (SaaS) solutions.
• Develops and manages Collibra for enterprise governance activities.
• Develops software system testing and validation procedures, programming, and documentation.
• Supports and maintains software applications in DEV and SIT environments.
• Proposes modifications and improvements based on user need.
• Provides L3 support in an Agile environment.
• Analyzes information to determine, recommend, and plan computer software specifications on major projects.

Education and Experience :

Bachelor’s degree (or foreign education equivalent) in Computer Science, Computer Information Systems, Computer Information Systems and Information Technology, Engineering, Information Technology, Mathematics, Physics or a closely related field and three (3) years of experience as a Senior Data Engineer (or closely related occupation) performing Informatica ETL and Oracle database development to support HR data engineering capabilities in a financial services environment.

Or, alternatively, Master’s degree (or foreign education equivalent) in Computer Science, Computer Information Systems, Computer Information Systems and Information Technology, Engineering, Information Technology, Mathematics, Physics or a closely related field and one (1) year of experience as a Senior Data Engineer (or closely related occupation) performing Informatica ETL and Oracle database development to support HR data engineering capabilities in a financial services environment.

Skills and Knowledge :

Candidate must also possess:

• Demonstrated Expertise (“DE”) working as a member of a data engineering team responsible for developing high quality data solutions in a multi-developer Agile environment according to design and coding best practices; developing ELT pipelines to migrate data to and from Snowflake data store, using WhereScape Red, Python, and Snowflake; and loading data from flat files and JSON into Snowflake using SnowSQL.
• DE performing code migrations, using GitHub, Jenkins, and Control-M scheduler; and performing SQL performance optimization for 1+ TB size data volumes.
• DE performing ETL operations, using Informatica Power Center and Metadata Manager; developing data masking solutions using Unix shell script; and creating functional and technical design mapping templates and solutions for data migrations using Workday I Loads.
• DE performing data profiling and analysis using Informatica Data Quality; preparing, analyzing, and portraying business metrics using BI reporting tools — OBIEE and Power BI; performing data profiling and analysis using Informatica Data Quality (IDQ); and pre-processing data to identify macro trends or information — out-of-range values — in Snowflake using SnowPipe loaded xml files.

#PE1M2

Certifications: