Data Engineer

Job Description

/Responsibilities

Bio: The primary responsibility of the Data Engineer is to deliver critical data sources through the expansion of and optimization of data and data pipeline architecture, as well as optimizing data flow and collection. In the roles secondary capacity the position is responsible for developing internal web applications and other means such as SOAP/REST services to gather information from outside sources. Collaboration with various team members, and outside vendors, is essential. This position can be remote in .

• Use PDS to enhance performance within the company through evaluation, planning, and goal execution. Strive to constantly develop oneself as a valuable asset through personal and professional growth and attention to the position’s outcomes.
• Provide leadership, and other functional areas, key measures against all performance based activities. Develop internal web applications and data pull data via a variety of methods to generate KPIs allowing the company to drive for change via statistical data driven measurements.
• Contribute to the overall company growth year over year by providing reliable data and support to all functions within the company. Consolidate data from numerous data repositories and generate easy to use data sources that can be displayed in a variety of ways to help the company make an informative financial decisions.
• Provide data and systems that can be utilized by client groups to improve usability and thus team member’s efficiency of day to day activities. This will lead to improved business decisions and strategic planning.
• Provide tools designed to manage and measure productivity and performance. Employ end user feedback to improve data analysis focused around process-defined utilization.
• Modify and develop custom internal web applications working closely with subject matter experts to identify and define the scope of current and future business requirements and provide system-based solutions. Take requirements and architect database structure following 3NF design and rules. Accountable for the results, performance, and maintenance of applications. Experience with SFTP/FTP service transfer development utilizing .NET via a Windows service. Also develop one-off custom data pulls using SOAP/REST to collect and prepare data from third party systems/vendors.
• Ensure proper data pipeline architecture, as well as optimizing data flow and collection is being implemented and maintained. Review and evaluate existing applications for process that can be better utilized and optimized. Manage the overlapping technical and human-centered disciplines to provide business solutions.
• Ensure organization and proper time-management by following list of priorities and organizing tasks based on this list. Provide timely updates to team member or requestors. Provide weekly priority updates to manager, along with details of non-priority tasks completed.
• Work with the Master Data Team to ensure data is accurate and up to date.

Qualifications/Requirements

MUST

• Strong analytical and technical skills
• Excellent oral & written communication skills
• Working knowledge of MS Office Products (Word, Excel and Outlook)
• Bachelor's Degree
• Demonstrate the ability to work as a team as well as self-directed
• Code Languages: SQL (T-SQL), C# and VB (.NET 3.5 and up), XML, JSON, SSIS, SSRS, XHTML, Python, SCALA
• Database Engines: SQL Server, DB2, and Azure SQL
• Experience of .NET and Webapp development
• Microsoft Cloud Data Platform Azure Data Factory Azure Databricks
• experience in developing data ingestion data processing and analytical pipelines for big data relational databases data lake solutions
• 3 years Data engineering experience

PREFERRED

• Database Engines: SQL Server, DB2, and Azure SQL
• Experience in custom ETL development
• Additional Azure certifications (Associate, Expert, Specialty)
• Experience with data warehousing and data lake methodology
• Experience with Cognos or similar reporting platforms
• 3 years Experience in manufacturing software (ERP, MRP, MPS, WMS)
• 3 years Hands on ERP experience

#LI-MD1