Senior Data Engineer

Qualifications :

Requirements for employment : Must work in person at the Columbus, Ohio location 3 days per week (Tuesday, Wednesday, and Thursday). Legally authorized to work in the US; does not require sponsorship. Responsibilities : The Job Details are as follows : As a Senior Data Engineer, you will participate as a member of the Enterprise Data Lake Agile team. You join your fellow team understand requirements, plan the upcoming work needed, analyze source data systems, and create components required for the data lake (with a focus on ingestion from our production systems). The opportunity for business impact is enormous as NiSource continues to innovate transformations across the organization, ultimately providing, and extending new and increased value to our internal and external customers. Responsibilities Design, program, build, deploy, and maintain software applications and systems such as databases, cloud, or other components required for NiSource data Lakes. Analyze and modify existing software as well as design, construct, and test. Participate in full development life cycle including requirements analysis and design. Write technical specifications based on conceptual design and stated business requirements. Support, maintain, and document software functionality. Identify and evaluate new technologies for implementation. Analyze code to find causes of errors and revise programs as needed. Consult with end user to prototype, refine, test, and debug programs to meet needs. Delivers complex work, unsupervised and with extensive latitude for independent judgment. Pair and collaborate closely with other data engineers on the team. Conduct code reviews to ensure code quality, adherence to standards, and knowledge sharing among team members. Required Qualifications : Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, or Java. Proficiency with Azure data services, such as Azure Data Lake, Azure Data Factory and Databricks. Expertise using Cloud Security (i.e., Active Directory, network security groups, and encryption services). Proficient in Python for developing and maintaining data solutions. Experience with optimizing or managing technology costs. Ability to build and maintain a data architecture supporting both real-time and batch processing. Ability to implement industry standard programming techniques by mastering advanced fundamental concepts, practices, and procedures, and having the ability to analyze and solve problems in existing systems. Expertise with unit testing, integration testing and performance / stress testing. Database management skills and understanding of legacy and contemporary data modeling and system architecture. Demonstrated leadership skills, team spirit, and the ability to work cooperatively and creatively across an organization Experience on teams leveraging Lean or Agile frameworks.