Hadoop Data Lake Automation Engineer

Job Summary :

We are looking for a skilled and motivated Hadoop Data Lake Automation Engineer with 4 5 years of experience in automating data workflows and processes within Hadoop-based data lake environments. The ideal candidate will be responsible for building scalable automation solutions optimizing data pipelines and ensuring efficient data movement and transformation across platforms.

Key Responsibilities :

• Design and implement automation solutions for data ingestion transformation and processing in Hadoop data lake environments.
• Develop and maintain scalable data pipelines using tools such as Apache NiFi Spark Hive and Sqoop.
• Collaborate with data engineers analysts and business stakeholders to understand data requirements and deliver automation solutions.
• Monitor and troubleshoot data workflows ensuring reliability and performance.
• Implement best practices for data governance security and metadata management.
• Maintain documentation for data flows automation scripts and operational procedures.
• Support production environments and participate in on-call rotations as needed.

Required Skills & Qualifications :

Preferred Qualifications :

Key Skills

Continuous Integration,APIs,Automotive software,Test Cases,Electrical Engineering,Junit,Distributed Control Systems,Testng,Java,Test Automation,Programmable Logic Controllers,Selenium

Employment Type : Full Time

Experience : years

Vacancy : 1