Hadoop Admin (Austin)

Job Title : Hadoop Administrator

Responsibilities

• Responsible for implementation and ongoing administration of Hadoop infrastructure.
• Responsible for cluster maintenance, troubleshooting, monitoring, and following proper backup & recovery strategies.
• Provisioning and managing the life cycle of multiple clusters like EMR & EKS.
• Infrastructure monitoring, logging & alerting with Prometheus, Grafana, and Splunk.
• Performance tuning of Hadoop clusters and Hadoop workloads, including capacity planning at the application / queue level.
• Responsible for memory management, queue allocation, and distribution experience in Hadoop / Cloud era environments.
• Should be able to scale clusters in production and have experience with 18 / 5 or 24 / 5 production environments.
• Monitor Hadoop cluster connectivity and security, including file system (HDFS) management and monitoring.
• Investigate and analyze new technical possibilities, tools, and techniques that reduce complexity, create more efficient and productive delivery processes, or deliver better technical solutions that increase business value.
• Involved in fixing issues, performing RCA, and suggesting solutions for infrastructure / service components.
• Responsible for meeting Service Level Agreement (SLA) targets and collaboratively ensuring team targets are met.
• Ensure all changes to production systems are planned and approved in accordance with the Change Management process.
• Collaborate with application teams to install operating system and Hadoop updates, patches, and version upgrades when required.
• Maintain central dashboards for all system, data, utilization, and availability metrics.

Ideal Candidate Profile