10 years of experience with enterprise and application design patterns that are applied on Hadoop and Big data platforms in aws.
The ideal candidate will possess deep expertise in both on-premises Hadoop ecosystems and modern cloud-native big data solutions on AWS.
Hands-on experience with Cloudera Hadoop stack (HDFS Hive Spark Oozie Python)
Proficiency in writing maintaining and troubleshooting shell scripts (Bash or similar) for automation and operational support.
Migration to AWS will need -
Analyze existing Cloudera Hadoop architecture workflows and data pipelines.
Develop a comprehensive migration strategy to transfer data processing logic and applications to AWS services.
Design target architecture using AWS big data services such as Amazon EMR Airflow Glue Lambda.
Evaluate and select appropriate AWS tools for data ingestion storage processing and analytics.
Oversee the migration process including data transfer application re-platforming and validation.
Ensure the new architecture meets performance scalability reliability and security requirements.
Collaborate with developers data engineers DevOps and stakeholders to ensure a seamless migration.
Create detailed technical documentation and migration runbooks.
Mentor team members on AWS big data best practices.
Strong understanding of data security compliance and governance in the cloud.
Proven track record of migrating or modernizing big data workloads to AWS.
Experience with cloud automation and Infrastructure as Code (e.g. Terraform).
AWS certifications (e.g. AWS Certified Solutions Architect AWS Certified Big Data - Specialty) are highly desirable.
10 years of experience with enterprise and application design patterns that are applied on Hadoop and Big data platforms in aws.
The ideal candidate will possess deep expertise in both on-premises Hadoop ecosystems and modern cloud-native big data solutions on AWS.
Hands-on experience with Cloudera Hadoop stack (HDFS Hive Spark Oozie Python)
Proficiency in writing maintaining and troubleshooting shell scripts (Bash or similar) for automation and operational support.
Migration to AWS will need -
Analyze existing Cloudera Hadoop architecture workflows and data pipelines.
Develop a comprehensive migration strategy to transfer data processing logic and applications to AWS services.
Design target architecture using AWS big data services such as Amazon EMR Airflow Glue Lambda.
Evaluate and select appropriate AWS tools for data ingestion storage processing and analytics.
Oversee the migration process including data transfer application re-platforming and validation.
Ensure the new architecture meets performance scalability reliability and security requirements.
Collaborate with developers data engineers DevOps and stakeholders to ensure a seamless migration.
Create detailed technical documentation and migration runbooks.
Mentor team members on AWS big data best practices.
Strong understanding of data security compliance and governance in the cloud.
Proven track record of migrating or modernizing big data workloads to AWS.
Experience with cloud automation and Infrastructure as Code (e.g. Terraform).
AWS certifications (e.g. AWS Certified Solutions Architect AWS Certified Big Data - Specialty) are highly desirable.
Required Skills:
BigdataHadoopClouderaHDFSAmazon EMRHiveLamda
Bigdata Tech Lead • Chicago, Illinois, USA
CloudFactory is seeking a Client Principal, AI Consulting for Property & Casualty insurance.You will lead senior-level engagements, shape AI transformation agendas, and drive delivery oversight fro... Show more
Spark Foundry was built during the most transformative time in the history of advertising and marketing.We deliver everything a traditional media agency has to offer and have grown into one of the ... Show more
Senior Product Manager, Digital Transformation.The Senior Product Manager, Digital Transformation will drive the product strategy, product roadmap development, and market delivery/operation for our... Show more
The KPMG Advisory practice is at the forefront of transformation, offering excellent opportunities for individuals to advance their careers and expertise with KPMG.Looking ahead, we anticipate cont... Show more
Comcast is seeking a leader for their Software Engineering for Audience & Measurement department in Chicago, Illinois.The role focuses on managing software platforms for audience data ingestion, en... Show more
Jobtailor in Chicago is seeking an experienced Product Manager to own business-unit relationships, translate needs into structured intake, and guide AI-enabled product delivery.You will work with s... Show more
Publicis Groupe ANZ is seeking a Senior Director of Product Management located in Chicago, who will define and lead the product vision for innovative data products.The ideal candidate will have ove... Show more
For 25 years, Inovus has been helping clients better serve their customers and team members by delivering custom designed and configured business management solutions leveraging low-code and no cod... Show more
Old National Bank has been serving clients and communities since 1834.With over $70 billion in total assets, we are a regional powerhouse deeply rooted in the communities we serve.As a trusted part... Show more
Job Title: Senior Developer / Tech Lead Location: Houston, TX or Chicago, IL (Hybrid) Duration: Temp - 5 months Pay Range: $58/hr to $64/hr (W2) Job ID: 406744 About BCforward BCforward is a leadin... Show more
US AMR-Jones Lang LaSalle Americas, Inc.Senior Manager, Software Engineer to lead the technical execution of a data platform vision in Chicago, IL.You will architect foundational platform services ... Show more
Ovative Group is seeking a CTO to own the technology vision and lead the engineering organization delivering EMRge and the AI OS.You will guide architecture, set standards, and represent Ovative’s ... Show more
V is seeking a Senior Director of Product Management to own the product vision and data roadmap for Epsilon data capabilities.This role requires a leader with over 12 years of experience in product... Show more
Platform Product Leader to drive strategy, prioritization, and evolution of internal platform domains.You will own data platform capabilities that make data reliable, reusable, and accessible acros... Show more
Project Lead - Data and Analytics.We are looking for a dynamic and experienced Project Lead to oversee our data and analytics projects.In this role, you will lead a variety of initiatives aimed at ... Show more
Vizient seeks a Platform Product Leader to drive the strategy, prioritization, and evolution of internal platform domains that support Vizient Intelligence products, including the Enterprise Data L... Show more
Epsilon seeks a Senior Director of Product Management in Chicago to lead the creation of innovative data products.This position involves defining product vision and strategy, managing a team, and e... Show more
Jones Lang LaSalle Incorporated is seeking a Sr Manager, Software Engineering to lead the technical execution of their new data platform vision.This role requires 8+ years of software engineering e... Show more
Chicago, IL is seeking a Lead/Director of Platform Product Management for Data Platform & Operations to shape strategy and drive internal platform capabilities across ingestion, EDL, data quality, ... Show more
Epsilon is seeking a Senior Manager, Software Engineering to lead a high-impact team responsible for building core capabilities for Epsilon Clean Room, a data collaboration platform focused on priv... Show more
