Hadoop developer
Charlotte, NC | 10 - 15 years of experience
Duration: Full Time
Job Description
Must Have Technical/Functional Skills
Primary Skill: Spark, Java, Hive, SQL
Secondary: Unix, Kafka, Python
Experience: 10+ years
Roles & Responsibilities
We are seeking a highly experienced Hadoop Spark Developer with 10+ years of expertise in Big Data technologies, including Java, Spark, Hadoop Ecosystem and Hive. The ideal candidate will be responsible for designing, developing, optimizing, and maintaining large-scale data processing solutions. Experience with Microsoft Copilot for AI-assisted development and productivity enhancement is highly desirable. The developer should hold a bachelor's or master's degree.
The candidate should possess strong analytical skills, hands-on experience in distributed data processing, and the ability to work closely with business stakeholders, architects, and data engineering teams.
Design, develop, and maintain scalable Big Data solutions using Hadoop and Spark.
Build and optimize ETL/ELT pipelines using Java, Spark, Hive, and Python.
Process and analyze large datasets in distributed environments.
Develop high-performance Spark jobs and optimize existing workloads.
Create and manage Hive tables, partitions, views, and complex queries.
Implement data quality, data validation, and reconciliation frameworks.
Perform code reviews and ensure adherence to coding standards and best practices.
Utilize Microsoft Copilot to accelerate development, automate code generation, troubleshooting, documentation, and testing activities.
Strong experience building both batch and real-time streaming applications with Kafka.
Collaborate with Data Architects, Data Scientists, Business Analysts, and DevOps teams.
Troubleshoot production issues and perform root cause analysis.
Design data ingestion frameworks for structured, semi-structured, and unstructured data.
Participate in Agile ceremonies including sprint planning, estimation, and retrospectives.
Mentor junior developers and provide technical leadership.
Hadoop Developer • Charlotte, NC, United States
Job TitleLocation:Charlotte, NC Duration:Permanent-Fulltime Required Skills:Extensive experience architecting build of Data Lake ecosystem using Hadoop, Cassandra platforms.Experience in building b... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Information Technology Professional (IT/CTN/IS).Information Systems Technicians, Cryptologic Technician Networks, and Intelligence Specialists keep the Fleet connected, informed, and secure by oper... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
The Year End Analyst will be responsible for researching and managing changes to yearend reporting guidelines.The Year End Analyst will review all exceptions and partner with other business units t... Show more
IT / OT Infrastructure Manager.Rock Hill, SC (hybrid 3 days onsite / 2 days remote).Candidates must be local to the Rock Hill, SC area or willing to relocate.At Re:Build, our mission is to ensure ... Show more
We design, build, operate, and maintain cyber-physical solutions for the nation's most mission-critical facilities, secure environments, complex infrastructure, and global enterprises.With over 7,0... Show more
Are you interested in being part of an innovative team that supports Westinghouse's mission to provide clean energy solutions? At Westinghouse, we recognize that our employees are our most valuable... Show more
Operations & Community Liaison Intern/Lead.Live your best life possible by helping others live theirs.At ComForCare, we like to celebrate successes and have fun while building meaningful relationsh... Show more
Sunbelt Rentals strives to be the customer's first choice in the equipment rental industry.From pumps to scaffolding to general construction tools, we aim to be the only call needed to outfit a job... Show more
Review and label digital content including text, images, and documents.Every task you complete helps improve how technology interprets information and performs in practical settings.Detail-oriented... Show more
Interpret business requirements while considering three perspectives: the business, technology, and user experience.Partner with Product Management to breakdown Epics into smaller chunks of work th... Show more
Join us as we Rise to the Challenge.At KCI, we're building an enduring community that provides unparalleled value to our employee-owners.We make our mark designing and delivering our world-class so... Show more
Product Testers are wanted to work from home in the UK to fulfill upcoming contracts with local and international companies.We guarantee 15-25 hours per week with an hourly pay of between £18/hr.Th... Show more
Lennar is one of the nation's leading homebuilders, dedicated to making an impact and creating an extraordinary experience for their Homeowners, Communities, and Associates by building quality home... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
CapTech is an award-winning consulting firm that collaborates with clients to achieve what's possible through the power of technology.At CapTech, we're passionate about the work we do and the resul... Show more
Expert Contributor - Software Engineer.Task-Based Independent Contractor Opportunity.We're looking for engineers who can operate at an expert level across real-world, end-to-end tasks in terminal e... Show more
Commissioning Manager - Data Center.Are you looking for a highly rewarding opportunity that provides extensive career growth opportunity? Gilbane is seeking a Commissioning Manager - Data Center to... Show more
