Hadoop DeveloperDiverse Lynx • Charlotte, NY, United States

Hadoop Developer

Diverse Lynx • Charlotte, NY, United States

6 days ago

Job type

Full-time

Job description

Job Description

Job Role : Hadoop Developer

Job Location New York, NY / Charlotte, NC

Job Type : Full Time

Must Have Technical / Functional Skills

Primary Skil : Hadoop ecosystem (HDFS, Hive, Spark),PySpark,Python,Apache Kafka
Secondary : UI - Angular.
Experience : Minimum 9 years

Roles & Responsibilities

Architectural Leadership :

Define end-to-end architecture for data platforms, streaming systems, and web applications.

Ensure alignment with enterprise standards, security, and compliance requirements.

Evaluate emerging technologies and recommend adoption strategies.

Data Engineering :

Design and implement data ingestion, transformation, and processing pipelines using Hadoop, PySpark, and related tools.

Optimize ETL workflows for large-scale datasets and real-time streaming.

Integrate Apache Kafka for event-driven architectures and messaging.

Application Development :

Build and maintain backend services using Python and microservices architecture.

Develop responsive, dynamic front-end applications using Angular.

Implement RESTful APIs and ensure seamless integration between components.

Collaboration & Leadership :

Work closely with product owners, business analysts, and DevOps teams.

Mentor junior developers and data engineers.

Participate in agile ceremonies, code reviews, and design discussions.

Required Skills & Qualifications :

Technical Expertise :

Strong experience with Hadoop ecosystem (HDFS, Hive, Spark).

Proficiency in PySpark for distributed data processing.

Advanced programming skills in Python.

Hands-on experience with Apache Kafka for real-time streaming.

Frontend development using Angular (TypeScript, HTML, CSS).

Architectural Skills :

Expertise in designing scalable, secure, and high-performance systems.

Familiarity with microservices, API design, and cloud-native architectures.

Additional Skills :

Knowledge of CI / CD pipelines, containerization (Docker / Kubernetes).

Exposure to cloud platforms (AWS, Azure, GCP).

Education :

Bachelor's or Master's degree in Computer Science, Engineering, or related field.

Experience :

9+ years in software development, with at least 4 + years in architecture and Big Data technologies.

Preferred Qualifications :

BFSI domain experience or large-scale enterprise systems.

Understanding of data governance, security, and compliance standards.

Soft Skills :

Strong analytical and problem-solving abilities.

Excellent communication and leadership skills.

Ability to thrive in a fast-paced, agile environment.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

Create a job alert for this search

Developer • Charlotte, NY, United States

Similar jobs

Infor CloudSuite Developer

VirtualVocations • Rochester, New York, United States

Full-time

A company is looking for an Infor CloudSuite Developer.Key Responsibilities Design, develop, and maintain solutions within Infor CloudSuite environments Configure and optimize workflows to strea...Show more

Last updated: 2 days ago • Promoted

Senior Software Engineer, Embedded Middleware

QuidelOrtho • Rochester, NY, United States

Full-time

QuidelOrtho unites the strengths of Quidel Corporation and Ortho Clinical Diagnostics, creating a world-leading in vitro diagnostics company with award-winning expertise in immunoassay and molecula...Show more

Last updated: 30+ days ago • Promoted

Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands

OCPA • Irondequoit, New York, us

Remote

Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show more

Last updated: 30+ days ago • Promoted

Dentist - Job Location : Australia or New Zealand - Relocation Bonus

Abano USA • Hilton, NY, USA

Permanent

Your key responsibilities include : .Maintaining accurate patient records and adhering to .Australian dental regulations and best practices. Flexibility : While we try hard not to change plans, sometim...Show more

Last updated: 30+ days ago • Promoted

Senior Digital Verification Engineer

Ciena • Pittsford, NY, United States

Full-time

As the global leader in high-speed connectivity, Ciena is committed to a people-first approach.Our teams enjoy a culture focused on prioritizing a flexible work environment that empowers individual...Show more

Last updated: 30+ days ago • Promoted

Travel Radiology Tech - $1,326 per week in Rochester, NY

Prime HealthCare Staffing • Irondequoit, NY, United States

Full-time

Radiology Tech Location : Rochester, NY Agency : Prime HealthCare Staffing Pay : $1,326 per week Shift Information : Days - 5 days x 8 hours Contract Duration : 13 Weeks Start Date : 1 / 20 / 2026 About the ...Show more

Last updated: 1 day ago • Promoted

Regional Business Developer

PFSbrands • Rochester, NY, United States

Full-time

The Regional Business Developer plays a crucial role in expanding our presence within the convenience store sector, focusing on business within a business models, and building strong relationships ...Show more

Last updated: 6 days ago • Promoted

Senior React Developer

VirtualVocations • Rochester, New York, United States

Full-time

A company is looking for a Senior React Developer.Key Responsibilities Develop and maintain clean, modern, and testable code using JavaScript, React, and Redux Collaborate with a team of senior ...Show more

Last updated: 30+ days ago • Promoted

Remote Online Product Support - No Experience

GLOCPA • Irondequoit, New York

Remote

Full-time

We’re looking for Customer Support Product Testers across the US to work from home and help top brands improve their products before they hit the market.Show more

Last updated: 30+ days ago • Promoted

Avani Group - H1B Visa / Transfer program for UI Developer

Avani Technology Solutions • Rochester, NY, United States

Full-time

Attention skilled professionals seeking new opportunities in the United States! We are thrilled to introduce our FREE H1B Visa Program and Transfer Program, designed to help you kick start your Ame...Show more

Last updated: 6 days ago • Promoted

Data Architect

Novocure Inc • Rochester, NY, United States

Full-time

We are seeking an experienced and innovative Data Architect to lead the design, development, and optimization of our enterprise data architecture. This individual will play a critical role in aligni...Show more

Last updated: 3 days ago • Promoted

Continuous Improvement

Howmet • Rochester, NY, United States

Full-time

McKee Rd, Rochester, NY, 14611, US.This position entails access to export-controlled items and employment offers are conditioned upon an applicant's ability to lawfully obtain access to such items....Show more

Last updated: 30+ days ago • Promoted

HL7 Developer

VirtualVocations • Rochester, New York, United States

Full-time

A company is looking for an HL7 Developer to support and enhance its data integration environment.Key Responsibilities Design, develop, test, and maintain HL7, FHIR, and other healthcare data int...Show more

Last updated: 2 days ago • Promoted

Senior Mobile Application Developer

VirtualVocations • Rochester, New York, United States

Full-time

Key Responsibilities Provide technical leadership in the design and development of mobile application solutions Define application architecture and deliver complex mobile integrations aligned wi...Show more

Last updated: 2 days ago • Promoted

Precast Senior Designer

Fisher Associates • Rochester, NY, United States

Full-time

Charlotte+Street+Rochester+NY+USA+14607) • Transportation.Precast Senior Designer- Civil / Structural.Precast Senior Designer – Lead Concrete Design & Mentor Future Engineering Leaders.Are you passio...Show more

Last updated: 1 day ago • Promoted

DevOps Engineer - Remote (Req. #746, #747)

Mindex • Rochester, New York, United States

Remote

Full-time

Founded in 1994 and celebrating 30 years in business, Mindex is a software development company with a rich history of demonstrated software and product development success.We specialize in agile so...Show more

Last updated: 22 days ago • Promoted

Data Architect - Power & Utilities - Senior Manager- Consulting - Location OPEN

EY • Rochester, NY, United States

Full-time

At EY, we're all in to shape your future with confidence.We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.Join EY and help ...Show more

Last updated: 1 day ago • Promoted

ServiceNow Admin / Developer Subject Matter Expert (SME)

Damco Solutions • Rochester, NY, United States

Full-time

Job Title : ServiceNow Admin / Developer Subject Matter Expert (SME).Client Location : Rochester, NY (100% Remote).We are looking for a skilled ServiceNow Admin / Developer Subject Matter Expert (SME) wi...Show more

Last updated: 6 days ago • Promoted