Talent.com
Big Data Solutions Lead Engineer
Big Data Solutions Lead EngineerJPS Tech Solutions LLC • Paterson, New Jersey, USA
Big Data Solutions Lead Engineer

Big Data Solutions Lead Engineer

JPS Tech Solutions LLC • Paterson, New Jersey, USA
8 days ago
Job type
  • Full-time
Job description

Role : Big Data Solutions Lead Engineer

Location : Paterson New Jersey

Experience : 12 Years

Employment : Contract

Interview Type : In-Person or Webcam

Job Overview

We are seeking a highly experienced Big Data Solutions Lead Engineer to design implement and manage large-scale data solutions. The ideal candidate will be responsible for leading the architecture development and optimization of big data platforms ensuring they meet business requirements and performance standards. This role requires strong technical expertise leadership skills and the ability to drive complex projects from conception to deployment.

Key Responsibilities

Lead the design and implementation of end-to-end big data solutions using modern technologies and frameworks.

Architect and manage large-scale data processing pipelines including ETL / ELT workflows data lakes and data warehouses.

Ensure data quality security and governance standards are maintained across all platforms.

Collaborate with stakeholders to understand business requirements and translate them into scalable data solutions.

Evaluate select and implement big data tools technologies and frameworks to optimize performance and efficiency.

Mentor and guide technical teams providing best practices and solutions for complex data challenges.

Troubleshoot and resolve performance issues in existing big data infrastructure.

Develop and maintain documentation for data architecture processes and standards.

Stay current with emerging trends and technologies in big data analytics and cloud platforms.

Required Skills and Qualifications

Education : Bachelors or Masters degree in Computer Science Information Systems or a related field.

Experience : Minimum 12 years of professional experience in big data engineering including hands-on experience with large-scale data platforms.

Technical Skills :

Expertise in big data technologies such as Hadoop Spark Kafka Hive HBase or similar.

Proficient in programming languages like Java Scala or Python.

Experience with cloud platforms such as AWS Azure or GCP and cloud-based data services.

Strong knowledge of data modeling ETL / ELT processes and data warehousing concepts.

Familiarity with data governance data security and compliance requirements.

Soft Skills :

Strong problem-solving and analytical skills.

Excellent leadership and team management capabilities.

Effective communication skills for collaborating with technical and non-technical stakeholders.

Ability to manage multiple priorities and projects in a fast-paced environment.

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Full Time

Experience : years

Vacancy : 1

Create a job alert for this search

Big Data Engineer • Paterson, New Jersey, USA

Related jobs
AD, IDS and Data Partnerships

AD, IDS and Data Partnerships

Novartis Group Companies • East Hanover, NJ, United States
Full-time
The Insights and Decision Science (IDS) team is dedicated to enabling improved decision-making at Novartis by leveraging data and advanced analytics capabilities to generate actionable insights tha...Show more
Last updated: 30+ days ago • Promoted
Executive Partner - Data & Analytics Advisor

Executive Partner - Data & Analytics Advisor

Gartner • Newark, NJ, United States
Full-time
Executive Technology Services is an executive-level advisory service that delivers expert insight and guidance tailored to each member's context and most critical initiatives.EITL consists of 7 are...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer - MDM

Senior Data Engineer - MDM

Synechron • Iselin, NJ, United States
Full-time
At Synechron, we believe in the power of digital to transform businesses for the better.Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital ...Show more
Last updated: 1 day ago • Promoted
Director, Data Science 1 of 2

Director, Data Science 1 of 2

Novartis Group Companies • East Hanover, NJ, United States
Full-time
This position will be located at the East Hanover, NJ location and will not have the ability to be located remotely.The Insights and Decision Science (IDS) team is dedicated to enabling improved de...Show more
Last updated: 30+ days ago • Promoted
Director, Platform and Data Security

Director, Platform and Data Security

Zelis Healthcare, LLC • Morristown, NJ, United States
Full-time
Zelis is modernizing the healthcare financial experience across payers, providers, and healthcare consumers.We serve more than 750 payers, including the top five national health plans, regional hea...Show more
Last updated: 30+ days ago • Promoted
Python Data Engineer (Iselin)

Python Data Engineer (Iselin)

TEKVANA INC. • Iselin, NJ, US
Part-time
Job Title : Data Engineer (Python, Spark, Cloud).Location : Iselin NJ or Charlette NC.Work Authorization : US Citizens only. Python and Big Data skills to design, develop, and maintain scalable data pip...Show more
Last updated: 21 hours ago • Promoted • New!
Data & Analytics Architect (Hybrid)

Data & Analytics Architect (Hybrid)

Selective Insurance • Short Hills, NJ, United States
Temporary
At Selective, we don't just insure uniquely, we employ uniqueness.Selective's unique position as both a leading insurance group and an employer of choice is recognized in a wide variety of awards a...Show more
Last updated: 30+ days ago • Promoted
Python Data Engineer

Python Data Engineer

TEKVANA INC. • Iselin, NJ, United States
Full-time
Job Title : Data Engineer (Python, Spark, Cloud).Location : Iselin NJ or Charlette NC.Work Authorization : US Citizens only. Python and Big Data skills to design, develop, and maintain scalable data pip...Show more
Last updated: 21 hours ago • Promoted • New!
Senior Data Engineer - Master Data Management (MDM)

Senior Data Engineer - Master Data Management (MDM)

Synechron • Iselin, NJ, United States
Full-time
We are seeking a highly skilled and experienced Senior Data Engineer specializing in Master Data Management (MDM) to join our data team. The ideal candidate will have a strong background in designin...Show more
Last updated: 1 day ago • Promoted
Director, IDS and Data Partnerships

Director, IDS and Data Partnerships

Novartis Group Companies • East Hanover, NJ, United States
Full-time
The Insights and Decision Science (IDS) team is dedicated to enabling improved decision-making at Novartis by leveraging data and advanced analytics capabilities to generate actionable insights tha...Show more
Last updated: 30+ days ago • Promoted
Lead data Engineer (W2 OnlY) (Roseland)

Lead data Engineer (W2 OnlY) (Roseland)

Oreva Technologies, Inc. • Roseland, NJ, US
Part-time
Role : Lead Data Engineer (W2 Only).Location : Hybrid 3 times a week in Roseland, NJ.Lead experience- this can be supplemented for staff as well. Bachelor's degree in computer science, information tec...Show more
Last updated: 1 day ago • Promoted
Senior Data Architect

Senior Data Architect

ValueMomentum • Edison, NJ, United States
Full-time
Act as a Enterprise Architect, supporting architecture reviews, design decisions, and strategic planning.Design and implement scalable data warehouse and analytics solutions on AWS and Snowflake.De...Show more
Last updated: 21 hours ago • Promoted • New!
Data Engineering Team Lead (Hybrid)

Data Engineering Team Lead (Hybrid)

Selective Insurance • Short Hills, NJ, United States
Temporary
At Selective, we don't just insure uniquely, we employ uniqueness.Selective's unique position as both a leading insurance group and an employer of choice is recognized in a wide variety of awards a...Show more
Last updated: 30+ days ago • Promoted
Big Data Developer

Big Data Developer

Syntricate Technologies • Iselin, NJ, United States
Full-time
Iselin, NJ (3 days a week onsite).They have to screen out as mid-level in apache spark, programming concepts and then whatever language it is that they use, either Scala, python, or java.Experience...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer - Master Data Management (MDM) (Iselin)

Senior Data Engineer - Master Data Management (MDM) (Iselin)

Synechron • Iselin, NJ, US
Part-time
We are seeking a highly skilled and experienced Senior Data Engineer specializing in Master Data Management (MDM) to join our data team. The ideal candidate will have a strong background in designin...Show more
Last updated: 1 day ago • Promoted
Senior Data Engineer

Senior Data Engineer

Apexon • New Providence, NJ, United States
Full-time
Apexon is a digital-first technology services firm specializing in accelerating business transformation and delivering human-centric digital experiences. We have been meeting customers wherever they...Show more
Last updated: 1 day ago • Promoted
BigData and Hadoop Ecosystems

BigData and Hadoop Ecosystems

CData Software • Piscataway, NJ, United States
Full-time
Technical Skills : Must be experienced in the following areas : Linux expertise; experience in the set-up and administration of Hadoop platform. working knowledge of tools like Hive, Spark, HBase, S...Show more
Last updated: 5 days ago • Promoted
Lead data Engineer (W2 OnlY)

Lead data Engineer (W2 OnlY)

Oreva Technologies, Inc. • Roseland, NJ, United States
Full-time
Role : Lead Data Engineer (W2 Only).Location : Hybrid 3 times a week in Roseland, NJ.Lead experience- this can be supplemented for staff as well. Bachelor's degree in computer science, information tec...Show more
Last updated: 1 day ago • Promoted