Talent.com
Big Data Solutions Lead Engineer
Big Data Solutions Lead EngineerJPS Tech Solutions LLC • Paterson, New Jersey, USA
Big Data Solutions Lead Engineer

Big Data Solutions Lead Engineer

JPS Tech Solutions LLC • Paterson, New Jersey, USA
6 days ago
Job type
  • Full-time
Job description

Role : Big Data Solutions Lead Engineer

Location : Paterson New Jersey

Experience : 12 Years

Employment : Contract

Interview Type : In-Person or Webcam

Job Overview

We are seeking a highly experienced Big Data Solutions Lead Engineer to design implement and manage large-scale data solutions. The ideal candidate will be responsible for leading the architecture development and optimization of big data platforms ensuring they meet business requirements and performance standards. This role requires strong technical expertise leadership skills and the ability to drive complex projects from conception to deployment.

Key Responsibilities

Lead the design and implementation of end-to-end big data solutions using modern technologies and frameworks.

Architect and manage large-scale data processing pipelines including ETL / ELT workflows data lakes and data warehouses.

Ensure data quality security and governance standards are maintained across all platforms.

Collaborate with stakeholders to understand business requirements and translate them into scalable data solutions.

Evaluate select and implement big data tools technologies and frameworks to optimize performance and efficiency.

Mentor and guide technical teams providing best practices and solutions for complex data challenges.

Troubleshoot and resolve performance issues in existing big data infrastructure.

Develop and maintain documentation for data architecture processes and standards.

Stay current with emerging trends and technologies in big data analytics and cloud platforms.

Required Skills and Qualifications

Education : Bachelors or Masters degree in Computer Science Information Systems or a related field.

Experience : Minimum 12 years of professional experience in big data engineering including hands-on experience with large-scale data platforms.

Technical Skills :

Expertise in big data technologies such as Hadoop Spark Kafka Hive HBase or similar.

Proficient in programming languages like Java Scala or Python.

Experience with cloud platforms such as AWS Azure or GCP and cloud-based data services.

Strong knowledge of data modeling ETL / ELT processes and data warehousing concepts.

Familiarity with data governance data security and compliance requirements.

Soft Skills :

Strong problem-solving and analytical skills.

Excellent leadership and team management capabilities.

Effective communication skills for collaborating with technical and non-technical stakeholders.

Ability to manage multiple priorities and projects in a fast-paced environment.

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Full Time

Experience : years

Vacancy : 1

Create a job alert for this search

Big Data Engineer • Paterson, New Jersey, USA

Related jobs
Big Data Solutions Lead Engineer

Big Data Solutions Lead Engineer

JPS Tech Solutions LLC • Paterson, NJ, United States
Full-time
Quick Apply
Role : Big Data Solutions Lead Engineer Location : Paterson, New JerseyShow more
Last updated: 7 days ago
Business Analytics Lead Analyst

Business Analytics Lead Analyst

Pyramid Consulting, Inc • Morris Plains, NJ, US
Temporary
Business Analytics Lead Analyst.Please review the job description below and contact me ASAP if you are interested.Employee benefits include, but are not limited to, health insurance (medical, denta...Show more
Last updated: 12 days ago • Promoted
Data Engineer

Data Engineer

ALTA IT Services • Elizabeth, New Jersey, United States
Full-time
Job Title : Data Engineer Location : Elizabeth, New Jersey Type : Contract Contractor Work Model : Hybrid - remote, occasional travel to the office will be required Data Engineer We’re seeking a Data E...Show more
Last updated: 22 hours ago • Promoted • New!
AD, IDS and Data Partnerships

AD, IDS and Data Partnerships

Novartis Group Companies • East Hanover, NJ, United States
Full-time
The Insights and Decision Science (IDS) team is dedicated to enabling improved decision-making at Novartis by leveraging data and advanced analytics capabilities to generate actionable insights tha...Show more
Last updated: 30+ days ago • Promoted
Digital Analytics Lead Engineer

Digital Analytics Lead Engineer

JPS Tech Solutions LLC • Newark, NJ, United States
Full-time
Quick Apply
Role : Digital Analytics Lead Engineer Location : Newark, New JerseyShow more
Last updated: 7 days ago
Cloud Deployment Engineer- Senior Associate

Cloud Deployment Engineer- Senior Associate

PwC • Florham Park, NJ, United States
Full-time
Platform Engineering & Architecture.At PwC, our people in integration and platform architecture focus on designing and implementing seamless integration solutions and robust platform architectures ...Show more
Last updated: 2 days ago • Promoted
Director, Data Science 1 of 2

Director, Data Science 1 of 2

Novartis Group Companies • East Hanover, NJ, United States
Full-time
This position will be located at the East Hanover, NJ location and will not have the ability to be located remotely.The Insights and Decision Science (IDS) team is dedicated to enabling improved de...Show more
Last updated: 30+ days ago • Promoted
Data & Analytics Architect (Hybrid)

Data & Analytics Architect (Hybrid)

Selective Insurance • Short Hills, NJ, United States
Temporary
At Selective, we don't just insure uniquely, we employ uniqueness.Selective's unique position as both a leading insurance group and an employer of choice is recognized in a wide variety of awards a...Show more
Last updated: 30+ days ago • Promoted
Lead Data Engineer

Lead Data Engineer

Softworld Inc • Roseland, New Jersey, United States
Full-time
Job Title : Lead Data Engineer Job Location : Roseland New Jersey 07068 Onsite Requirements : Data Bricks - must be skilled in data pipelines AWS - Experienced in AWS services related to data migratio...Show more
Last updated: 12 days ago • Promoted
Snowflake Data Engineer

Snowflake Data Engineer

Diligent Tec Inc • Parsippany, NJ, New Jersey, USA
Full-time
Job Title : Snowflake Data Engineer Location : Parsippany, NJ Type : Contract (2+ Years- Long Term Contract) •NOTE : Show more
Last updated: 12 days ago
Director, IDS and Data Partnerships

Director, IDS and Data Partnerships

Novartis Group Companies • East Hanover, NJ, United States
Full-time
The Insights and Decision Science (IDS) team is dedicated to enabling improved decision-making at Novartis by leveraging data and advanced analytics capabilities to generate actionable insights tha...Show more
Last updated: 30+ days ago • Promoted
Data Engineering Team Lead (Hybrid)

Data Engineering Team Lead (Hybrid)

Selective Insurance • Short Hills, NJ, United States
Temporary
At Selective, we don't just insure uniquely, we employ uniqueness.Selective's unique position as both a leading insurance group and an employer of choice is recognized in a wide variety of awards a...Show more
Last updated: 30+ days ago • Promoted
Big Data Developer

Big Data Developer

Syntricate Technologies • Iselin, NJ, United States
Full-time
Iselin, NJ (3 days a week onsite).They have to screen out as mid-level in apache spark, programming concepts and then whatever language it is that they use, either Scala, python, or java.Experience...Show more
Last updated: 30+ days ago • Promoted
Sr. Data Engineer

Sr. Data Engineer

VeeRteq Solutions Inc. • Iselin, NJ, United States
Full-time
Quick Apply
Job Description : Job Summary : Show more
Last updated: 16 days ago
BigData and Hadoop Ecosystems

BigData and Hadoop Ecosystems

CData Software • Piscataway, NJ, United States
Full-time
Technical Skills : Must be experienced in the following areas : Linux expertise; experience in the set-up and administration of Hadoop platform. working knowledge of tools like Hive, Spark, HBase, S...Show more
Last updated: 3 days ago • Promoted
Bigdata Hadoop Architect - Multiple openings

Bigdata Hadoop Architect - Multiple openings

ClifyX • Edison, NJ, United States
Full-time
Technology Architect | Big Data - Hadoop | Hive.Work Location & Address : Edison, NJ san jose CA.Are you flexible on the rate? (Yes / No) : Yes. Contract duration (in months) : 3.Target Start Date : 15 M...Show more
Last updated: 3 days ago • Promoted
Data Engineer

Data Engineer

Drillo.AI • New Providence, NJ, US
Full-time
Job Title : Senior Data Engineer (Python & Snowflake, SQL).Data Engineer (Python, Snowflake, SQL).Python, Snowflake, SQL coding skills. The developer should be able to.The developer should be abl...Show more
Last updated: 8 days ago • Promoted
Data Analysis Lead

Data Analysis Lead

TekWissen LLC • Morristown, NJ, United States
Temporary
Quick Apply
Overview : TekWissen is a global workforce management provider headquartered in Ann Arbor, Michigan that offers strategic talent solutions tour clien...Show more
Last updated: 2 days ago