Data EngineerAmicis Global • Jersey, New Jersey, USA

Data Engineer

Amicis Global • Jersey, New Jersey, USA

4 days ago

Job type

Full-time

Job description

Job Title : Data Engineer

Location :

Jersey City NJ 07311 - Hybrid

Duration : 06 Months

Summary :

Builds a comprehensive QA framework in Azure DataBricks that gather store detect and process large volumes of data for QA analysis and detection of bugs found in ETL code.

Responsibilities :

Develop QA ETL pipelines ensure data quality optimize data storage solutions. Skills : Python SQL cloud data tools experience (e.g. AWS Glue Azure Data Factory Azure DataBricks). Work with the QA analysts to test code and data as part of the SDLC process.

The Security Data Operations team is looking for a QA Data Engineer to design and develop a QA framework and pipeline for the CyberDW on the

Data Lakehouse.

This role is a necessary component and part of the overall SDLC effort to centralize Information Security data and test the accuracy of storing and transforming the ETL process through the medallion architecture.

To achieve success this individual will be required to analyze and develop the ingestion pipeline that will be used to test the data feeds from raw transformation and to the target process.

This individual will function as a development resource in the Information Security Data Operations team and be a technical liaison between IT and the CDAO Data Engineering teams.

They will be responsible for creating a mechanism to create JIRA tickets for the developers to remediate and fix their code if bug arise.

These QA processes will be built to be flexible adaptable and scalable.

They will be responsible for timely follow-ups and routine updates to the CyberDW sprint schedule as well as adherence to the internal IT SDLC agile processes.

#CareerBuilder #Monster #Dice #Indeed #LinkedIn

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Full Time

Experience : years

Vacancy : 1

Create a job alert for this search

Data Engineer • Jersey, New Jersey, USA

Similar jobs

Senior Data Engineer

Maven Clinic • New York, New York, US

Full-time

Job Description Job Description Maven is the world's largest virtual clinic for women and families on a mission to make healthcare work for all of us. Maven's award-winning digital programs provid...Show more

Last updated: 5 days ago • Promoted

Data Engineer

VirtualVocations • Bronx, New York, United States

Full-time

A company is looking for a Data Engineer with experience in building and optimizing data pipelines and reporting solutions. Key Responsibilities Develop and improve reporting solutions while worki...Show more

Last updated: 2 days ago • Promoted

Data Engineer

BBR Partners • New York, New York, US

Full-time

Job Description Job Description FIRM OVERVIEW BBR Partners is a boutique wealth management firm providing customized investment strategies and bespoke advice to high-net-worth individuals and fam...Show more

Last updated: 5 days ago • Promoted

Data Engineer

Tiger Analytics Inc. • City of Jersey City, New Jersey, US

Full-time

Job Description Job Description Tiger Analytics is a fast-growing advanced analytics consulting firm.Our consultants bring deep expertise in Data Science, Machine Learning and AI.We are the trust...Show more

Last updated: 5 days ago • Promoted

Data Engineer

Contact Government Services, LLC • New York, New York, US

Full-time

Job Description Job Description Data Engineer Employment Type : Full-Time, Mid-level Department : Business Intelligence CGS is seeking a passionate and driven Data Engineer to support a rapidly gr...Show more

Last updated: 5 days ago • Promoted

Data Engineer

The Cypress Group • New York, New York, US

Full-time

Job Description Job Description Our client is a hedge fund in NYC looking for a talented Data Engineer to join their team. Qualified candidates will have 5-10+ years of professional experience.Spe...Show more

Last updated: 5 days ago • Promoted

Data Engineer

Prizeout • New York, New York, US

Full-time

Job Description Job Description What is Prizeout Prizeout is a fast-growing fintech transforming how people interact with their money by turning everyday transactions into rewarding, value-drive...Show more

Last updated: 5 days ago • Promoted

Data Engineer

Tabs • New York, New York, US

Full-time

Job Description Job Description Tabs is the leading AI-native revenue platform for modern finance and accounting teams.Tabs agents automates the entire contract-to-cash lifecycle, including billi...Show more

Last updated: 5 days ago • Promoted

Data Engineer

BDG • New York, New York, US

Full-time

Job Description Job Description Bustle Digital Group (BDG) is looking for a talented Data Engineer to join our growing data team. You will work alongside the Director of Data Engineering to build,...Show more

Last updated: 5 days ago • Promoted

Data Engineer

Zone IT Solutions • New York, New York, US

Permanent

Job Description Job Description We are actively looking for Data Engineer for a permanent position.This exciting opportunity is with a well-established global IT service provider known for its ex...Show more

Last updated: 5 days ago • Promoted

Data Engineer II

Garner Health • New York, New York, US

Full-time

Job Description Job Description Garner's mission is to transform the healthcare economy, delivering high-quality and affordable care for all. We are fundamentally reimagining how healthcare works ...Show more

Last updated: 5 days ago • Promoted

Senior Data Engineer

Applecart • New York, New York, US

Full-time

Job Description Job Description Applecart is the leading technology company that C-suites rely on to reach business-critical decision makers. The most important decisions are made by the hardest p...Show more

Last updated: 5 days ago • Promoted

Data Engineer - Analytics and GTM

Career Renew • New York, New York, US

Full-time

Job Description Job Description Career Renew is recruiting for one of its clients a Data Engineer - Analytics and GTM - this is a fully onsite position in NYC. Salary range : 140-220K USD yearly pl...Show more

Last updated: 5 days ago • Promoted

Data Engineer

Chelsea Technologies • New York, New York, US

Full-time

Job Description Job Description Salary : $130,000 $140,000 Data Engineer FLSA Classification : Exempt Professional Position Summary The Data Engineer serves as a consultative technology partner to ...Show more

Last updated: 3 days ago • Promoted

Senior Data Engineer

Jobot • New York City, NY, US

Full-time

Join a World Class Team Operating at the Intersection of Technology, Data, and Digital Products.This Jobot Job is hosted by : Amanda Preston. Are you a fit? Easy Apply now by clicking the "Apply" but...Show more

Last updated: 4 days ago • Promoted

Data engineer

Jobot • New York, NY, US

Full-time

One of the HOTTEST and FASTEST growing companies in the US is adding to their team.This Jobot Job is hosted by : Adam Bennett. Are you a fit? Easy Apply now by clicking the "Apply Now" button and sen...Show more

Last updated: 14 days ago • Promoted

Data Engineer

Forhyre • New York, New York, US

Full-time

Job Description Job Description We are looking for a passionate certified Data Engineer.The successful candidate will turn data into information, information into insight and insight into busines...Show more

Last updated: 5 days ago • Promoted

Data Engineer - Product

2070Health • New York, New York, US

Full-time

Job Description Job Description This is not a role for 2070.About Xponentiate : Xponentiate is a healthcare recruitment partner with deep industry expertise. We connect top talent with the right op...Show more

Last updated: 5 days ago • Promoted