Data EngineerAmicis Global • Jersey, New Jersey, USA

Data Engineer

Amicis Global • Jersey, New Jersey, USA

2 days ago

Job type

Full-time

Job description

Job Title : Data Engineer

Location :

Jersey City NJ 07311 - Hybrid

Duration : 06 Months

Summary :

Builds a comprehensive QA framework in Azure DataBricks that gather store detect and process large volumes of data for QA analysis and detection of bugs found in ETL code.

Responsibilities :

Develop QA ETL pipelines ensure data quality optimize data storage solutions. Skills : Python SQL cloud data tools experience (e.g. AWS Glue Azure Data Factory Azure DataBricks). Work with the QA analysts to test code and data as part of the SDLC process.

The Security Data Operations team is looking for a QA Data Engineer to design and develop a QA framework and pipeline for the CyberDW on the

Data Lakehouse.

This role is a necessary component and part of the overall SDLC effort to centralize Information Security data and test the accuracy of storing and transforming the ETL process through the medallion architecture.

To achieve success this individual will be required to analyze and develop the ingestion pipeline that will be used to test the data feeds from raw transformation and to the target process.

This individual will function as a development resource in the Information Security Data Operations team and be a technical liaison between IT and the CDAO Data Engineering teams.

They will be responsible for creating a mechanism to create JIRA tickets for the developers to remediate and fix their code if bug arise.

These QA processes will be built to be flexible adaptable and scalable.

They will be responsible for timely follow-ups and routine updates to the CyberDW sprint schedule as well as adherence to the internal IT SDLC agile processes.

#CareerBuilder #Monster #Dice #Indeed #LinkedIn

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Full Time

Experience : years

Vacancy : 1

Create a job alert for this search

Data Engineer • Jersey, New Jersey, USA

Similar jobs

Data Engineer

VirtualVocations • Yonkers, New York, United States

Full-time

A company is looking for a Data Engineer to manage and enhance its data infrastructure.Key Responsibilities Own and evolve end-to-end data infrastructure, including ingestion, transformation, mod...Show more

Last updated: 27 days ago • Promoted

Senior Data Engineer

New York Blood Center • New York, NY, United States

Full-time

Design, implement, and optimize robust and scalable data pipelines using SQL, Python, and cloud-based ETL tools such as Databricks. Ensure efficient data flow and processing to support large-scale d...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

BBR Partners • New York, New York, US

Full-time

Job Description Job Description FIRM OVERVIEW BBR Partners is a boutique wealth management firm providing customized investment strategies and bespoke advice to high-net-worth individuals and fam...Show more

Last updated: 3 days ago • Promoted

Data Engineer

Contact Government Services, LLC • New York, New York, US

Full-time

Job Description Job Description Data Engineer Employment Type : Full-Time, Mid-level Department : Business Intelligence CGS is seeking a passionate and driven Data Engineer to support a rapidly gr...Show more

Last updated: 3 days ago • Promoted

Data Engineer

The Cypress Group • New York, New York, US

Full-time

Job Description Job Description Our client is a hedge fund in NYC looking for a talented Data Engineer to join their team. Qualified candidates will have 5-10+ years of professional experience.Spe...Show more

Last updated: 3 days ago • Promoted

Data Engineer

Prizeout • New York, New York, US

Full-time

Job Description Job Description What is Prizeout Prizeout is a fast-growing fintech transforming how people interact with their money by turning everyday transactions into rewarding, value-drive...Show more

Last updated: 3 days ago • Promoted

Data Engineer

Tabs • New York, New York, US

Full-time

Job Description Job Description Tabs is the leading AI-native revenue platform for modern finance and accounting teams.Tabs agents automates the entire contract-to-cash lifecycle, including billi...Show more

Last updated: 3 days ago • Promoted

Data Engineer (W2, F2F)

Siritech Solutions Corp • New York, New York, US

Full-time

Job Description Job Description Position : Data Engineer Location : NYCNY / Atlanta GA (In-Person Interview) Duration : 12 Months Need locals to NY or GA with local DL / State ID W2 Only - Face to Fac...Show more

Last updated: 2 days ago • Promoted

Data Engineer

BDG • New York, New York, US

Full-time

Job Description Job Description Bustle Digital Group (BDG) is looking for a talented Data Engineer to join our growing data team. You will work alongside the Director of Data Engineering to build,...Show more

Last updated: 3 days ago • Promoted

Data Engineer

Zone IT Solutions • New York, New York, US

Permanent

Job Description Job Description We are actively looking for Data Engineer for a permanent position.This exciting opportunity is with a well-established global IT service provider known for its ex...Show more

Last updated: 3 days ago • Promoted

Lead Data Engineer, Revenue Engine

Charlie Health Engineering, Product & Design • New York, New York, US

Full-time

Job Description Job Description Why Charlie Health? Millions of people across the country are navigating mental health conditions, substance use disorders, and eating disorders, but too often, th...Show more

Last updated: 3 days ago • Promoted

Data Engineer II

Garner Health • New York, New York, US

Full-time

Job Description Job Description Garner's mission is to transform the healthcare economy, delivering high-quality and affordable care for all. We are fundamentally reimagining how healthcare works ...Show more

Last updated: 3 days ago • Promoted

Data Engineer

Canoe Intelligence • New York, New York, US

Full-time

Job Description Job Description COMPANY : Canoe Intelligence WEBSITE : https : / / canoeintelligence.TITLE : Data Engineer LOCATION : New York City (hybrid) or Fully Remote in the United States SALARY : ...Show more

Last updated: 3 days ago • Promoted

Data Engineer - Analytics and GTM

Career Renew • New York, New York, US

Full-time

Job Description Job Description Career Renew is recruiting for one of its clients a Data Engineer - Analytics and GTM - this is a fully onsite position in NYC. Salary range : 140-220K USD yearly pl...Show more

Last updated: 3 days ago • Promoted

Data Engineer

Chelsea Technologies • New York, New York, US

Full-time

Job Description Job Description Salary : $130,000 $140,000 Data Engineer FLSA Classification : Exempt Professional Position Summary The Data Engineer serves as a consultative technology partner to ...Show more

Last updated: 2 days ago • Promoted

Data Engineer

Forhyre • New York, New York, US

Full-time

Job Description Job Description We are looking for a passionate certified Data Engineer.The successful candidate will turn data into information, information into insight and insight into busines...Show more

Last updated: 3 days ago • Promoted

Data Engineer

The People Placers • Montvale, NJ, US

Full-time

We are seeking a highly skilled Data Engineer to build and manage our data infrastructure.The ideal candidate will be an expert in writing complex SQL queries, designing efficient database schemas,...Show more

Last updated: 6 days ago • Promoted

Data Eng - Analytics and GTM

MLabs • New York, New York, US

Full-time

Job Description Job Description Data Eng - Analytics and GTM Location : New york Onsite | Full-time Compensation : $140K - $220K We are an aggressively growing, well-funded fintech startup (Series...Show more

Last updated: 1 day ago • Promoted