Data Pipeline EngineerCcmpool • Rockaway, NJ, US

Data Pipeline Engineer

Ccmpool • Rockaway, NJ, US

5 days ago

Job type

Full-time

Job description

Position Summary

CCM Consolidated Intermodal Technologies Group (CIT) is seeking a highly skilled and detail-oriented Data Pipeline Engineer to join our team. The role designs, builds, and maintains systems that process and transport data efficiently, ensuring seamless data flow from various sources to storage solutions. By managing the data lifecycle, the engineer supports business objectives through enhanced decision-making and operational efficiency.

Key Duties

Ingest, transform, load, and distribute data.
Troubleshoot data issues, optimize existing pipelines, and implement new technologies.
Work with API standards, EDI protocols, and commercial ETL tools.

Location

This position is located on-site in Rockaway, NJ.

Responsibilities

Develop and maintain scalable data pipelines to support data processing and transformation.

Collaborate with cross-functional teams to gather requirements and design and document data solutions.

Monitor and optimize existing data pipelines for performance and reliability.

Ensure data quality and integrity through rigorous testing and validation processes.

Implement and manage ETL processes to extract, transform, and load data from various sources.

Document data pipeline architecture, processes, and workflows for future reference.

Stay updated with the latest industry trends and technologies related to data engineering.

Requirements

Bachelor's degree in Computer Science, Information Technology, Business, or a related field (or equivalent work experience).

5+ years of experience working in the data pipeline field or in a similar role.

Proven experience with EDI protocols (e.g., X12, EDIFACT) and integration tools.

Strong knowledge of SQL and experience with relational databases.

Proficient in programming languages such as PowerShell, Python, Java, or Scala.

Experience with data pipeline tools (e.g., Cleo, Informatica, Talend, or Microsoft SSIS) and frameworks.

Excellent problem-solving skills and attention to detail.

Ability to work independently and collaboratively in a team environment and communicate effectively.

Experience with version control, debugging, and data validation techniques.

Strong analytical and problem-solving abilities.

Excellent communication skills, both written and verbal.

Detail-oriented with a strong focus on data accuracy and process improvement.

Benefits

Health Care, Dental, and Vision Insurance

Life, Short Term & Long Term Disability Insurance

401(k) with Company Contribution

Paid holidays and vacation

Professional development and growth opportunities

Collaborative and innovative work environment.

About CCM

At Consolidated Chassis Management, LLC, our mission is to deliver unparalleled intermodal equipment and fleet management solutions. We are dedicated to optimizing chassis and fleet operations through innovative, reliable, and efficient services. By prioritizing customer satisfaction and operational excellence, we aim to enhance the logistics and transportation industry, driving value for our customers and stakeholders.

J-18808-Ljbffr

Create a job alert for this search

Data Pipeline Engineer • Rockaway, NJ, US

Related jobs

Data Pipeline Engineer

VirtualVocations • Paterson, New Jersey, United States

Full-time

A company is looking for a Staff Data Pipeline Engineer.Key Responsibilities Design, build, and optimize high-performance data pipelines for business and customer-facing systems Implement and ma...Show more

Last updated: 30+ days ago • Promoted

Data Entry - 2

Robert Half • Whitehouse Station, NJ, US

Temporary

We are seeking a detail-oriented and organized Data Entry Clerk to join our team in New Jersey.The ideal candidate will be responsible for accurately inputting, verifying, and maintaining policy-re...Show more

Last updated: 8 days ago • Promoted

Databricks Engineer

VirtualVocations • Newark, New Jersey, United States

Full-time

A company is looking for a Databricks Engineer.Key Responsibilities Design, develop, and deploy cloud data solutions for risk, regulatory, finance, and compliance projects Provide indirect leade...Show more

Last updated: 30+ days ago • Promoted

Cloud Data Engineer

VirtualVocations • Paterson, New Jersey, United States

Full-time

A company is looking for a Cloud Data Engineer to join the Data Office Team in modernizing enterprise analytics.Key Responsibilities Design and develop data pipelines and ELT processes to integra...Show more

Last updated: 30+ days ago • Promoted

ETL Data Engineer

VirtualVocations • Elizabeth, New Jersey, United States

Full-time

A company is looking for a Data Engineer for a contract role.Key Responsibilities Develop Ab Initio jobs and workflows within the existing metadata-driven framework Review requirements and sourc...Show more

Last updated: 3 days ago • Promoted

Associate Data Engineer

VirtualVocations • Paterson, New Jersey, United States

Full-time

A company is looking for an Associate Data Engineer to assist with data pipeline management and development.Key Responsibilities Participate in data engineering projects primarily on AWS Collabo...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

VirtualVocations • Paterson, New Jersey, United States

Full-time

A company is looking for a Senior Data Engineer to oversee data integration and migration, develop data warehouses, and mentor junior engineers. Key Responsibilities Developing solutions to improv...Show more

Last updated: 30+ days ago • Promoted

Travel Physical Therapist

CompHealth Inc. • Dingmans Ferry, PA, US

Permanent

Physical Therapist for a travel job in Dingmans Ferry, Pennsylvania.Job Description & Requirements.Some locum assignments can be as short as a day, others, years. Some are far from home, others ...Show more

Last updated: 30+ days ago • Promoted

Senior Data Partner

VirtualVocations • Elizabeth, New Jersey, United States

Full-time

A company is looking for a Senior Data Partner who will play a crucial role in enhancing the data culture and assisting business users in maximizing the value of data. Key Responsibilities : Develo...Show more

Last updated: 1 day ago • Promoted

Data Engineer

VirtualVocations • Paterson, New Jersey, United States

Full-time

A company is looking for a Data Systems Engineer to audit, compare, validate, and assess infrastructure and application data in ServiceNow. Key Responsibilities Design, write, and optimize complex...Show more

Last updated: 30+ days ago • Promoted

Staff Data Engineer

VirtualVocations • Paterson, New Jersey, United States

Full-time

A company is looking for a Staff Data Engineer - Databricks SME (Remote).Key Responsibilities Develop and maintain ETL / ELT pipelines using Databricks notebooks and workflows Optimize Spark jobs ...Show more

Last updated: 30+ days ago • Promoted

Analytics Engineer II

VirtualVocations • Elizabeth, New Jersey, United States

Full-time

A company is looking for an Analytics Engineer II (REMOTE).Key Responsibilities Design and build data models and Power BI dashboards to solve business problems Collaborate with Agile teams to tr...Show more

Last updated: 30+ days ago • Promoted

Data Engineer / DBA

VirtualVocations • Newark, New Jersey, United States

Full-time

A company is looking for a Data Engineer / DBA to manage and optimize their data systems.Key Responsibilities Design and manage MySQL databases focusing on speed, scalability, and reliability Bu...Show more

Last updated: 30+ days ago • Promoted

Data Solutions Engineer

VirtualVocations • Elizabeth, New Jersey, United States

Full-time

A company is looking for a Data Solutions Engineer to support strategic data initiatives by designing and developing data pipelines and models. Key Responsibilities Architect and build new data pi...Show more

Last updated: 30+ days ago • Promoted

AWS Data Engineer

VirtualVocations • Paterson, New Jersey, United States

Full-time

A company is looking for an AWS Data Engineer to support cloud migration and optimize data queries.Key Responsibilities Review and rewrite existing SQL / Power BI queries for Amazon Redshift Optim...Show more

Last updated: 30+ days ago • Promoted

Sr. Data Engineer

Robert Half • Oldwick, NJ, US

Full-time

We are looking for an experienced Senior Data Engineer to join our team.This role involves designing and implementing scalable data solutions, optimizing data workflows, and driving innovation in d...Show more

Last updated: 2 days ago • Promoted

Azure Cloud Data Engineer

VirtualVocations • Newark, New Jersey, United States

Full-time

A company is looking for a Data Engineer for a fully remote contract opportunity.Key Responsibilities Manage data / cloud generalist responsibilities related to Oracle, DevOps, and Azure Cloud Bui...Show more

Last updated: 2 days ago • Promoted

Principal Data Engineer

VirtualVocations • Paterson, New Jersey, United States

Full-time

A company is looking for a Principal Data Engineer to join their Data Engineering team.Key Responsibilities Design, implement, and maintain data models, pipelines, and architecture for healthcare...Show more

Last updated: 30+ days ago • Promoted