Data Engineer

ForhyreCarolina, NC, US

30+ days ago

Job type

Full-time

Job description

Job Description

We are looking for a passionate certified Data Engineer. The successful candidate will turn data into information, information into insight and insight into business decisions.

Data analyst responsibilities include conducting full lifecycle analysis to include requirements, activities and design. Data analysts will develop analysis and reporting capabilities. They will also monitor performance and quality control plans to identify improvements.

Primary skillset : Python / Pyspark & Azure, ADF, SQL, SQL Server, Data Warehousing, ETL

Secondary : Databricks

Nice to have : Informatica / ETL.

Responsibilities

Design and develop ETL processes based on functional and non-functional requirements in python / pyspark within Azure platform
Understand the full end to end development activities from design to go live for ETL development and Azure platform

Recommend and execute improvements

Document component design for developers and for broader communication.

Understand and adopt an Agile (SCRUM like) software development mindset

Follow established processes / standards, business technology architecture for development, release management and deployment process

Execute and provide support during testing cycles and post-production deployment, engage in peer code reviews.

Elicit, analyze, interpret business and data requirements to develop complete business solutions, includes data models (entity relationship diagrams, dimensional data models), ETL and business rules, data life cycle management, governance, lineage, metadata and reporting elements.

Apply automation and innovation on new and on-going data platforms for those development projects aligned to business or organizational strategies.

Design, develop and implement reporting platforms (e.g. modeling, ETL, BI framework) and complex ETL frameworks that meet business requirements.

Deliver business or enterprise data deliverables (that adhere to enterprise frameworks) for various platforms / servers / applications / systems.

Requirements

Proven working experience as a data engineer

Bachelor degree or equivalent in Computer Science

Skilled in Python object-oriented programming

Skilled in AWS Compute such as EC2, Lambda, Beanstalk, or ECS

Skilled in AWS Database products such as Neptune, RDS, Redshift, or Aurora

Skilled in AWS Management and Governance suite of products such as CloudTrail, CloudWatch, or Systems Manager

Skilled in Amazon Web Services (AWS) offerings, development, and networking platforms

Skilled in SQL

Skilled in Jenkins

Skilled in JSON

Skilled in discovering patterns in large data sets with the use of relevant software such as Oracle Data Mining or Informatica

Skilled in cloud technologies and cloud computing

Experience using software and computer systems' architectural principles to integrate enterprise computer applications such as xMatters, AWS Application Integration, or WebSphere

Determining causes of operating errors and taking corrective action

Experience in the process of analyzing data to identify trends or relationships to inform conclusions about the data

Skilled in creating and managing databases with the use of relevant software such as MySQL, Hadoop, or MongoDB

Programming including coding, debugging, and using relevant programming languages

Communication including communicating in writing or verbally, copywriting, planning and distributing communication, etc.

Ability to frame ideas as systems and analyzing the inputs, outputs, and process

Experience helping an organization to plan and manage change in effort to meet strategic objectives

Adept at managing project plans, resources, and people to ensure successful project completion

Working with people with different functional expertise respectfully and cooperatively to work toward a common goal

Create a job alert for this search

Data Engineer • Carolina, NC, US

Related jobs

Promoted

Data Engineer

Strata Solar Services LLCDurham, NC, US

Full-time

Essential Duties and Responsibilities : .Design, build, and maintain scalable ETL / ELT pipelines to process large datasets efficiently. Leverage Python for scripting and orchestration tasks.Develop and...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

DATASOFT TECHNOLOGIESDurham, NC, United States

Temporary

Duration : 12 Months Contract (possibility of extension).Pay rate : Hourly, depending on experience.Develop and maintain data models in Synapse to support reporting and analytics.Develop ETL solution...Show moreLast updated: 4 days ago

Promoted

Junior Data Engineer

SynergisticITDurham, NC, United States

Full-time

SYNERGISTICIT is aware that the Job Market is Challenging because of Tech Layoffs due to which The Job market is flooded with hundreds and thousands of laid off Jobseekers who are competing with ex...Show moreLast updated: 4 days ago

Promoted

GCP Data Engineer - Senior Manager

PwCGreensboro, NC, United States

Full-time

At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in tra...Show moreLast updated: 30+ days ago

Promoted

Cloud Data Engineer

Piper CompaniesDurham, NC, United States

Full-time

Financial Services company located in.Responsibilities of the Cloud Data Engineer.Developing, designing, implementing, and managing the Data Lake. Manage canary releases and blue-green deployments.C...Show moreLast updated: 4 days ago

Promoted

Sr Data Engineer

Banc of CaliforniaDurham, NC, United States

Full-time

BANC OF CALIFORNIA AND YOUR CAREER.NYSE : BANC) is a bank holding company headquartered in Los Angeles with one wholly-owned banking subsidiary, Banc of California (the "bank").Banc of California is...Show moreLast updated: 4 days ago

Promoted

GCP Data Engineer - Manager

PwCGreensboro, NC, United States

Full-time

Promoted

Data Engineer

InterSourcesDurham, NC, United States

Full-time

The Expertise and Skills You Bring.Bachelor's Degree or equivalent in a technology related field (e.Computer Science, Engineering, etc. Data engineering, data warehousing and analytics technologies....Show moreLast updated: 4 days ago

Promoted

Sr Data Engineer

Diverse LynxApex, NC, United States

Full-time

ADF, DataBricks, PYSpark, PYTHON (Sr Data Engineer).Diverse Lynx LLC is an Equal Employment Opportunity employer.All qualified applicants will receive due consideration for employment without any d...Show moreLast updated: 30+ days ago

Promoted

Data Cleansing. Engineer

CoolsoftDurham, NC, United States

Full-time

Skills required Oracle DB, PL / SQL, Data Migrations, Data Cleansing.Job Description Engineer : Oracle DB, PL / SQL, Data Migrations, Data Cleansing. Submission Deadline : 10 / 02 / 2025.Either Webcam Intervi...Show moreLast updated: 4 days ago

Promoted
New!

Cloud Engineer / Durham, NC,8+ Months Contract

Staffing the UniverseDurham, NC, United States

Temporary

Dynamic work schedule - This is five days on-site a month in the same week then the remainder of the month is working from home. If your candidate is not open to this please tell them they will not ...Show moreLast updated: 7 hours ago

C&Q Engineer

Stark Pharma Solutions IncNC, United States

Full-time

Quick Apply

Job Title : C&Q Engineer Location : Raleigh, NC (Onsite) Experience : 5...Show moreLast updated: 30+ days ago

Promoted

Azure Data Engineer - Durham, NC (W2 candidates)

HYR Global Source IncDurham, NC, US

Full-time

Job Title : Azure Data Engineer Location : Durham, NC (3 Days Hybrid) Job Type : Full-Time Job Description : We are seeking a highly skilled Azure Data Engineer to join our data engineering team in Min...Show moreLast updated: 21 days ago

Promoted

AI Data Engineer - Senior Associate

PwCGreensboro, NC, United States

Full-time

At PwC, our people in business application consulting specialise in consulting services for a variety of business applications, helping clients optimise operational efficiency.These individuals ana...Show moreLast updated: 4 days ago

Senior Data Engineer (Hybrid)

Serigor Inc.Durham, NC, NC, US

Full-time

Quick Apply

Senior Data Engineer (Hybrid) Location : Durham, NC Duration : 12 Month Job Description : The client is seeking a Senior Data Engineer to lead the development and optimization of end-to-end solutions ...Show moreLast updated: 9 days ago

Data Engineer

My3TechDurham, NC, United States

Full-time

Quick Apply

Title : Data Engineer Location : Research Triangle Park, Durham NC 27709 Responsibilities and Duties : <...Show moreLast updated: 8 days ago

Promoted

Data Engineer - Oracle / PL-SQL

CrescensDurham, NC, United States

Full-time

Title : Data Engineer - Oracle / PL-SQL.The Client requires the assistance of contract resources to serve as Data Engineers. The primary purpose of these positions is to analyze, map, build, test, and ...Show moreLast updated: 4 days ago

Promoted

AI Data Developer

CREODurham, NC, US

Full-time

The Data Developer designs and constructs sophisticated data architectures to support advanced AI and analytics solutions, ensuring effective integration, storage, management, and utilization of st...Show moreLast updated: 30+ days ago