Data Engineer

ForhyrePhoenix, AZ, US

30+ days ago

Job type

Full-time

Job description

Job Description

We are looking for a passionate certified Data Engineer. The successful candidate will turn data into information, information into insight and insight into business decisions.

Data analyst responsibilities include conducting full lifecycle analysis to include requirements, activities and design. Data analysts will develop analysis and reporting capabilities. They will also monitor performance and quality control plans to identify improvements.

Primary skillset : Python / Pyspark & Azure, ADF, SQL, SQL Server, Data Warehousing, ETL

Secondary : Databricks

Nice to have : Informatica / ETL.

Responsibilities

Design and develop ETL processes based on functional and non-functional requirements in python / pyspark within Azure platform
Understand the full end to end development activities from design to go live for ETL development and Azure platform

Recommend and execute improvements

Document component design for developers and for broader communication.

Understand and adopt an Agile (SCRUM like) software development mindset

Follow established processes / standards, business technology architecture for development, release management and deployment process

Execute and provide support during testing cycles and post-production deployment, engage in peer code reviews.

Elicit, analyze, interpret business and data requirements to develop complete business solutions, includes data models (entity relationship diagrams, dimensional data models), ETL and business rules, data life cycle management, governance, lineage, metadata and reporting elements.

Apply automation and innovation on new and on-going data platforms for those development projects aligned to business or organizational strategies.

Design, develop and implement reporting platforms (e.g. modeling, ETL, BI framework) and complex ETL frameworks that meet business requirements.

Deliver business or enterprise data deliverables (that adhere to enterprise frameworks) for various platforms / servers / applications / systems.

Requirements

Proven working experience as a data engineer

Bachelor degree or equivalent in Computer Science

Skilled in Python object-oriented programming

Skilled in AWS Compute such as EC2, Lambda, Beanstalk, or ECS

Skilled in AWS Database products such as Neptune, RDS, Redshift, or Aurora

Skilled in AWS Management and Governance suite of products such as CloudTrail, CloudWatch, or Systems Manager

Skilled in Amazon Web Services (AWS) offerings, development, and networking platforms

Skilled in SQL

Skilled in Jenkins

Skilled in JSON

Skilled in discovering patterns in large data sets with the use of relevant software such as Oracle Data Mining or Informatica

Skilled in cloud technologies and cloud computing

Experience using software and computer systems' architectural principles to integrate enterprise computer applications such as xMatters, AWS Application Integration, or WebSphere

Determining causes of operating errors and taking corrective action

Experience in the process of analyzing data to identify trends or relationships to inform conclusions about the data

Skilled in creating and managing databases with the use of relevant software such as MySQL, Hadoop, or MongoDB

Programming including coding, debugging, and using relevant programming languages

Communication including communicating in writing or verbally, copywriting, planning and distributing communication, etc.

Ability to frame ideas as systems and analyzing the inputs, outputs, and process

Experience helping an organization to plan and manage change in effort to meet strategic objectives

Adept at managing project plans, resources, and people to ensure successful project completion

Working with people with different functional expertise respectfully and cooperatively to work toward a common goal

Create a job alert for this search

Data Engineer • Phoenix, AZ, US

Related jobs

Promoted

Data Engineer

PrePassPhoenix, AZ, US

Full-time

PrePass® is North America's most trusted weigh station bypass and toll management platform.We’re transforming how the transportation industry operates—creating solutions that ke...Show moreLast updated: 1 day ago

Promoted
New!

Data Engineer (Scottsdale)

GlocommsScottsdale, AZ, US

Part-time

Data Engineer (Hybrid - Scottsdale, AZ or Relocation Required).We are seeking a highly skilled.This role is ideal for someone with strong experience in modern data engineering practices and a passi...Show moreLast updated: 13 hours ago

Promoted

Senior Data Engineer

KindsightScottsdale, AZ, US

Full-time

Kindsight builds technology that helps fundraisers make a difference.For decades, Kindsight has supported the education, healthcare, and nonprofit sectors with fundraising tools and the largest cha...Show moreLast updated: 13 days ago

Data Engineer

Purple DriveTEMPE, New Jersey, USA

Full-time

Data Engineer Need 8+ years of experienced resource with Data analytics skills including data science, AI, ML and data engineering .Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

MSR Technology GroupScottsdale, AZ, US

Permanent

FTE basis to lead design, development and implementation efforts on our client’s Enterprise Analytics platform which includes an MPP Enterprise Data Warehouse, cloud-based Data Lake and other...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

AchieveTempe, AZ, US

Full-time

Achieve is a leading digital personal finance company.We help everyday people move from struggling to thriving by providing innovative, personalized financial solutions. By leveraging proprietary da...Show moreLast updated: 9 days ago

Promoted
New!

ETL Big Data Engineer

Computer Task Group, IncPhoenix, AZ, US

Full-time

CTG is seeking to fill an ETL Big Data Engineer position for our client in Phoenix, AZ.Genesys, Oracle, PL / SQL, Apache Kafka, API development, Denodo, Google Cloud Platform (GCP).Design, develop, a...Show moreLast updated: 5 hours ago

Promoted

Big Data Engineer

iSoftTek Solutions IncPhoenix, AZ, US

Full-time

SoftTek Solutions Inc is seeking a talented Big Data Engineer to join our team.In this role, you will be responsible for developing and maintaining big data solutions and frameworks.You will work c...Show moreLast updated: 30+ days ago

Big Data Engineer / Data Engineer

CrackaJack Digital Solutions LLCPhoenix, AZ, US

Full-time

Quick Apply

In-Person round of interview mandatory.Big Data, Spark, Python, SQL, GCP is must.Need a hardcore, heavy hitting Data Engineer who is extremely skilled and is able to function independently and mana...Show moreLast updated: 30+ days ago

Big Data Engineer

OmegaHiresphoenix, AZ, US

Full-time

Quick Apply

Big Data Engineer Location : Phoenix, AZ (Onsite / Hybrid) Job Description : We are looking for an experienced Big Data Engineer skilled in Google Cloud Platform (GCP) and...Show moreLast updated: 9 days ago

Senior Data Engineer

Hudson ManpowerPhoenix, AZ, US

Full-time

For over half a decade, Hudson Manpower has been a trusted partner in delivering specialized talent and technology solutions across IT, Energy, and Engineering industries worldwide.We work closely ...Show moreLast updated: 2 days ago

Promoted

Data Engineer

FullbayPhoenix, AZ, US

Full-time

Fullbay is a leading SaaS organization dedicated to providing exceptional products / services to our clients.We are passionate about growth, innovation, and delivering top-notch customer experiences....Show moreLast updated: 30+ days ago

data engineer

Purple DrivePHOENIX, Arizona, USA

Full-time

GCP Cloud Data Engineer Design, develop, and maintain Big Data solutions using Hadoop ecosystem tools and frameworks.Leverage advanced Java programming concept...Show moreLast updated: 30+ days ago

Promoted
New!

Data Engineer

GlocommsScottsdale, AZ, United States

Full-time

Data Engineer

Hudson ManpowerPhoenix, AZ, US

Temporary

Location : PHX, AZ (HYBRID) (Local only).We are seeking a skilled and motivated Data Engineer to join our team.The ideal candidate will be responsible for designing, building, and maintaining scalab...Show moreLast updated: 1 day ago

Promoted

Sr. Data Engineer

ValenzPhoenix, AZ, US

Full-time

Vālenz® Health is the platform to simplify healthcare – the destination for employers, payers, providers and members to reduce costs, improve quality, and elevate the healthcare exp...Show moreLast updated: 5 days ago

Promoted

Data Engineer - Azure

Savas Management Center LLCScottsdale, AZ, US

Full-time

Location : Scottsdale, AZ (Hybrid 3 days Onsite), $100K to $150K, must be authorized to work in USA, no visa sponsorship available. Savas Software is a leading provider of transdisciplinary pain mana...Show moreLast updated: 5 days ago

Data Engineer - W2

Stellent IT LLCPhoenix, AZ, United States

Temporary

Quick Apply

Job Title : Data Engineer Location : PHX, AZ (HYBRID) (Local only) Show moreLast updated: 2 days ago