Talent.com
Data Engineer - AWS, Snowflake, Python
Data Engineer - AWS, Snowflake, PythonIntraEdge • Chandler, AZ
Data Engineer - AWS, Snowflake, Python

Data Engineer - AWS, Snowflake, Python

IntraEdge • Chandler, AZ
Hace más de 30 días
Tipo de contrato
  • A tiempo completo
Descripción del trabajo

Job Description

The Data Engineer will be responsible for designing, developing, and maintaining robust and scalable data pipelines and data solutions. This role requires strong expertise in cloud-based data platforms, particularly AWS services like Glue and Lambda, combined with proficiency in Python, PySpark, and Snowflake for data warehousing. The ideal candidate will ensure efficient data ingestion, transformation, and availability for analytics and reporting, contributing to data-driven decision-making.Key Responsibilities:
  • Design, build, and maintain scalable and efficient ETL/ELT pipelines using AWS Glue, AWS Lambda, and PySpark for data ingestion, transformation, and loading into Snowflake.
  • Develop and optimize data models within Snowflake, ensuring high performance and adherence to best practices for data warehousing.
  • Write, test, and deploy production-grade Python and PySpark code for data processing and manipulation.
  • Implement and manage data orchestration and scheduling using AWS services or other relevant tools.
  • Monitor data pipeline performance, troubleshoot issues, and implement optimizations for improved efficiency and reliability.
  • Ensure data quality, integrity, and security across all data solutions, adhering to compliance standards.
Required Skills & Qualifications:
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 5+ years of hands-on experience in data engineering or a similar role.
  • Strong proficiency in Python and PySpark for data manipulation and processing.
  • Extensive experience with AWS services, specifically AWS Glue and AWS Lambda, for building and managing data pipelines.
  • Solid understanding of SQL and experience with relational and NoSQL databases.
  • Familiarity with version control systems (e.g., Git).
Good to Have:
  • Experience with other AWS services such as S3, Redshift, Athena, Step Functions, Kinesis, CloudWatch.
  • Experience with IBM Datastage or CP4D
  • Knowledge of CI/CD pipelines and infrastructure-as-code tools (e.g., Terraform, CloudFormation).
  • Experience with data governance and security best practices.
  • Familiarity with real-time data processing concepts.
Job Requirements The Data Engineer will be responsible for designing, developing, and maintaining robust and scalable data pipelines and data solutions. This role requires strong expertise in cloud-based data platforms, particularly AWS services like Glue and Lambda, combined with proficiency in Python, PySpark, and Snowflake for data warehousing. The ideal candidate will ensure efficient data ingestion, transformation, and availability for analytics and reporting, contributing to data-driven decision-making.Key Responsibilities:
  • Design, build, and maintain scalable and efficient ETL/ELT pipelines using AWS Glue, AWS Lambda, and PySpark for data ingestion, transformation, and loading into Snowflake.
  • Develop and optimize data models within Snowflake, ensuring high performance and adherence to best practices for data warehousing.
  • Write, test, and deploy production-grade Python and PySpark code for data processing and manipulation.
  • Implement and manage data orchestration and scheduling using AWS services or other relevant tools.
  • Monitor data pipeline performance, troubleshoot issues, and implement optimizations for improved efficiency and reliability.
  • Ensure data quality, integrity, and security across all data solutions, adhering to compliance standards.
Required Skills & Qualifications:
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 5+ years of hands-on experience in data engineering or a similar role.
  • Strong proficiency in Python and PySpark for data manipulation and processing.
  • Extensive experience with AWS services, specifically AWS Glue and AWS Lambda, for building and managing data pipelines.
  • Solid understanding of SQL and experience with relational and NoSQL databases.
  • Familiarity with version control systems (e.g., Git).
Good to Have:
  • Experience with other AWS services such as S3, Redshift, Athena, Step Functions, Kinesis, CloudWatch.
  • Experience with IBM Datastage or CP4D
  • Knowledge of CI/CD pipelines and infrastructure-as-code tools (e.g., Terraform, CloudFormation).
  • Experience with data governance and security best practices.
  • Familiarity with real-time data processing concepts.
Crear una alerta de empleo para esta búsqueda

Data Engineer - AWS, Snowflake, Python • Chandler, AZ

Ofertas similares

GenAI Cloud Engineer

Purple DrivePhoenix, AZ, Arizona, USA
A tiempo completo

Calibri,sans-serif">Role Overview We are seeking a highly skilled GenAI Cloud Engineer with strong hand...Mostrar más

Data Engineer

Akaasa TechnologiesPhoenix, AZ, United States
A tiempo completo
Quick Apply

Job Title: Data Engineer (GCP / Telecom / Genesys Migration) Location: Phoenix, AZ (1st preference)or Walnut Creek, CA (Local candidates preferred, last round will be onsite ) Mostrar más

Data Platform Engineer - Remote

DriveTimeTempe, AZ, United States
Teletrabajo
A tiempo completo +1

What's Under the HoodDriveTime Family of Brands is the largest privately owned used car sales finance & servicing company in the nation.Headquartered in Tempe, Arizona and Dallas, Texas, we create ...Mostrar más

 • Oferta promocionada

Shift Leader (P1-1360001-3)

Panda Restaurant GroupMaricopa, AZ, United States
A tiempo completo

Our Panda Shift Leader associates are important leaders of our team and are responsible for bringing Panda's mission alive in our restaurants by supporting management in creating food with passion,...Mostrar más

 • Oferta promocionada

amazon warehouse associate $15+/ Hour (Sign on Bonus)!

AmazonMaricopa, AZ
A tiempo completo +1

Amazon warehouse associates hiring in your area.If you are looking for outstanding pay, flexible part-time, full-time and seasonal schedules, plus benefits for you and your family, the Amazon Logis...Mostrar más

 • Oferta promocionada

Remote Financial Planner - AI Trainer ($50-$60 per hour)

Data AnnotationParadise Valley, Arizona
Teletrabajo
A tiempo completo +1

DataAnnotation is committed to creating high-quality AI.Join our team to help train the next generation of AI while enjoying the flexibility of remote work and the freedom to set your own schedule....Mostrar más

 • Oferta promocionada

Online Survey Participant: Work Remote and Earn Up To $25 Per Survey

Earn HausParadise Valley, AZ, US
Teletrabajo
A tiempo completo +1

Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion.You will help influence brand decisions on se...Mostrar más

 • Oferta promocionada

Physician / Anesthesiology / Arizona / Permanent / Anesthesiology Physician

AMN HealthcareMaricopa, AZ, US
A tiempo completo +1

Job Description & Requirements Anesthesiology Physician StartDate: ASAP Available Shifts: Regular 10 Pay Rate: $376.This facility is seeking a Vascular Anesthesiology Physician for locum tenens sup...Mostrar más

 • Oferta promocionada

Data Engineer (GCP / Telecom / Genesys Migration)

Conch Technologies IncPhoenix, AZ, United States
Temporal
Quick Apply

Job Title: Data Engineer (GCP / Telecom / Genesys Migration) Location: Phoenix, AZ (Preferred) or Walnut Creek, CA (Hybrid Final round onsite)Mostrar más

Full Stack Engineer/Data Architect - Phoenix Arizona (Remote)

Sunrise SystemsPhoenix, Arizona, United States
Teletrabajo
A tiempo completo
Quick Apply

Full Stack Engineer/Data Architect.Mainly remote but will need to come into the office periodically for meetings.Full Stack Engineer/Data Architect.The Client is developing a centralized portal to ...Mostrar más

Staff Data Architect: Cloud-Native Data Pipelines Lead

Arizona State UniversityScottsdale, AZ, United States
A tiempo completo

A prominent educational institution in Scottsdale is seeking a Staff Data Architect to lead the development of robust data pipelines.You will play a key role in leveraging cloud technologies (AWS, ...Mostrar más

 • Oferta promocionada

Physician / Endocrinology / Arizona / Permanent / Endocrinology Physician

Enterprise Medical RecruitingMaricopa, AZ, US
A tiempo completo +1

Interviewing Endocrinologists to join a physician-owned and led multi-specialty group in Phoenix.The practice boasts more than 70 providers offering Primary Care, Endocrinology, Gastroenterology, C...Mostrar más

 • Oferta promocionada

Big Data Engineer

Vensoft IncPhoenix, AZ, United States
A tiempo completo
Quick Apply

Hi, Please share the resume at abhic@vensoft.Big Data Engineer Location: Phoenix, AZ (Onsite/Hybrid) Primary Skills <...Mostrar más

 • Nueva oferta

Remote Azure Data Architect / Engineer

Irvine Tech CorpPhoenix, AZ, United States
Teletrabajo
A tiempo completo

Job Title : Data Solutions ArchitectLocation : Remote or hybrid from Glendale, Anaheim, West Covina, Riverside, San Diego, Phoenix, Las Vegas, or UtahOverviewOur client is seeking a hands-on Data S...Mostrar más

 • Oferta promocionada

Data Engineer

ViasatTempe, Arizona, United States
A tiempo completo

At Viasat, we're on a mission to deliver connections with the capacity to change the world.For more than 35 years, Viasat has helped shape how consumers, businesses, governments and militaries arou...Mostrar más

 • Oferta promocionada

Senior Storage Engineer: Build Resilient Data Platforms

GustoScottsdale, AZ, United States
A tiempo completo

A leading tech company is seeking a Storage Infrastructure Engineer in Scottsdale, AZ, to design and maintain robust data storage platforms.Responsibilities include planning migrations, establishin...Mostrar más

 • Oferta promocionada

Snowflake Data Engineer (Remote)

NTT DATAPhoenix, AZ, United States
Teletrabajo
A tiempo completo

Develop Snowflake data pipelines for migration of data from one EDW to another EDW Design and implement datawarehouse models required to support the project requirements.Execute data migration scri...Mostrar más

 • Oferta promocionada

Senior Data Engineer, Predictive Modeling

CarvanaTempe, AZ
A tiempo completo
Quick Apply

At Carvana, we’re changing the way people buy and sell cars.With an ambitious vision and a fundamentally different approach designed to be fun, fast, and fair, Carvana became the fastest-growing au...Mostrar más