Talent.com
IntraEdge
Data Engineer - AWS, Snowflake, PythonIntraEdge • Chandler, AZ
Data Engineer - AWS, Snowflake, Python

Data Engineer - AWS, Snowflake, Python

IntraEdge • Chandler, AZ
30+ days ago
Job type
  • Full-time
Job description

Job Description

The Data Engineer will be responsible for designing, developing, and maintaining robust and scalable data pipelines and data solutions. This role requires strong expertise in cloud-based data platforms, particularly AWS services like Glue and Lambda, combined with proficiency in Python, PySpark, and Snowflake for data warehousing. The ideal candidate will ensure efficient data ingestion, transformation, and availability for analytics and reporting, contributing to data-driven decision-making.Key Responsibilities:
  • Design, build, and maintain scalable and efficient ETL/ELT pipelines using AWS Glue, AWS Lambda, and PySpark for data ingestion, transformation, and loading into Snowflake.
  • Develop and optimize data models within Snowflake, ensuring high performance and adherence to best practices for data warehousing.
  • Write, test, and deploy production-grade Python and PySpark code for data processing and manipulation.
  • Implement and manage data orchestration and scheduling using AWS services or other relevant tools.
  • Monitor data pipeline performance, troubleshoot issues, and implement optimizations for improved efficiency and reliability.
  • Ensure data quality, integrity, and security across all data solutions, adhering to compliance standards.
Required Skills & Qualifications:
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 5+ years of hands-on experience in data engineering or a similar role.
  • Strong proficiency in Python and PySpark for data manipulation and processing.
  • Extensive experience with AWS services, specifically AWS Glue and AWS Lambda, for building and managing data pipelines.
  • Solid understanding of SQL and experience with relational and NoSQL databases.
  • Familiarity with version control systems (e.g., Git).
Good to Have:
  • Experience with other AWS services such as S3, Redshift, Athena, Step Functions, Kinesis, CloudWatch.
  • Experience with IBM Datastage or CP4D
  • Knowledge of CI/CD pipelines and infrastructure-as-code tools (e.g., Terraform, CloudFormation).
  • Experience with data governance and security best practices.
  • Familiarity with real-time data processing concepts.
Job Requirements The Data Engineer will be responsible for designing, developing, and maintaining robust and scalable data pipelines and data solutions. This role requires strong expertise in cloud-based data platforms, particularly AWS services like Glue and Lambda, combined with proficiency in Python, PySpark, and Snowflake for data warehousing. The ideal candidate will ensure efficient data ingestion, transformation, and availability for analytics and reporting, contributing to data-driven decision-making.Key Responsibilities:
  • Design, build, and maintain scalable and efficient ETL/ELT pipelines using AWS Glue, AWS Lambda, and PySpark for data ingestion, transformation, and loading into Snowflake.
  • Develop and optimize data models within Snowflake, ensuring high performance and adherence to best practices for data warehousing.
  • Write, test, and deploy production-grade Python and PySpark code for data processing and manipulation.
  • Implement and manage data orchestration and scheduling using AWS services or other relevant tools.
  • Monitor data pipeline performance, troubleshoot issues, and implement optimizations for improved efficiency and reliability.
  • Ensure data quality, integrity, and security across all data solutions, adhering to compliance standards.
Required Skills & Qualifications:
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 5+ years of hands-on experience in data engineering or a similar role.
  • Strong proficiency in Python and PySpark for data manipulation and processing.
  • Extensive experience with AWS services, specifically AWS Glue and AWS Lambda, for building and managing data pipelines.
  • Solid understanding of SQL and experience with relational and NoSQL databases.
  • Familiarity with version control systems (e.g., Git).
Good to Have:
  • Experience with other AWS services such as S3, Redshift, Athena, Step Functions, Kinesis, CloudWatch.
  • Experience with IBM Datastage or CP4D
  • Knowledge of CI/CD pipelines and infrastructure-as-code tools (e.g., Terraform, CloudFormation).
  • Experience with data governance and security best practices.
  • Familiarity with real-time data processing concepts.
Create a job alert for this search

Data Engineer - AWS, Snowflake, Python • Chandler, AZ

Similar jobs

Senior Software Engineer - Data Platform

CoinbasePhoenix, AZ, United States
Full-time

Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world.It’s a massive, ambitious opportunity that demands the best of us, ... Show more

 • Promoted

Azure Snowflake Architect - Lead Data Platform (Hybrid)

NucleusTeqPhoenix, AZ, United States
Full-time

A leading tech company is looking for a Snowflake Solutions Architect to design and implement an enterprise Snowflake Data Platform on Azure.The role involves architecting multi-zone data layers an... Show more

 • Promoted

Sr. AWS Data Architect

CognizantPhoenix, AZ, United States
Full-time

The ideal candidate should have expertise in Spark Optimization, AWS DevOps, AWS Glue Studio, AWS Glue ETL, AWS Glue Catalog, Amazon S3, and Apache Spark.This role involves optimizing data processe... Show more

 • Promoted

Senior Data & Analytics Architect

Davis Technology ManagementPhoenix, AZ, United States
Full-time

Davis Technology Management is seeking a senior-level Software Architect specialized in Data & Analytics to design and implement a modern enterprise analytics platform.This strategic role involves ... Show more

 • Promoted

Senior Principal Architect, AI & Cloud Platform Strategy

Teradata Corporation (SE)Phoenix, AZ, United States
Full-time

Teradata Corporation (SE) is looking for a Sr.Principal Architect at the Senior Director level in Phoenix, AZ.This role entails defining the technical direction for the Core Platform and leading in... Show more

 • Promoted

Senior Data Platform Engineer — Scalable Pipelines (Remote)

CoinbasePhoenix, AZ, United States
Remote
Full-time

A leading cryptocurrency exchange in Phoenix, Arizona, seeks a Software Engineer for its Data Platform team.The role involves designing and maintaining scalable data services and applications to fa... Show more

 • Promoted

Sr. Data Engineer – Azure

INSPYR SolutionsScottsdale, AZ, United States
Full-time +1

Work Requirements: US Citizen, GC Holders or Authorized to Work in US.If interested, please contact Margot Parsons at mparsons@inspyrsolutions.We are seeking a highly skilled and motivated Senior D... Show more

 • Promoted

Principal AI Solutions Engineer

Bausch + LombPhoenix, AZ, United States
Full-time

The Principal AI Solutions Engineer is a hands‑on individual contributor responsible for designing, building, and deploying production‑ready AI solutions, with a strong focus on AI agents that reas... Show more

 • Promoted

Sales Engineer

ZipRecruiterPhoenix, AZ, United States
Full-time

Sales Engineer/h2pPhoenix, AZ/ppWe offer a hybrid work environment.Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.Our Missi... Show more

 • Promoted

AI & Cloud Architecture Lead: GenAI, RAG, Deployments

Adept AI SolutionsPhoenix, AZ, United States
Full-time

Adept AI Solutions is seeking a talented AI Developer based in Phoenix, Arizona.The ideal candidate will have extensive experience in full stack Python development and AI technologies.You will be r... Show more

 • Promoted

Hybrid Cloud Software Engineer - Microservices & AWS

Siemens AGTempe, AZ, United States
Full-time

A leading technology company is seeking a Senior Software Engineer in Tempe, AZ.The role involves product definition, project management, and transforming existing products into modularized microse... Show more

 • Promoted

Senior Software Engineer II (TASER Data Science)

AxonScottsdale, AZ, United States
Full-time

Join Axon and be a Force for Good.At Axon, we’re on a mission to Protect Life.We’re explorers, pursuing society’s most critical safety and justice issues with our ecosystem of devices and cloud sof... Show more

 • Promoted

Senior Principal Data Scientist - Remote AI & Analytics Leader

RaytheonPhoenix, AZ, United States
Remote
Full-time

A leading defense contractor is seeking a Senior Principal Data Science Developer for a remote position.The ideal candidate has extensive experience with Python, SQL, and machine learning, and will... Show more

 • Promoted

Lead Cloud Platform Engineer - Azure & AI

Wolters KluwerPhoenix, AZ, United States
Full-time

Wolters Kluwer is seeking a Lead Product Software Engineer - Cloud Operations in Phoenix, Arizona.This role focuses on owning the cloud infrastructure and operations for AI products.Responsibilitie... Show more

 • Promoted

Sr Enterprise Cloud Architect – AWS Governance, Standards & FinOps

Western Governors UniversityPhoenix, AZ, United States
Full-time +1

Sr Enterprise Cloud Architect – AWS Governance, Standards & FinOps.Apply locations Salt Lake City, UT Phoenix, AZ time type Full time posted on Posted 6 Days Ago time left to apply End Date: Februa... Show more

 • Promoted

Senior Azure Data Engineer - Scalable Pipelines & Analytics

INSPYR SolutionsScottsdale, AZ, United States
Full-time

A technology solutions provider is looking for a Senior Data Engineer to lead the design and optimization of data solutions in a cloud-forward environment.This role requires expertise in Azure Data... Show more

 • Promoted

Senior AWS Mid-Market Architect: Cloud & AI Solutions

AccentureScottsdale, AZ, United States
Full-time

A leading consulting firm is seeking an experienced AWS Cloud Architect to design reusable Enterprise Cloud Architecture and AI solutions.In this role, you'll lead project delivery while providing ... Show more

 • Promoted

Senior Edge AI Software Engineer SaaS/Cloud

Microchip Technology IncChandler, AZ, United States
Full-time

A leading technology company in Chandler, Arizona is seeking an experienced software engineer to develop applications for their Edge AI Development platform.The ideal candidate will have strong sof... Show more

 • Promoted

AI Data Architect: Lakehouse & AI Pipelines Lead

InsightChandler, AZ, United States
Full-time

A technology solutions integrator is seeking an AI Data Architect to maintain and manage data lakehouse architecture.This role requires a strong background in data engineering, particularly with Da... Show more

 • Promoted

Remote-First Solutions Architect: Enterprise Data Platforms Lead

JobotPhoenix, AZ, United States
Remote
Full-time

Jobot is looking for a Solutions Architect in Phoenix, Arizona to optimize enterprise cloud data platforms.You will design and implement platforms across Snowflake, AWS, and Azure, lead migrations,... Show more