Talent.com
ETL Data Engineer
ETL Data EngineerIntraEdge • Detroit, MI, US
No longer accepting applications
ETL Data Engineer

ETL Data Engineer

IntraEdge • Detroit, MI, US
1 day ago
Job type
  • Full-time
Job description

Principal Technical Recruiter @ IntraEdge | Building Relationships, Assessing Candidates

The Data Engineer will be responsible for designing, developing, and maintaining robust and scalable data pipelines and data solutions. This role requires strong expertise in cloud-based data platforms, particularly AWS services like Glue and Lambda , combined with proficiency in Python, PySpark , and Snowflake for data warehousing . The ideal candidate will ensure efficient data ingestion, transformation, and availability for analytics and reporting, contributing to data-driven decision-making.

Key Responsibilities

  • Design, build, and maintain scalable and efficient ETL / ELT pipelines using AWS Glue, AWS Lambda, and PySpark for data ingestion, transformation, and loading into Snowflake.
  • Develop and optimize data models within Snowflake, ensuring high performance and adherence to best practices for data warehousing.
  • Write, test, and deploy production-grade Python and PySpark code for data processing and manipulation.
  • Implement and manage data orchestration and scheduling using AWS services or other relevant tools.
  • Monitor data pipeline performance, troubleshoot issues, and implement optimizations for improved efficiency and reliability.
  • Ensure data quality, integrity, and security across all data solutions, adhering to compliance standards.

Required Skills & Qualifications

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 5+ years of hands-on experience in data engineering or a similar role.
  • Strong proficiency in Python and PySpark for data manipulation and processing.
  • Extensive experience with AWS services, specifically AWS Glue and AWS Lambda, for building and managing data pipelines.
  • Solid understanding of SQL and experience with relational and NoSQL databases.
  • Familiarity with version control systems (e.g., Git).
  • Good to Have

  • Experience with other AWS services such as S3, Redshift, Athena, Step Functions, Kinesis, CloudWatch.
  • Experience with IBM Datastage or CP4D.
  • Knowledge of CI / CD pipelines and infrastructure-as-code tools (e.g., Terraform, CloudFormation).
  • Experience with data governance and security best practices.
  • Familiarity with real-time data processing concepts.
  • Employment Details

  • Seniority level : Mid-Senior level
  • Employment type : Contract
  • Job function : Information Technology
  • J-18808-Ljbffr

    Create a job alert for this search

    Data Engineer • Detroit, MI, US

    Related jobs
    Lead Software Engineer - Data Platform

    Lead Software Engineer - Data Platform

    Relativity • Detroit, MI, United States
    Full-time
    Join our team as we reimagine and modernize the core of Relativity's data architecture.You'll play a pivotal role in transforming the Document Domain - a foundational component of our platform-into...Show more
    Last updated: 30+ days ago • Promoted
    Data Protection Engineer, Sr.

    Data Protection Engineer, Sr.

    Old National Bank • Troy, MI, United States
    Full-time
    US-IL-Chicago | US-IN-Evansville | US-MN-Lake Elmo | US-MN-St Louis Park | US-IN-Indianapolis | US-KY-Louisville | US-WI-Milwaukee | US-WI-Madison | US-MI-Troy | US-TN-Nashville.Old National Bank h...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer

    AI Engineer

    OneStream Software • Birmingham, MI, United States
    Full-time
    Range applies to US candidates only) + Benefits / Variable Comp / Equity - Range may vary based on experience.Vision, Medical, Life, Dental, 401K. This role requires the candidate to work from one of th...Show more
    Last updated: 30+ days ago • Promoted
    Design Release Engineer

    Design Release Engineer

    Aptiv • Troy, MI, United States
    Full-time
    SHAPE THE FUTURE OF MOBILITY FROM DAY ONE.This position is part of our Signal & Power Solutions segment, Electrical Distribution Systems business group and is located in Troy, MI.We are seeking a D...Show more
    Last updated: 30+ days ago • Promoted
    Principal Software Engineer, Data

    Principal Software Engineer, Data

    Credit Acceptance • Southfield, MI, United States
    Full-time
    Credit Acceptance is proud to be an award-winning company with local and national workplace recognition in multiple categories! Our world-class culture is shaped by dedicated Team Members who share...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer, Data Platform

    Senior Software Engineer, Data Platform

    Credit Acceptance • Southfield, MI, United States
    Full-time
    Credit Acceptance is proud to be an award-winning company with local and national workplace recognition in multiple categories! Our world-class culture is shaped by dedicated Team Members who share...Show more
    Last updated: 19 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Integra Partners • Troy, MI, US
    Full-time
    Integra Partners is seeking an enthusiastic and motivated individual to join our data engineering team.As a Senior Data Engineer, you will play a key role in building and maintaining robust data pi...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer - Data Platform

    Senior Software Engineer - Data Platform

    Relativity • Detroit, MI, United States
    Full-time
    Join our team as we reimagine and modernize the core of Relativity's data architecture.You'll play a pivotal role in transforming the Document Data Model (DDM)-a foundational component of our platf...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer - BigData

    Senior Data Engineer - BigData

    Hays • windsor, on, ca
    Full-time
    Work with stakeholders to architect and develop data driven-solutions that support diverse data consumers across the organization. Drive the development and implementation of robust data models and ...Show more
    Last updated: 20 days ago • Promoted
    Databricks & Azure Data Platform Principal Engineer

    Databricks & Azure Data Platform Principal Engineer

    Axiom Software Solutions Limited • Warren, MI, US
    Full-time
    A senior technical expert responsible for designing, building, and optimizing data solutions using Databricks and Azure Data technologies. This principal engineer oversees the architecture, integrat...Show more
    Last updated: 30+ days ago • Promoted
    Data & AI Engineer

    Data & AI Engineer

    Reply • Detroit, MI, US
    Full-time
    Concept Reply is a leader in IoT solutions.We support and advise our customers in Automotive, Manufacturing, Smart Infrastructure and beyond in all aspects of Internet of Things (IoT) and Cloud Com...Show more
    Last updated: 3 days ago • Promoted
    Senior Software Engineer, Data

    Senior Software Engineer, Data

    Credit Acceptance • Southfield, MI, United States
    Full-time
    Credit Acceptance is proud to be an award-winning company with local and national workplace recognition in multiple categories! Our world-class culture is shaped by dedicated Team Members who share...Show more
    Last updated: 30+ days ago • Promoted
    Staff Software Engineer, Data

    Staff Software Engineer, Data

    Credit Acceptance • Southfield, MI, United States
    Full-time
    Credit Acceptance is proud to be an award-winning company with local and national workplace recognition in multiple categories! Our world-class culture is shaped by dedicated Team Members who share...Show more
    Last updated: 30+ days ago • Promoted
    Principal Software Engineer, Data Platform

    Principal Software Engineer, Data Platform

    Credit Acceptance • Southfield, MI, United States
    Full-time
    Credit Acceptance is proud to be an award-winning company with local and national workplace recognition in multiple categories! Our world-class culture is shaped by dedicated Team Members who share...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    TEKsystems • Dearborn, MI, United States
    Full-time
    UNITED STATES CITIZEN OR GC CANDIDATES ONLY • • • • •.The Finance Data Hub team plays a key role in how our client approaches data analytics across the enterprise. Positioned within the Data Platform gro...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer (Remote)

    Senior Data Engineer (Remote)

    Trevco Inc • Madison Heights, MI, US
    Remote
    Full-time
    ETL processes in a fully remote capacity.You’ll build pipelines that collect, transform, and centralize data from platforms like Amazon Seller Central, NetSuite, and PostgreSQL into a secure ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Contact Government Services, LLC • Detroit, MI, US
    Full-time
    Employment Type : Full-Time, Mid-level.Department : Business Intelligence.CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence pl...Show more
    Last updated: 4 days ago • Promoted
    Director, Data Lake and Integration

    Director, Data Lake and Integration

    Credit Acceptance • Southfield, MI, United States
    Full-time
    Credit Acceptance is proud to be an award-winning company with local and national workplace recognition in multiple categories! Our world-class culture is shaped by dedicated Team Members who share...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer - BigData - Hays

    Senior Data Engineer - BigData - Hays

    Hays • windsor, on, ca
    Full-time
    Work with stakeholders to architect and develop data driven-solutions that support diverse data consumers across the organization. Drive the development and implementation of robust data models and ...Show more
    Last updated: 20 days ago • Promoted
    Senior Data Engineer - BigData - windsor

    Senior Data Engineer - BigData - windsor

    Hays • windsor, on, ca
    Full-time
    Work with stakeholders to architect and develop data driven-solutions that support diverse data consumers across the organization. Drive the development and implementation of robust data models and ...Show more
    Last updated: 20 days ago • Promoted