Talent.com
No longer accepting applications
Data Engineer (PySpark / AWS)

Data Engineer (PySpark / AWS)

Purple DriveWilmington, DE, United States
9 days ago
Job type
  • Full-time
Job description

Title : Data Engineer (PySpark / AWS)

Location : Wilmington, DE - Onsite

Type : Contract

Job Overview

We are seeking a highly skilled Data Engineer with strong expertise in PySpark, ETL pipelines, and AWS services to join our onsite team in Wilmington, DE. The role requires hands-on experience in designing, developing, and maintaining large-scale data processing solutions, while collaborating with cross-functional teams to deliver high-quality, scalable data systems.

Key Responsibilities

  • Design, build, and optimize ETL and streaming data pipelines using PySpark .
  • Leverage AWS services ( SQS, Lambda, S3, RDS ) to implement scalable and secure data solutions.
  • Develop and maintain clean, efficient, and reusable code in Python and other programming languages.
  • Collaborate with business and technical stakeholders to translate requirements into data engineering solutions.
  • Ensure data integrity, governance, and compliance across all platforms.
  • Conduct performance tuning, troubleshooting, and optimization of data pipelines.
  • Document processes, workflows, and best practices for continuous improvement.

Must-Have Skills

  • Extensive hands-on experience with PySpark and ETL / Streaming Pipelines .
  • Strong knowledge of AWS services (SQS, Lambda, S3, RDS).
  • Advanced proficiency in at least one programming language ( Python preferred ).
  • Preferred Skills

  • Proficiency with Alteryx, Tableau, ThoughtSpot, and SQL .
  • Deep understanding of advanced AWS concepts ( Glue, EMR ).
  • Practical cloud-native development experience .
  • Good to Have

  • Experience with Shell scripting and Unix systems .
  • Proficiency in Terraform for infrastructure as code.
  • Familiarity with Large Language Models (LLM) , including practical use case development with OpenAI Azure .
  • Experience & Qualifications

  • 5+ years of applied experience in data engineering or software development .
  • Formal training or certification in software engineering concepts .
  • Bachelor's or Master's degree in Computer Science, Computer Engineering, Mathematics , or a related technical field.
  • Create a job alert for this search

    Data Engineer Aws • Wilmington, DE, United States

    Related jobs
    • Promoted
    Data Engineer II

    Data Engineer II

    VirtualVocationsNewark, Delaware, United States
    Full-time
    A company is looking for a Data Engineer II.Key Responsibilities Designing, developing, and maintaining software applications that process large volumes of data Collaborating with cross-function...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    VirtualVocationsNewark, Delaware, United States
    Full-time
    A company is looking for a GCP Data Engineer to design and implement scalable data pipelines on Google Cloud Platform.Key Responsibilities Build and maintain streaming and batch data pipelines us...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Infrastructure Engineer

    Senior Data Infrastructure Engineer

    VirtualVocationsNewark, Delaware, United States
    Full-time
    A company is looking for a Senior Data Infrastructure Engineer to enhance its core data infrastructure and support advanced applications. Key Responsibilities Own and maintain data pipeline archit...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocationsNewark, Delaware, United States
    Full-time
    A company is looking for a Lead Data Engineer to architect and scale their data platform and analytics stack.Key Responsibilities Refine and evolve the AWS data platform to enhance analytical cap...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    VirtualVocationsNewark, Delaware, United States
    Full-time
    A company is looking for a Senior Data Platform Engineer.Key Responsibilities Enhance and improve the performance and reliability of existing Data Platform Services Design and build self-service...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Databricks Engineer

    Senior Databricks Engineer

    VirtualVocationsNewark, Delaware, United States
    Full-time
    A company is looking for a Senior Databricks Engineer / Cloud Data Engineer (Remote).Key Responsibilities Design, build, and optimize data pipelines using Databricks, Apache Spark, and Delta Lake...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VirtualVocationsNewark, Delaware, United States
    Full-time
    A company is looking for a Data Engineer to design, construct, and maintain scalable data management systems.Key Responsibilities Develop and maintain data architectures, including databases and ...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Data Engineer

    Staff Data Engineer

    VirtualVocationsNewark, Delaware, United States
    Full-time
    A company is looking for a Staff Data Engineer - Hybrid.Key Responsibilities Design, build, and maintain scalable data models and ETL / ELT pipelines for enterprise analytics and reporting Develop...Show moreLast updated: 30+ days ago
    • Promoted
    Data Science Engineer

    Data Science Engineer

    VirtualVocationsNewark, Delaware, United States
    Full-time
    A company is looking for a Data Science Engineer to implement data science and machine learning solutions.Key Responsibilities Collaborate with teams to understand business requirements and impro...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer I

    Data Engineer I

    VirtualVocationsNewark, Delaware, United States
    Full-time
    A company is looking for a Data Engineer I to develop and operationalize data pipelines for improved health outcomes.Key Responsibilities Design and implement standardized data management procedu...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Insights Engineer

    Senior Data Insights Engineer

    VirtualVocationsNewark, Delaware, United States
    Full-time
    A company is looking for a Senior Data Insights Engineer.Key Responsibilities Design, develop, and maintain scalable data models for reporting and analytics Develop and maintain dashboards using...Show moreLast updated: 16 hours ago
    • Promoted
    Senior Software Engineer - Data Platform

    Senior Software Engineer - Data Platform

    RelativityWilmington, DE, United States
    Full-time
    Join our team as we reimagine and modernize the core of Relativity's data architecture.You'll play a pivotal role in transforming the Document Data Model (DDM)-a foundational component of our platf...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer III

    Data Engineer III

    VirtualVocationsNewark, Delaware, United States
    Full-time
    A company is looking for a Data Engineer III to design, develop, and maintain data pipelines and systems.Key Responsibilities Design, develop, and maintain data pipelines and infrastructure using...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocationsNewark, Delaware, United States
    Full-time
    A company is looking for a Senior Data Engineer to lead the development of scalable data processing and enrichment pipelines. Key Responsibilities Design and implement scalable AI-powered data pro...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer (AI / ML)

    Data Engineer (AI / ML)

    VirtualVocationsNewark, Delaware, United States
    Full-time
    A company is looking for a Data Engineer (AI / ML) 2 to support the Generative AI for Forms SBIR project by designing and maintaining data infrastructure for AI applications.Key Responsibilities De...Show moreLast updated: 2 days ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    VirtualVocationsNewark, Delaware, United States
    Full-time
    A company is looking for a Backend Engineer, Data Platform.Key Responsibilities Build and expand data pipelines and products for various product lines and internal business intelligence Collabor...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    VirtualVocationsNewark, Delaware, United States
    Full-time
    A company is looking for an Azure Developer-Data Engineer.Key Responsibilities Design, develop, and deploy scalable Azure-based data ingestion, transformation, and curation pipelines Implement d...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Analytics Engineer

    Senior Data Analytics Engineer

    VirtualVocationsNewark, Delaware, United States
    Full-time
    A company is looking for a Senior Data Analytics Engineer.Key Responsibilities Design and implement advanced data models and analytics solutions Develop and optimize scalable data pipelines and ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer Contractor

    Data Engineer Contractor

    VirtualVocationsNewark, Delaware, United States
    Full-time
    A company is looking for an Independent Contractor, Data Engineer, Business Operations.Key Responsibilities Build and maintain a scalable Databricks lakehouse for business operations data Design...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Lead Data and ML Engineer

    Lead Data and ML Engineer

    VirtualVocationsNewark, Delaware, United States
    Full-time
    A company is looking for a Lead Data / ML Engineer to build scalable, cost-efficient systems for transforming ad data into reliable intelligence. Key Responsibilities Design, build, and maintain sca...Show moreLast updated: 22 hours ago