Talent.com
Data Engineer - Pipelines & Analytics

Data Engineer - Pipelines & Analytics

Soni ResourcesConshohocken, PA, United States
3 days ago
Job type
  • Full-time
Job description

Soni's client is seeking a highly skilled Data Engineer to design, build, and maintain scalable, reliable data pipelines that power their analytics ecosystem. You will be responsible for ensuring the smooth integration of data from multiple transactional systems into the AWS-based data platform.

You'll work closely with application developers, data analysts, and business stakeholders to ensure high data quality, efficient processing, and timely availability of transactional and analytics-ready data.

Key Responsibilities :

Data Pipeline Development

  • Design, implement, and maintain ETL / ELT processes to ingest data from multiple transactional sources (PostgreSQL, DynamoDB, and others) into the data warehouse.
  • Transform and load curated datasets from the warehouse into data marts.
  • Optimize pipeline performance for large datasets and complex transformations.

Data Modeling & Transformation

  • Design and maintain efficient data models for both the warehouse and data marts to support analytics use cases.
  • Implement best practices for normalization, denormalization, and dimensional modeling.
  • Data Quality & Governance

  • Implement data validation, anomaly detection, and error-handling mechanisms.
  • Work with developers and analysts to implement and maintain security for data at rest.
  • Maintain data lineage and metadata documentation.
  • Platform & Infrastructure

  • Leverage AWS services (e.g., S3, Lambda, Glue, DMS, Step Functions, RDS, DynamoDB) to manage scalable and secure pipelines.
  • Work with DevOps to automate deployments and CI / CD for data workflows.
  • Maintain and support the different Data Platforms(operational and transactional) for optimum usage and performance
  • Responsible for ensuring the security of data and user information related to the various databases.
  • Collaboration & Support

  • Partner with analysts and BI teams to ensure data marts meet reporting and dashboard needs suck as actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
  • Collaborate with application teams to integrate new transactional sources into the pipeline.
  • Required Skills & Experience :

    Technical Skills

  • Strong SQL skills and experience with PostgreSQL and SQL Server .
  • Hands-on experience with AWS data services (S3, Glue, Lambda, DMS, Step Functions, RDS, DynamoDB, IAM).
  • Proficiency in ETL / ELT frameworks and scripting languages (Python, Bash).
  • Experience designing and maintaining data models for analytics (star schema, snowflake).
  • Professional Experience

  • 3+ years as a Data Engineer, ETL Developer, or related role.
  • Experience working with both structured, unstructured, and semi-structured data.
  • Proven track record of optimizing data processing performance and reliability.
  • Soft Skills

  • Strong analytical thinking and problem-solving abilities.
  • Excellent communication skills to work with both technical and non-technical stakeholders.
  • Ability to manage multiple priorities in a fast-paced environment.
  • Preferred Qualifications

  • Experience with dbt or similar transformation frameworks.
  • Familiarity with BI tools (Power BI, Tableau, Looker).
  • Experience with data governance tools and practices.
  • What Is Offered :

  • Competitive salary and benefits package.
  • Opportunities for professional growth.
  • Collaborative environment with a focus on data-driven innovation including AI / ML.
  • #SoniTech1

    Create a job alert for this search

    Data Engineer • Conshohocken, PA, United States

    Related jobs
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    RIT SolutionsMalvern, PA, United States
    Full-time
    Location : Malvern, PA, Scottsdale, AZ, Charlotte, NC.Responsibilities : Data Engineers will be data mining, writing code, and creating tables / environments in S3. Qualifications : Engineer required - S...Show moreLast updated: 7 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Diverse LynxMalvern, PA, United States
    Full-time
    Hands-on experience in Pyspark, EMR, Glue, IAM, Cloud formation.Experience on AWS S3, Python, Lambda, Redshift.Design and develop ETL pipelines using PySpark, AWS EMR, and AWS Glue for large-scale ...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ForhyrePhiladelphia, PA, US
    Full-time
    We are looking for a passionate certified Data Engineer.The successful candidate will turn data into information, information into insight and insight into business decisions.Data analyst responsib...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer (AWS, Azure, GCP)

    Lead Data Engineer (AWS, Azure, GCP)

    ZipRecruiterPhiladelphia, PA, United States
    Full-time
    Job DescriptionJob DescriptionCompany Description.CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology.At CapTech, w...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer, Python

    Senior Data Engineer, Python

    Capital OneWilmington, DE, US
    Full-time +1
    Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,. At Capital One, you'll be part of a big group of makers, ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    DCM INFOTECH LIMITEDWest Chester, PA, United States
    Full-time
    Dear all - Please submit all resumes with skill metrics as mentioned below, only TELECOM RESUMES , Look for someone who has worked with Telecommunication in past and has similar experience.Data Pip...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Diverse LynxMt Laurel, NJ, United States
    Full-time
    Senior Data Engineer with 12+ years of experience.Worked on ETL, Azure, Databricks, Informatica, Oracle and Business Reports. Excellent Communication Skills.Diverse Lynx LLC is an Equal Employment O...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer AWS Azure GCP

    Data Engineer AWS Azure GCP

    CapTech ConsultingPhiladelphia, PA, United States
    Full-time
    CapTech Data Engineering consultants enable clients to build and maintain advanced data systems that bring together data from disparate sources in order to enable decision-makers.We build pipelines...Show moreLast updated: 3 days ago
    • Promoted
    GCP Data Engineer - Manager

    GCP Data Engineer - Manager

    PwCPhiladelphia, PA, United States
    Full-time
    At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in tra...Show moreLast updated: 3 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Capital OneWilmington, DE, United States
    Full-time +1
    Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    TEEMAWilmington, DE, United States
    Full-time
    Be the owner of an ever-increasing multi-terabyte dataset and develop processes and software to process, maintain, and govern it. Lead the data engineering team by mentoring team members, reviewing ...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Soni ResourcesConshohocken, PA, United States
    Full-time
    Strategic Analytics team, which supports multiple business areas-including Marketing, Finance, and Underwriting-by delivering insights that drive informed decision-making.This role focuses on build...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer (PySpark / AWS)

    Data Engineer (PySpark / AWS)

    Purple DriveWilmington, DE, United States
    Full-time
    We are seeking a highly skilled.PySpark, ETL pipelines, and AWS services.The role requires hands-on experience in designing, developing, and maintaining large-scale data processing solutions, while...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer II

    Data Engineer II

    AmazonMalvern, PA, United States
    Full-time
    Offered Position : Data Engineer II.Job Location : Malvern, Pennsylvania.Design, develop, implement, test, document, and operate large-scale, high-volume, high-performance data structures for busines...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer (AWS, Azure, GCP)

    Lead Data Engineer (AWS, Azure, GCP)

    CapTech ConsultingPhiladelphia, PA, US
    Full-time
    CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do a...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    RIT Solutions, Inc.Wayne, PA, United States
    Full-time
    Location : Malvern, PA or Charlotte, NC or Phoenix, AZ (3 days onsite) - need to be onsite day one.Data Engineers will be data mining, writing code, and creating tables / environments in S3.SQL, Pytho...Show moreLast updated: 3 days ago
    • Promoted
    Sr Data Engineer

    Sr Data Engineer

    Omni InclusiveLansdale, PA, United States
    Full-time
    Design of data solutions on Databricks including delta lake, data warehouse, data marts and other data solutions to support the analytics needs of the organization. Apply best practices during desig...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Robert HalfWayne, PA, US
    Full-time
    We are looking for a skilled Data Engineer to join our team in Wayne, Pennsylvania.In this role, you will design, develop, and optimize data pipelines and platforms to support business operations a...Show moreLast updated: 24 days ago