Talent.com
Data Engineer - WM

Data Engineer - WM

QodeColumbia, SC, United States
3 days ago
Job type
  • Full-time
Job description

Data Engineer - Wealth Management

About the Role

We are seeking a highly skilled Data Engineer to design, build, and optimize data pipelines and solutions on AWS. The ideal candidate will have strong expertise in Python, PySpark, AWS Glue, Lambda, and Redshift , with hands-on experience in building scalable and reliable data workflows that power analytics and business decisions.

Key Responsibilities

Design, develop, and maintain ETL / ELT pipelines using AWS Glue, PySpark, and Python .

Implement serverless data workflows using AWS Lambda for automation and event-driven processing.

Build and manage data models, tables, and schemas in Amazon Redshift , ensuring performance and scalability.

Optimize data pipelines for reliability, performance, and cost-effectiveness.

Collaborate with data scientists, analysts, and business teams to deliver clean, structured, and usable datasets.

Ensure compliance with data security, governance, and best practices within AWS cloud infrastructure.

Monitor, troubleshoot, and improve existing data solutions and workflows.

Required Skills & Qualifications

Strong programming skills in Python and PySpark .

Hands-on experience with AWS services including Glue, Lambda, Redshift, S3, and CloudWatch .

Experience building ETL pipelines and transforming large-scale structured and unstructured data.

Strong understanding of data warehousing concepts and performance tuning in Amazon Redshift .

Proficiency in SQL for complex data queries and transformations.

Familiarity with version control (Git) and CI / CD for data pipeline deployments.

Problem-solving skills with the ability to work in fast-paced environments.

Preferred Qualifications

Experience with orchestration tools (e.g., Airflow, Step Functions ) is a plus.

Knowledge of data governance, cataloging, and lineage tools within AWS.

Exposure to streaming frameworks (Kafka, Kinesis) is desirable.

Prior experience in agile development environments .

Education & Experience

Bachelor's or Master's degree in Computer Science, Information Systems, Data Engineering, or related field .

3+ years of professional experience as a Data Engineer or in a similar role.

Create a job alert for this search

Data Engineer • Columbia, SC, United States

Related jobs
  • Promoted
Data Engineer

Data Engineer

Infinite Computer SolutionsColumbia, SC, United States
Full-time
Design and implement robust, scalable ETL / ELT pipelines using GCP Dataflow, Dataproc, and BigQuery.Develop streaming data ingestion and real-time processing pipelines using Pub / Sub and Cloud Functi...Show moreLast updated: 3 days ago
  • Promoted
Data Engineer

Data Engineer

METAColumbia, SC, United States
Full-time
Meta), formerly known as Facebook Inc.When Facebook launched in 2004, it changed the way people connect.Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around t...Show moreLast updated: 3 days ago
  • Promoted
Data Engineer, Analytics

Data Engineer, Analytics

METAColumbia, SC, United States
Full-time
Meta), formerly known as Facebook Inc.When Facebook launched in 2004, it changed the way people connect.Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around t...Show moreLast updated: 30+ days ago
  • Promoted
Senior Data Engineer

Senior Data Engineer

InterSourcesColumbia, SC, United States
Full-time
Job Title : Senior Data Engineer.Location : Columbia, SC (Hybrid).Team, responsible for designing, developing, and implementing enterprise-scale data solutions. This position requires a strong foundat...Show moreLast updated: 3 days ago
  • Promoted
Senior Data Engineer

Senior Data Engineer

SHI GmbHColumbia, SC, United States
Full-time
Since 1989, SHI International Corp.We've grown every year since, and today we're proud to be a $15 billion global provider of IT solutions and services. Over 17,000 organizations worldwide rely on S...Show moreLast updated: 3 days ago
  • Promoted
GCP Data Engineer - Manager

GCP Data Engineer - Manager

PwCColumbia, SC, United States
Full-time
At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in tra...Show moreLast updated: 3 days ago
  • Promoted
Data Engineer (Analytics)

Data Engineer (Analytics)

METAColumbia, SC, United States
Full-time
Meta), formerly known as Facebook Inc.When Facebook launched in 2004, it changed the way people connect.Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around t...Show moreLast updated: 3 days ago
  • Promoted
GCP Data Engineer - Senior Manager

GCP Data Engineer - Senior Manager

PwCColumbia, SC, United States
Full-time
At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in tra...Show moreLast updated: 30+ days ago
  • Promoted
Snowflake Data Engineer - DBT

Snowflake Data Engineer - DBT

CapgeminiColumbia, SC, United States
Permanent
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by?a collaborative community of colleagues...Show moreLast updated: 3 days ago
  • Promoted
Data Engineer (Junior Level)

Data Engineer (Junior Level)

SynergisticITColumbia, SC, United States
Full-time
Since 2010 Synergisticit has helped Jobseekers get employed in the tech Job market by providing candidates the requisite skills, experience and technical competence to outperform at interviews and ...Show moreLast updated: 30+ days ago
  • Promoted
Data Integration Engineer

Data Integration Engineer

Eliassen GroupColumbia, SC, United States
Full-time +1
We are currently seeking a talented Data Integration Principal to join us as we develop our data driven, analytic focused and predictive products to help revolutionize the law enforcement sector.Th...Show moreLast updated: 2 days ago
  • Promoted
Data Engineer

Data Engineer

ShortList Recruitment LimitedColumbia, SC, United States
Full-time
ShortList is looking for a Data Engineer to underpin a new AI programme of work for a leading not-for-profit in Columbia, SC. The Data Engineer will work as part of a project team to improve the dat...Show moreLast updated: 3 days ago
  • Promoted
Sr Data Engineer (MFT - IBM Sterling)

Sr Data Engineer (MFT - IBM Sterling)

The Hertz CorporationColumbia, SC, United States
Full-time
The IBM Sterling Senior MFT Engineer will have expertise in Sterling B2B Integrator, Sterling File Gateway, Sterling Secure Proxy, Control Center and Connect Direct. This position requires an expert...Show moreLast updated: 30+ days ago
  • Promoted
Databricks Data Engineer - Manager - Consulting - Location Open

Databricks Data Engineer - Manager - Consulting - Location Open

EYColumbia, SC, United States
Full-time
At EY, we're all in to shape your future with confidence.We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.Join EY and help ...Show moreLast updated: 3 days ago
AWS Data Engineer

AWS Data Engineer

QodeSouth Carolina, SC, US
Full-time
Quick Apply
AWS Data Engineer (Spark, AWS, Glue).Location : Fort Mill SC (Hybrid).Work with development teams and other project leaders / stakeholders to prov...Show moreLast updated: 30+ days ago
  • Promoted
AI Data Engineer - Senior Manager

AI Data Engineer - Senior Manager

PwCColumbia, SC, United States
Full-time
At PwC, our people in business application consulting specialise in consulting services for a variety of business applications, helping clients optimise operational efficiency.These individuals ana...Show moreLast updated: 3 days ago
  • Promoted
Data Architect

Data Architect

Find Great People | FGPBlythewood, SC, US
Full-time
Our client in Blythewood, SC is looking to add a Data Architect onto their team! Be part of a high-performing team of 6 database engineers, collaborating with architects, developers, business analy...Show moreLast updated: 23 hours ago
  • Promoted
AI Data Engineer - Manager

AI Data Engineer - Manager

PwCColumbia, SC, United States
Full-time
At PwC, our people in business application consulting specialise in consulting services for a variety of business applications, helping clients optimise operational efficiency.These individuals ana...Show moreLast updated: 3 days ago