Software Development Engineer

A company is looking for a Software Development Engineer (Python / Pyspark).

Key Responsibilities

Support and enhance batch data processing and batch letters using Python and PySpark

Research, troubleshoot, and fix issues in existing data pipelines and Spark jobs

Develop and maintain new ETL / ELT data pipelines to support business enhancements

Required Qualifications

6+ years of experience in Python development

Strong hands-on experience with PySpark and Apache Spark

Experience in ETL / ELT integration using Python

Proficiency in AWS services including EMR, Redshift, S3, and EC2

Strong knowledge of SQL for data transformation and analytics