DATA ENGINEER

Job Summary :

The Senior Data Engineer will be responsible for designing, building, and maintaining robust data pipelines and architectures on AWS to support scalable data processing, storage, and analytics. The ideal candidate will possess deep expertise in AWS services, PySpark, and data modeling, with proven experience in developing data-driven solutions that support business intelligence and analytics initiatives.

Key Responsibilities :

• Design, develop, and optimize data ingestion and transformation pipelines using AWS Glue , PySpark , and other AWS-native services.
• Build and manage data lake and data warehouse solutions using Amazon S3 and Amazon Redshift .
• Develop and maintain data models, schemas, and ETL frameworks to ensure efficient data organization and accessibility.
• Collaborate with data analysts, scientists, and business teams to understand data requirements and deliver reliable solutions.
• Implement data quality checks, validation frameworks, and automation to ensure data accuracy and reliability.
• Integrate version control and CI / CD practices using Git and related tools.
• Monitor and optimize performance, scalability, and cost efficiency of data pipelines in AWS.
• Ensure compliance with data governance, security, and best practices in data handling and storage.

Required Skills and Qualifications :

Good to Have :

Soft Skills :