Certified Cloud Engineer

Key Responsibilities :

• Collaborate with data engineering and development teams to design, develop, test, and maintain robust and scalable ELT / ETL pipelines using SQL scripts, Redshift stored procedures, and other AWS tools and services.
• Collaborate with our engineering and data teams to understand business requirements and data integration needs, translate them into effective data solutions, that yield top-quality outcomes.
• Architect, implement, and manage end-to-end data pipelines, ensuring data accuracy, reliability, data quality, performance, and timeliness.
• Employ AWS DMS and other services for efficient data ingestion from on-premises databases into Redshift.
• Design and implement ETL processes, encompassing Changed Data Capture (CDC) and Slow Changing Dimension (SCD) logics, to seamlessly integrating data from diverse source systems.
• Provide expertise in Redshift database optimization, performance tuning, and query optimization.
• Design and implement efficient orchestration workflows using Airflow, ensuring seamless coordination of complex ETL processes.
• Integrate Redshift with other AWS services, such as AWS DMS, AWS Glue, AWS Lambda, Amazon S3, Airflow, and more, to build end-to-end data pipelines.
• Perform data profiling and analysis to troubleshoot data-related challenges / issues and build solutions to address those concerns.
• Proactively identify opportunities to automate tasks and develop reusable frameworks.
• Work closely with version control team to maintain a well-organized and documented repository of codes, scripts, and configurations using Git.
• Provide technical guidance and mentorship to fellow developers, sharing insights into best practices, tips, and techniques for optimizing Redshift-based data solutions.

Qualifications and Skills :

Top Skills (3) & Years of Experience :

Nice to Have :

Interview Process :

Duration :

Onsite or Remote?

Additional Details :

Access to FTI (Federal Tax Information)?

Security Required : Yes