Senior Data Engineer-Alameda, California (Hybrid)

Senior Data Engineer

Location : Alameda, California (Hybrid)

Duration : 06 Months plus

Rate : DOE

US Citizens and Green cards Preferred. No 3rd party corp to corp

Job Description :

We are seeking an experienced Senior DevOps Engineer with a strong background in automating data engineering infrastructure. The ideal candidate will be proficient in orchestrating data workflows, including data ingestion, processing, and pipeline development, utilizing a range of tools like AWS Glue, S3, Redshift, Terraform, and GitHub. This role involves close collaboration with our data engineering and IT teams to ensure efficient, scalable, and reliable data operations.

Key Responsibilities :

• Design, implement, and maintain robust, scalable, and automated data engineering solutions.
• Develop and manage data pipelines using AWS services like Glue, S3, and Redshift.
• Utilize Terraform for infrastructure as code (IaC) to ensure consistent and reliable environment provisioning.
• Maintain and enhance CI / CD pipelines for data engineering applications, ensuring seamless integration and deployment.
• Collaborate with data engineers to understand data needs and implement solutions that meet these requirements.
• Develop scripts and tools in Python to automate various data engineering tasks.
• Manage source control using GitHub, including branching, merging, and version control.
• Ensure data security and compliance with industry standards and company policies.
• Monitor, troubleshoot, and optimize data systems for performance and efficiency.
• Stay updated with the latest trends and technologies in DevOps and data engineering.

Qualifications :