We are seeking a highly skilled Senior Test Automation & Data Engineer to join a high-impact Agile delivery squad working on complex data engineering and quality assurance projects within a large-scale Common Data Platform (CDP) initiative. The ideal candidate will have a strong background in automated testing frameworks, modern data engineering practices, and experience working with cloud technologies, especially AWS. The role involves developing robust test automation strategies and high-quality data pipelines to support regulatory functions with system-wide visibility.
Job Responsibilities :
- Actively participate in Agile ceremonies following Scaled Agile methodologies
- Design, build, and maintain automated test frameworks and reusable test components
- Coordinate and execute data quality assurance across ingestion, transformation, and delivery stages
- Lead the development of end-to-end automated testing strategies
- Design, develop, and maintain data pipelines using Spark, Airflow, and related tools
- Ensure traceability between requirements and test scenarios, tracking progress with quality metrics
- Provide mentorship on testing methods, automation techniques, and quality assurance best practices
- Implement data security and governance best practices
- Collaborate with cross-functional teams including data scientists, analysts, product managers, and stakeholders
- Monitor and troubleshoot data pipelines, implementing alerts and auto-remediation
- Continuously research, evaluate, and recommend modern data tools and frameworks
Required Skills :
Bachelor’s degree in Computer Science, Information Systems, or a related field7+ years of experience in test automation, data engineering, or software engineering2+ years of experience with modern data stacks (e.g., S3, Spark, Airflow, Lakehouse architectures)2+ years of experience with test automation tools (e.g., Great Expectations, Lambda Test, Selenium, Cucumber)Proficiency with SQL and data modeling conceptsExperience in designing and managing ETL and data pipelines for structured / semi-structured / unstructured dataStrong understanding of data governance, information security, and architecture principlesProficient in AWS services such as S3, EC2, Lambda, Data Pipeline, CloudWatch, etc.Excellent analytical, communication, and problem-solving skillsAbility to work independently and manage multiple tasks in a fast-paced environmentPreferred Skills :
Experience with Big Data ecosystemsFamiliarity with domain areas such as Supervision and Regulation functionsPrior experience building data pipelines using Spark on cloud platforms (e.g., AWS)Knowledge of CI / CD automation tools and DevOps best practicesExperience in coaching and mentoring technical teamsCertifications :
AWS certifications or related cloud / data engineering certifications are a plus
#J-18808-Ljbffr