Sr. Data Engineer

Job Description

Job Description

We are looking for an experienced Senior Data Engineer to join our team. This role involves designing and implementing scalable data solutions, optimizing data workflows, and driving innovation in data architecture. The ideal candidate will possess strong leadership qualities and a passion for problem-solving in a fast-paced, cutting-edge environment.

Responsibilities :

• Develop high-performance data systems, including databases, APIs, and data integration pipelines, to support scalable solutions.
• Design and implement metadata-driven architectures and automate deployment processes using infrastructure-as-code principles.
• Promote best practices in software engineering, such as code reviews, testing, and continuous integration / delivery (CI / CD).
• Establish and maintain a robust data governance framework to ensure compliance and data integrity.
• Monitor processes and implement improvements, including query optimization, code refactoring, and efficiency enhancements.
• Leverage cloud platforms, particularly Azure and Databricks, to improve system architecture and scalability.
• Conduct data quality checks and build procedures to address and resolve data issues effectively.
• Create and maintain documentation for data architecture, standards, and best practices.
• Provide technical leadership to the team, guiding design discussions and fostering innovation in data infrastructure.
• Identify and implement opportunities for process optimization and automation to improve operational efficiency.
• Minimum of 7 years of experience in roles such as Data Engineer, Data Architect, or Database Developer.
• Proficiency in programming languages like Python, Scala, Java, or Rust, with hands-on experience.
• Extensive experience in Oracle database design, development, and data pipeline creation using tools like Apache Spark and Airflow.
• Expertise in API development, including REST and GraphQL, and data warehouse design using methodologies like Kimball or Inmon.
• Knowledge in NoSQL database design, preferably with MongoDB, and experience with message broker platforms such as RabbitMQ or Kafka.
• Strong familiarity with cloud-native technologies and services, particularly Azure and AWS.
• Working knowledge of CI / CD tools like Jenkins or Ansible and containerization platforms such as Docker or Kubernetes.
• Demonstrated ability to solve complex problems, innovate, and deliver results in data and analytics projects.