Data Engineer with Python Automation Lead

Job Description :

• Seeking a Senior Specialist with 7 to 11 years of experience in Python and data technologies including Flask Apache Spark Scala and Nginx to design and implement scalable data driven solutions.
• Develop and maintain high performance data processing applications using Apache Spark and Scala Build and deploy RESTful APIs and web services using Flask framework.
• Utilize Python extensively for data manipulation automation and integration tasks Configure and optimize Nginx as a reverse proxy and load balancer for web applications.
• Collaborate with cross functional teams to design scalable data architectures within the Python Data skill cluster.
• Ensure code quality performance and reliability through rigorous testing and best practices.
• Stay updated with the latest trends and advancements in data engineering and Python ecosystems.
• Lead the design and development of data processing pipelines leveraging Apache Spark and Scala.
• Architect and implement backend services and APIs using Flask to support data driven applications. Manage deployment and configuration of Nginx servers to ensure high availability and security Mentor junior developers and provide technical guidance in Python and related technologies.
• Work closely with data scientists analysts and product teams to translate requirements into technical solutions.
• Optimize existing data workflows for performance and scalability Participate in code reviews troubleshooting and resolving complex technical issues.

Key Skills

Continuous Integration,APIs,Automotive software,Test Cases,Electrical Engineering,Junit,Distributed Control Systems,Testng,Java,Test Automation,Programmable Logic Controllers,Selenium

Employment Type : Full Time

Experience : years

Vacancy : 1