Senior Cloud / Data Engineer

Job Description

Top Skills :

Data Engineering with Python programming

pache Spark and PySpark

WS

Snowflake

• Bachelor's degree in computer science or related discipline; advanced Studies / Degree preferred.
• 5-7 years of experience in data engineering with strong proficiency in Python programing language (Nice to have : Scala, Java).
• Strong proficiency in spark SQL, SQL, gremlin, GraphQL and database management (Snowflake cloud-base warehousing).
• Strong experience with data processing frameworks, DataFrames, Apache Spark, Graph DBs
• Experience with cloud platform AWS (EMR, EKS, Lambda).
• Experience writing statistical and / or optimization programs to develop models and algorithms.
• Programming languages may include-but are not limited to-Python, R
• Solid understanding of SDLC practices including development, testing, and release management.
• Experience with version control systems such as Git, BitBucket
• Experience with RESTful API design and development.
• Familiarity with PySpark for large-scale data processing and analysis.