Job Title - Data Engineer
Location - Chicago, IL Remote
Duration - 12+ months
Rate - DOE
U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor at this time.
JOB DESCRIPTIO N
- 5+ years of experience in a Data Engineer role, with a Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field.
- Very good knowledge in
SQL (7+ out of 10)PySpark
Databricks on Azure (7+ out of 10)(7+ out of 10)SparkSQL (7+ out of 10)Azure / ADLS (7+ out of 10)Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.Great numerical and analytical skillsData engineering certifications / Azure is a plusCreate and maintain optimal data pipeline architectureAnalyze and organize raw dataWrite pseudo codeCombine raw information from different sourcesExplore ways to enhance data quality and reliabilityWorking with stakeholders including data, design, product and executive teams and assisting them with data-related technical issuesIdentify, design, and implement internal process improvements : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.Experience supporting and working with cross-functional teams in a dynamic environment.Build processes supporting data transformation, data structures, metadata, dependency, and workload management