A company is looking for a Big Data Engineer.
Key Responsibilities
Implement ETL pipelines and data transformation processes
Troubleshoot and resolve issues related to PySpark applications and workflows
Ensure compliance with data security and privacy regulations
Required Qualifications
Experience with big data processing and distributed computing systems like Spark
Strong programming skills in Python and SQL
Experience with big data technologies such as Hadoop, Hive, and Kafka
Understanding of data warehousing concepts and relational databases
Knowledge of CI / CD pipelines and DevOps practices
Big Data Engineer • Lincoln, Nebraska, United States