Big Data Engineer

A company is looking for an Engineer, Big Data - Claims Data / Databricks - Remote.

Key Responsibilities

Collect, store, process, and analyze large sets of data while maintaining optimal solutions

Implement batch and real-time data ingestion / extraction processes between diverse source and target systems

Design and build scalable data solutions, ensuring high performance and reliability

Required Qualifications

3 years of experience in data handling and building ETLs from disparate data sources

Experience with stream-processing systems and Big Data tools like Spark and Hive

Familiarity with NoSQL databases and integration of data from multiple sources

Proficiency in programming languages such as Java, Scala, or Python

Strong background in database technologies and data governance