Data Engineer Job Description
Job Responsibilities :
- Design construct install test and maintain highly scalable data management systems
- Develop and implement data ingestion processes for both batch and real-time streaming data
- Collaborate with cross-functional teams to gather and understand data requirements
- Perform data cleansing transformation and validation to ensure data accuracy and integrity
- Create and maintain data pipelines and workflows to support data analytics and reporting
- Troubleshoot data-related issues and provide solutions in a timely manner
- Stay up-to-date with the latest trends and technologies in data engineering
Essential Qualifications :
Bachelors degree in Computer Science Engineering or a related fieldProven experience in designing and implementing data solutionsProficiency in programming languages such as Python Java or ScalaStrong SQL skills for data querying and manipulationExperience working with relational and non-relational databasesDesired Experience :
Minimum of 1 year of experience in data engineering or a related roleExperience with big data technologies such as Hadoop Spark or KafkaKnowledge of data warehousing concepts and ETL processesFamiliarity with cloud platforms like AWS GCP or AzureSalary & Benefits :
Salary Range : $98000 - $108000 per yearCompany-provided health insurance401(k) retirement plan with employer matchingPaid time off and sick leaveOpportunities for career growth and professional developmentKey Skills
Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala
Employment Type : Full Time
Experience : years
Vacancy : 1