Big Data Developer

Hiring : W2 Candidates Only

Visa : Open to any visa type with valid work authorization in the USA

Key Responsibilities :

• Design and implement scalable data ingestion and transformation pipelines using PySpark or Scala Hadoop Hive and Dremio.
• Build and manage Kafka batch pipelines for reliable data streaming and integration.
• Work with on-prem Hadoop ecosystems (Cloudera Hortonworks MapR) or cloud-native big data platforms.
• Develop and maintain RESTful APIs using Python (FastAPI Flask or Django) to expose data and services.
• Collaborate with data scientists ML engineers and platform teams to ensure seamless data flow and system performance.
• Monitor troubleshoot and optimize production data pipelines and services.
• Ensure security scalability and reliability across all data engineering components.
• (Optional but valuable) Contribute to the design and deployment of AI-driven RAG systems for enterprise use cases.

Required Skills & Qualifications

Key Skills

CCTV,Computer Science,Corporate Marketing,E Learning,Arabic English Translation

Employment Type : Full Time

Experience : years

Vacancy : 1