Junior Agentic AI Engineer

Overview

DigiCZE is a leading digital transformation AI firm that supports multiple verticals : Finance, Healthcare, Retail and Manufacturing.

We're hiring for a dynamic Junior Agentic AI Engineer (Open-Source Spark Focus)

We are looking for an enthusiastic and driven Junior Agentic AI Engineer to join our team dedicated to advancing cutting-edge AI within the Apache Spark ecosystem . The ideal candidate has a foundational understanding of distributed systems, a passion for open-source development, and an eagerness to explore and implement agentic AI architectures (e.g., planning, tool use, memory) to enhance Spark\'s capabilities, particularly in automated data operations and optimization. This role is a unique opportunity to contribute directly to a globally used open-source project and work at the intersection of Big Data and next-generation AI.

Responsibilities

• Open Source Contribution : Develop, test, and submit high-quality code (primarily Python and / or Scala ) to the Apache Spark project, specifically focused on integrating or leveraging agentic AI principles.
• Agentic AI Implementation : Design and implement proof-of-concept AI agents that can interact with Spark APIs and configurations to autonomously manage or optimize data workflows (e.g., automatic query optimization, resource tuning, self-healing pipelines).
• Tool Integration : Integrate and maintain Large Language Models (LLMs) and related tools (e.g., LangChain, LlamaIndex) with Spark components, enabling AI agents to "reason" about data processing tasks.
• Testing and Validation : Write comprehensive unit and integration tests to ensure the stability and reliability of new features and contributions within the distributed Spark environment.
• Documentation : Create clear, concise documentation for new features and agent designs, both for internal use and for the open-source community.
• Collaboration : Work closely with senior engineers and the broader open-source community to align on development standards and future roadmaps.

Essential Qualifications

Desired (Bonus) Qualifications

Seniority level

Employment type

Job function

Industries

J-18808-Ljbffr