Senior Software Engineer - AI and LLMs

At Apiphani, we are a technology-enabled managed services company on a mission to revolutionize support for enterprise workloads. As a small but rapidly expanding organization, we offer abundant opportunities for growth and learning!

We are committed to fostering a diverse and inclusive work environment, as we believe that diversity of experience and thought fuels creativity and innovation. At Apiphani, we strive to create a sense of belonging where every employee feels respected, valued, and empowered.

Position : Senior Software Engineer - Agentic AI Platform

Join us in building the future of intelligent infrastructure automation through agentic AI. We are seeking a Senior Backend Engineer to design and construct the systems that drive Luumen, our AI-powered automation platform, utilized by enterprise IT and managed service providers worldwide.

This pivotal engineering role focuses on establishing the backend foundations for large-scale AI orchestration. You will engage with distributed systems merging traditional infrastructure automation with large language models (LLMs), retrieval-augmented generation (RAG), and intelligent agents.

Key Responsibilities :

• Design and implement backend services to enable intelligent agent workflows and autonomous infrastructure actions.
• Develop APIs and orchestration layers using Python and TypeScript, integrating LLMs, vector databases, and observability pipelines.
• Build scalable systems facilitating LLM-based reasoning, retrieval, and decision-making across cloud infrastructures.
• Integrate with AWS Bedrock and other LLM platforms to support multi-model capabilities.
• Develop data access and semantic search layers with vector databases (e.g., pgvector, Pinecone, Qdrant).
• Create robust monitoring, testing, and CI / CD systems ensuring the reliability and reproducibility of AI workflows.
• Collaborate closely with product and DevOps teams to design architecture diagrams, plan deployments, and monitor system health.
• Write clean, maintainable code with thorough documentation, prioritizing security and performance best practices.
• Participate in code reviews, design discussions, and iterative delivery cycles to enhance product velocity and quality.

Qualifications :

Bonus Points :

Why Join Apiphani?

You'll become part of a high-achieving, globally distributed team focused on transforming enterprise infrastructure management. Every feature you develop will have a direct impact on how engineers interact with intelligent systems in production settings. This is your chance to help architect a platform that intertwines infrastructure automation, AI, and agentic reasoning. Your technical decisions will shape the future of enterprise operations.

Base Salary : $120,000 - $160,000 USD

Company Benefits :