Talent.com
Senior Software Engineer (AI / LLMs)

Senior Software Engineer (AI / LLMs)

apiphaniBoston, MA, US
7 days ago
Job type
  • Full-time
Job description

Job Description

Job Description

Apiphani is a technology-enabled managed services company dedicated to redefining what it means to support mission-critical enterprise workloads. We're a small but rapidly growing company, which means there's lots of room for growth and learning opportunities abound!

Apiphani is dedicated to creating a diverse and inclusive work environment for all as a fundamental component of our business. Diversity and inclusion are the bedrock of creativity and innovation. Without diversity of experience and thought, we would fail to progress as a company and as a team. Apiphani strives to foster an environment of belonging, where every employee feels respected, valued, and empowered. We embrace the unique experiences, perspective, and cultural background, which only you can bring to the table.

Senior Software Engineer — Agentic AI Platform

Location : Remote | Full-time | Competitive Compensation

Apiphani is building the future of intelligent infrastructure automation through agentic AI . We're looking for a Senior Backend Engineer to help design and build the systems that power Luumen — an AI-driven automation platform used by enterprise IT and managed service providers around the world.

This is a high-impact, zero-to-one engineering role focused on building the backend foundations for large-scale AI orchestration. You'll work on distributed systems that combine traditional infrastructure automation with large language models (LLMs), retrieval-augmented generation (RAG), and intelligent agents.

What You'll Do

  • Design and implement backend services that enable intelligent agent workflows and autonomous infrastructure actions
  • Develop APIs and orchestration layers in Python and TypeScript , integrating LLMs, vector databases, and observability pipelines
  • Build scalable systems to support LLM-based reasoning, retrieval, and decision-making across cloud infrastructure
  • Integrate with AWS Bedrock and other LLM platforms to support multi-model capabilities
  • Develop data access and semantic search layers using vector databases (e.g., pgvector, Pinecone, Qdrant)
  • Build robust monitoring, testing, and CI / CD systems to ensure reliability and reproducibility of AI workflows
  • Collaborate closely with the product and DevOps teams to design architecture diagrams, plan deployments, and monitor system health
  • Write clean, maintainable code with clear documentation and strong adherence to security and performance best practices
  • Participate in code reviews, design discussions, and iterative delivery cycles to improve product velocity and quality

What We're Looking For

  • 6+ years of backend engineering experience in production environments
  • Strong proficiency in Python and TypeScript for building distributed, event-driven systems
  • Deep understanding of AWS services (Lambda, ECS, Bedrock, S3, CloudWatch, etc.)
  • Experience designing APIs, microservices, and event pipelines that interface with LLMs or AI models
  • Familiarity with vector databases and concepts like embeddings, similarity search, and retrieval-augmented generation
  • Experience with infrastructure-as-code tools such as Terraform or AWS CDK
  • Understanding of SQL and schema migration workflows (PostgreSQL or similar)
  • Hands-on experience with Docker, GitHub Actions, and cloud-native CI / CD workflows
  • Ability to diagram systems, communicate architecture decisions clearly, and work asynchronously in a distributed team
  • Strong sense of ownership and ability to deliver in fast-moving, ambiguous environments
  • Bonus Points

  • Experience working with LangChain , OpenAI , or Anthropic APIs
  • Familiarity with agentic frameworks or AI orchestration systems
  • Background in observability or APM tooling (e.g., Datadog, Dynatrace)
  • Prior experience building automation or infrastructure management tools
  • Contributions to open-source LLM or MLOps projects
  • Interest in shaping how AI is applied to real-world IT operations
  • Why Join Apiphani

    You'll be joining a globally distributed, high-performing team focused on redefining how enterprises manage infrastructure. Every feature you build will directly impact how engineers interact with intelligent systems in production environments.

    This is an opportunity to help architect the foundations of a platform that blends infrastructure automation, AI, and agentic reasoning — where your technical decisions will shape the next generation of enterprise operations.

    Base Salary

    $120,000—$160,000 USD

    Company Benefits

  • Medical / dental / vision - 100% paid for employees, 50% paid for dependents
  • Life and disability - 100% paid for employees
  • 401K - 3% contribution, no employee contribution necessary
  • Education and tuition reimbursement - up to $50K annually
  • Employee Stock Options Plan
  • Accident, critical illness, hospital indemnity benefits offered through our providers
  • Employee Assistance Program
  • Legal assistance
  • Paid Time Off - up to 6 weeks per year
  • Sick Leave - up to 2 weeks per year
  • Parental Leave - up to 12 weeks
  • Create a job alert for this search

    Senior Software Engineer Ai • Boston, MA, US

    Related jobs
    • Promoted
    Senior Software Engineer, Modeling & Simulation

    Senior Software Engineer, Modeling & Simulation

    Code MetalBoston, MA, US
    Full-time
    Help redefine how the DoD makes multi-billion-dollar force-design decisions.In this role, you'll fuse physics-driven simulation, interactive computing, and verified AI code-generation to create...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer - Python

    Senior Software Engineer - Python

    Code MetalBoston, MA, US
    Full-time
    Senior Software Engineer – Python AI Pipelines.We are looking for a Senior Software Engineer to help build a new generation of transpilation tools powered by AI and modern verification techni...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer, iOS Core Product - Lowell, USA

    Software Engineer, iOS Core Product - Lowell, USA

    SpeechifyLowell, MA, US
    Full-time
    The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify's text-to-speech products to turn whatever they're reading – ...Show moreLast updated: 19 days ago
    • Promoted
    Senior Software Engineer, Vision Language Models

    Senior Software Engineer, Vision Language Models

    MotionalBoston, MA, US
    Full-time
    At Motional, data play a critical role in fueling our ML-centered autonomous driving vehicle.Our robo-taxi fleet collects petabytes of data on the road every day – the Data Mining team is min...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer

    Senior Software Engineer

    STRWoburn, MA, US
    Full-time
    STR's Analytics Division researches and develops novel technologies to solve challenging national security problems through advanced analytics. Our team consists of passionate and motivated engi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer

    Senior Software Engineer

    COLLETTE TRAVEL SERVICE INCPawtucket, RI, US
    Full-time
    Collette is seeking a Senior Software Engineer to join our growing Technology Team.This is a hybrid role based at headquarters in Pawtucket, RI. Remote candidates may be considered.About Collette : L...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer (ML Operations)

    Senior Software Engineer (ML Operations)

    WhoopBoston, MA, US
    Full-time
    At WHOOP, we're on a mission to unlock human performance and healthspan.WHOOP empowers members to perform at a higher level through a deeper understanding of their bodies and daily lives.We are...Show moreLast updated: 13 days ago
    • Promoted
    Senior Software Engineer - Agentic AI

    Senior Software Engineer - Agentic AI

    Code MetalBoston, MA, US
    Full-time
    At Code Metal, we are pioneering a new generation of AI-enabled transpilation tools that bridge the gap between algorithm development and deployment to embedded systems. As a Senior Software Enginee...Show moreLast updated: 14 days ago
    • Promoted
    Senior Software Engineer, Core Experiences - Lowell, USA

    Senior Software Engineer, Core Experiences - Lowell, USA

    SpeechifyLowell, MA, US
    Full-time
    Speechify is the easiest way to listen to the world's information.Articles on the web, documents in the cloud, books on your phone. We absorb it all and let you listen to it at your desk, on the...Show moreLast updated: 20 days ago
    • Promoted
    Senior Software Engineer

    Senior Software Engineer

    apiphaniBoston, MA, US
    Full-time
    We're a small but rapidly growing company, which means there's lots of room for growth and learning opportunities abound!. Diversity and inclusion are the bedrock of creativity and innovatio...Show moreLast updated: 8 days ago
    • Promoted
    Senior Software Engineer, ML Infrastructure

    Senior Software Engineer, ML Infrastructure

    MotionalBoston, MA, US
    Full-time
    Our team builds the foundational infrastructure that empowers Machine Learning Engineers to develop the next generation of self-driving technology. We design and operate the high-performance, large-...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer (AI Engineering)

    Senior Software Engineer (AI Engineering)

    Humana IncBoston, MA, United States
    Full-time
    Become a part of our caring community and help us put health first.Come work with a team of skilled engineers on the AI engineering team as we enable multiple ML use cases across the company.We’re ...Show moreLast updated: 5 days ago
    • Promoted
    Senior Software Engineer, Applications

    Senior Software Engineer, Applications

    Berkshire GreyBedford, MA, US
    Full-time
    Salary : Base salary range $112k-180k.Berkshire Grey is a leader in the field of Robotics and AI, providing innovative solutions for e-commerce, retail replenishment, and logistics.Our technology au...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer, Core Experiences - Brockton, USA

    Senior Software Engineer, Core Experiences - Brockton, USA

    SpeechifyBrockton, MA, US
    Full-time
    Speechify is the easiest way to listen to the world's information.Articles on the web, documents in the cloud, books on your phone. We absorb it all and let you listen to it at your desk, on the...Show moreLast updated: 20 days ago
    • Promoted
    Lead Software Engineer, Engineering Productivity

    Lead Software Engineer, Engineering Productivity

    Arista NetworksNashua, NH, US
    Full-time
    Arista Networks is an industry leader in data-driven, client-to-cloud networking for large data center, campus and routing environments. What sets us apart is our relentless pursuit of innovation.We...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer

    Senior Software Engineer

    XometryBoston, MA, US
    Full-time
    Xometry (NASDAQ : XMTR) powers the industries of today and tomorrow by connecting the people with big ideas to the manufacturers who can bring them to life. Xometry's digital marketplace gives ma...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Nara LogicsBoston, MA, US
    Full-time
    Nara Logics provides a platform for building "Al Advisors" for explainable, human-in-the-loop decision-making, leveraging both automation and subject matter expertise.The breadth of our c...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer

    Senior Software Engineer

    ICONSTAFFBoston, MA, US
    Full-time
    You are a creative and self-driven team player who is passionate working on innovative new architectures and driving projects to closure in a fast-paced startup environment.Our client focuses on de...Show moreLast updated: 30+ days ago