TLDR
LiteLLM is an open-source LLM Gateway with 28K+ stars on GitHub and trusted by companies like NASA, Rocket Money, Samsara, Lemonade, and Adobe. Were rapidly expanding and seeking a founding full-stack engineer to help scale the platform. Were based in San Francisco.
What is LiteLLM
LiteLLM provides an open source Python SDK and Python FastAPI Server that allows calling 100+ LLM APIs (Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic) in the OpenAI format
We just hit $2.5M ARR and have raised a $1.6M seed round from Y Combinator, Gravity Fund and Pioneer Fund. You can find more information on our website, Github and Technical Documentation.
Why do companies use LiteLLM enterprise
Companies use LiteLLM Enterprise once they put LiteLLM into production and need enterprise features like Prometheus metrics (production monitoring) and need to give LLM access to a large number of people with SSO (secure sign on) or JWT (JSON Web Tokens)
What you will be working on
Skills : Next.js, Python, TypeScript, User discovery
LiteLLM exposes a developer portal, used by admins to grant access to 1k+ developers within their organizations. You will be responsible for :
This is a high impact role. You will be working closely with our CEO and CTO.
What is our tech stack
Backend built on Python, FastAPI. Frontend on Next.js + Typescript + TailwindCSS
Who we are looking for
#J-18808-Ljbffr
Founding Engineer • California, MO, United States