San Francisco, California, United StatesFounded 202310+ employeesPrivate
Seed
LiteLLM provides API unification, model routing, cost management, and logging/monitoring services.
Founders
YC W23
Hiring Pitch
LiteLLM (https://github.com/BerriAI/litellm) is a Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere] and is used by companies like Rocket Money, Adobe, Twilio, and Siemens.
Tech Stack
Founding engineer will help with migrating key systems to aiohttp, handle LLM provider-specific quirks like Azure role handling, standardize LLMs to OpenAI Spec.
- Strong Python and async framework experience (e.g., aiohttp, FastAPI).
- Familiarity with LLM APIs (OpenAI, Azure, Hugging Face)
- Proven ability to optimize scalable, high-performance systems.
Open Positions at LiteLLM (8 Jobs)
8 open
Showing 8 jobs
