LiteLLM

LiteLLM (https://github.com/BerriAI/litellm) is a Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere] and is used by companies like Rocket Money, Adobe, Twilio, and Siemens.

Founding engineer will help with migrating key systems to aiohttp, handle LLM provider-specific quirks like Azure role handling, standardize LLMs to OpenAI Spec.

• Strong Python and async framework experience (e.g., aiohttp, FastAPI).
• Familiarity with LLM APIs (OpenAI, Azure, Hugging Face)
• Proven ability to optimize scalable, high-performance systems.