LiteLLM (YC W23)

@LiteLLM

The industry standard AI Gateway for models, mcps and agents github.com/BerriAI/litellm

try it today ➜

github.com/BerriAI/litellm

Joined December 2022

195 Following

6,147 Followers

Replies Reposts Media

LiteLLM (YC W23)
@LiteLLM
Oct 31
New model releases, pricing, and benchmark results are all in one place: models.litellm.ai
Moe Khalil
@Mokhalil01
Oct 31
Introducing the @LiteLLM Model Registry. Track new model releases, provider deprecations, and benchmark results. Browse the website or use our RSS feeds to trigger automations. Check it out → models.litellm.ai
1
LiteLLM (YC W23)
@LiteLLM
Oct 30
How did we improve LLM translation or cost tracking for users in the last 24 hours? 1 - Codex sessions on Claude now starts with 30.8K tokens, down from 688K (#48972) 2 - PDFs from Claude apps now work on Azure OpenAI (#47166) 3 - PDF token estimates on Azure GPT now match the
3
LiteLLM (YC W23)
@LiteLLM
Oct 28
Autorouter SDK is here!
Moe Khalil
@Mokhalil01
Oct 28
Introducing the Autorouter SDK in @LiteLLM Pick the right model for every prompt across your agents, entirely in Python. You can: • Classify prompts with heuristics, an LLM, or custom code • Map any tiers to any models • Mix providers, pin sessions, escalate on stalls No
1
LiteLLM (YC W23)
@LiteLLM
Oct 28
20x latency reduction by December 1st, that's where Rust migration is headed. Read more: docs.litellm.ai/blog/rust-migr…
GIF
2
LiteLLM (YC W23)
@LiteLLM
Oct 27
Working on red teaming or rigorous security tests? Use abliterated models from Refuseless (@refuselessai) and Abliteration (@abliteration_ai) on LiteLLM.
Moe Khalil
@Mokhalil01
Oct 27
We just added support for Refuseless (@refuselessai) and Abliteration (@abliteration_ai) on @LiteLLM AI Gateway Read more below ↓
3