Introduction

any-llm is a Python library providing a single interface to different LLM providers.

from any_llm import completion

# Using the messages format
response = completion(
    model="gpt-4o-mini",
    messages=[{"role": "user", "content": "What is Python?"}],
    provider="openai"
)
print(response)

# Switch providers without changing your code
response = completion(
    model="claude-sonnet-4-5-20250929",
    messages=[{"role": "user", "content": "What is Python?"}],
    provider="anthropic"
)
print(response)

Get Started | View on GitHub

Why any-llm

Switch providers in one line

Change from OpenAI to Anthropic, Mistral, or any other provider with a single parameter change.

Unified exception handling

Consistent error handling across all providers with a unified exception hierarchy.

Simple API, powerful features

Streaming, tool calling, embeddings, reasoning, and more, all through one interface.

API Documentation

any-llm provides two main interfaces:

Direct API Functions (recommended for simple use cases):

• completion - Chat completions with any provider
• embedding - Text embeddings
• moderation - Content moderation
• responses - OpenResponses API for agentic AI systems

AnyLLM Class (recommended for advanced use cases):

• Provider API - Lower-level provider interface with metadata access and reusability

For AI Systems

This documentation is available in an AI-friendly format via the unified Mozilla.ai llms.txt:

• llms.txt - Structured overview of all Mozilla.ai documentation for AI systems
• llms-full.txt - Complete Mozilla.ai documentation concatenated into a single file