Skip to content
@truefoundry

TrueFoundry

Build fast, secure and cost-efficient ML/LLM Apps

TrueFoundryTrueFoundry

TrueFoundry - One Gateway for Your Entire AI Stack

Twitter Follow Artifact Hub YouTube Discord Signup

What is TrueFoundry?

  • TrueFoundry is an enterprise AI Gateway that gives organizations one control plane to securely access, govern, and observe LLMs, MCP servers, and agents.
  • The platform brings together identity & access, routing & discovery, policies & guardrails, credentials & trust, usage & cost controls, and observability & audit across your AI stack.

One Gateway for Your Entire AI Stack

TrueFoundry AI Gateway Architecture

  • LLM Gateway - Access 1000+ commercial, open-source, and fine-tuned models through one interface with routing, fallbacks, caching, guardrails, budgets, access controls, and observability.

  • MCP Gateway - Secure and govern access to MCP servers and tools with centralized authentication, authorization, credential management, policies, and observability.

  • Agent Gateway - Register, discover, and govern agents with identity, access controls, policies, guardrails, cost controls, and end-to-end visibility.

TrueFoundry Docs →

Explore guides, APIs, integrations, and deployment options for running the TrueFoundry AI Gateway as SaaS, in your VPC, on-prem, or in air-gapped environments.

OpenSource

  • TrueForge - Our open-source, vendor-neutral agent harness for building general-purpose agents. Bring your own model, MCP servers, tools, sandbox, and infrastructure.

Get in touch 💬

👉 Join our Discord community

🐦 Follow the latest from the TrueFoundry team on Twitter @truefoundry

📚 Explore the TrueFoundry Docs

🌐 Visit truefoundry.com

Pinned Loading

  1. trueforge trueforge Public

    The open-source agent harness - the runtime layer that turns an LLM into a working agent.

    TypeScript 2.3k 177

  2. CruiseKube CruiseKube Public

    CruiseKube is an intelligent Kubernetes resource optimization controller that automatically monitors, analyzes, and applies resource recommendations to improve cluster efficiency and reduce costs.

    Go 90 7

  3. aitori aitori Public

    Go 45

  4. models models Public

    Community-maintained registry of AI/LLM model configurations - pricing, features, and limits across 19 providers and 1000+ models

    35 6

  5. infra-charts infra-charts Public

    Helm Repo for TrueFoundry Platform Charts

    Go Template 7 6

  6. llm-locust llm-locust Public

    LLM Locust combines the simplicity of Locust with deep support for LLM-specific benchmarking

    TypeScript 36 11

Repositories

Showing 10 of 108 repositories

Top languages

Loading…

Most used topics

Loading…