For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Packages
You can install all the MAX API libraries and tools, including Mojo and all
optional dependencies, with max[all] (pip/uv) or max-all (conda/pixi).
Alternatively, you can install just a subset of the tools using one of the
other max package options as described below.
Installβ
To get the latest improvements and new features, we recommend installing our nightly build, which we release several times a week. If you want a better tested but older version, you can install a stable build. For version details, see the release notes.
System requirements:
Mac
Linux
WSL
- pixi
- uv
- If you don't have it, install
pixi:curl -fsSL https://pixi.sh/install.sh | shThen restart your terminal for the changes to take effect.
- Create a project:
pixi init example-project \ -c https://conda.modular.com/max-nightly/ -c conda-forge \ && cd example-project - Install
maxwith all dependencies (nightly):pixi add max-all - Start the virtual environment:
pixi shell
- If you don't have it, install
uv:curl -LsSf https://astral.sh/uv/install.sh | shThen restart your terminal to make
uvaccessible. - Create a project:
uv init example-project && cd example-project - Create and start a virtual environment:
uv venv && source .venv/bin/activate - Install
maxwith all dependencies (nightly):uv add "max[all]" \ --index https://whl.modular.com/nightly/simple/ \ --prerelease allow
See the following section for more details about what's included in
max[all] (and max-all).
What's includedβ
The max[all] (or max-all) package includes all optional dependencies so you
can do everything, including serve models, benchmark endpoints, and program
with Mojo.
If you're concerned about bloat in your dependencies, you can chose a
smaller package that includes only what you need. For example, if you only need
to benchmark an endpoint, you can install just max[benchmark].
max[all]β
- pip/uv:
max[all] - conda/pixi:
max-all
This is the "all extras" package. It includes everything MAX has to offer.
It's just a convenient way to get all these packages at once:
max[benchmark]max[serve]mojo
max[benchmark]β
- pip/uv:
max[benchmark] - conda/pixi:
max-benchmark
This is required to use the max benchmark command.
It depends on max and other third-party packages.
max[serve]β
- pip/uv:
max[serve] - conda/pixi:
max-serve
This is required to create an endpoint with the max serve
command.
It depends on max and other third-party packages.
maxβ
This is the main package you need to do anything with MAX. It includes:
maxCLI: Mostly used to create and benchmark endpoints, but theserveandbenchmarkcommands requiremax[serve]andmax[benchmark], respectively.- MAX Python library: Used to build models.
- MAX accelerator library: Used to accelerate inference with GPUs.
- MAX Engine C API: Used to run inference without an endpoint.
max depends on mojo-compiler and minimal third-party packages.
If you want all Mojo developer tools, you must install the larger mojo
package, which is included in the max[all] package. To see what's in the
mojo and mojo-compiler packages, see
what's include in the Mojo SDK.
Technically, there are other packages you'll see in your dependency tree
(such as max-core) but they're implementation detail and you should generally
ignore themβdon't set them as explicit dependencies in your project because
they won't work on their own.
System requirementsβ
Your system must meet these specifications.
- Mac
- Linux
- Windows
- macOS Sequoia (15) or later.
- Apple silicon (M1βM5 processor).
- Python 3.10β3.14.
- Xcode or Xcode Command Line Tools 16 or later.
- Apple silicon GPU support is available for Mojo GPU programming. See
GPU compatibility for details. You may need to run
xcodebuild -downloadComponent MetalToolchainto install the Metal utilities required for GPU programming.
-
glibc 2.34 or later (for example, Ubuntu 22.04 LTS or later).
Officially supported distribution -
x86-64-v3 (Haswell-class or newer; CPUs from approximately 2013 onward) or ARM64 Neoverse N1 or newer (for example, AWS Graviton2 and later).
x86-64-v3 CPU instruction sets -
8 GiB RAM minimum for Mojo development. MAX inference and model serving require significantly more memory, with the exact amount varying by model. For the catalog of supported models, see the supported models page; for a specific model, check its Hugging Face page for memory details.
-
Python 3.10β3.14.
-
A C compiler (such as
cc,gcc, orclang)βused as a linker. -
To use GPUs, see the GPU compatibility.
Windows is not officially supported at this time.
In the meantime, you can try MAX on Windows with WSL, using a compatible version of Ubuntu (see our requirements for Linux).
GPU compatibilityβ
MAX supports both CPUs and GPUs, so you don't always need a GPU to serve a model. But if you want to accelerate inference with GPUs or program for GPUs with Mojo, the following GPUs are compatible.
NVIDIA GPUsβ
| GPU | Architecture |
|---|---|
| Tested for serving | |
| B200 | Blackwell |
| Known compatible for development | |
| B300 | Blackwell |
| B100 | Blackwell |
| DGX Spark | Blackwell |
| H200 | Hopper |
| H100 | Hopper |
| L4 | Ada Lovelace |
| L40 | Ada Lovelace |
| A100 | Ampere |
| A10 | Ampere |
| A1000 | Ampere |
| RTX 50XX series | Blackwell |
| RTX 40XX series | Ada Lovelace |
| RTX 30XX series | Ampere |
| Jetson Orin / Orin Nano | Ampere |
| Jetson Thor | Blackwell |
| T4 | Turing |
| RTX 20XX series | Turing |
Software requirement: NVIDIA GPU driver 580 or later. Check your version with
nvidia-smi. To
update, see the NVIDIA driver docs. If
your driver is older than 580, set the MODULAR_NVPTX_COMPILER_PATH environment
variable to a system ptxas binary (for example,
export MODULAR_NVPTX_COMPILER_PATH=/usr/local/cuda/bin/ptxas).
AMD GPUsβ
| GPU | Architecture |
|---|---|
| Tested for serving | |
| MI355X | CDNA4 |
| MI300X | CDNA3 |
| MI325X | CDNA3 |
| Known compatible for development | |
| MI250X | CDNA2 |
| Radeon RX 9070 | RDNA4 |
| Radeon RX 9060 | RDNA4 |
| Radeon 880M / 890M | RDNA3.5 |
| Radeon 860M | RDNA3.5 |
| Radeon 8060S | RDNA3.5 |
| Radeon RX 7900 | RDNA3 |
| Radeon RX 7800 / 7700 | RDNA3 |
| Radeon RX 7600 | RDNA3 |
| Radeon 780M | RDNA3 |
| Radeon RX 6900 | RDNA2 |
Software requirement: AMD GPU driver 6.3.3 or later (MI355X requires ROCm 7.0 or later). For installation, see the Ubuntu native install guide.
Apple silicon GPUsβ
Apple silicon GPU support (M1βM5) is functional for GPU programming with Mojo. Large GenAI model inference via MAX isn't yet available on Apple silicon. For details, see the Mojo system requirements.