docker model
| Description | Docker Model Runner |
|---|
Description
Use Docker Model Runner to run and interact with AI models directly from the command line. For more information, see the documentation
Subcommands
| Command | Description |
|---|---|
docker model bench | Benchmark a model's performance at different concurrency levels |
docker model inspect | Display detailed information on one model |
docker model install-runner | Install Docker Model Runner (Docker Engine only) |
docker model list | List the models pulled to your local environment |
docker model logs | Fetch the Docker Model Runner logs |
docker model package | Package a GGUF file, Safetensors directory, or existing model into a Docker model OCI artifact. |
docker model pull | Pull a model from Docker Hub or HuggingFace to your local environment |
docker model purge | Remove all models |
docker model push | Push a model to Docker Hub |
docker model reinstall-runner | Reinstall Docker Model Runner (Docker Engine only) |
docker model restart-runner | Restart Docker Model Runner (Docker Engine only) |
docker model rm | Remove local models downloaded from Docker Hub |
docker model run | Run a model and interact with it using a submitted prompt or chat mode |
docker model start-runner | Start Docker Model Runner (Docker Engine only) |
docker model status | Check if the Docker Model Runner is running |
docker model stop-runner | Stop Docker Model Runner (Docker Engine only) |
docker model tag | Tag a model |
docker model uninstall-runner | Uninstall Docker Model Runner (Docker Engine only) |
docker model version | Show the Docker Model Runner version |
