You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
compose up: --backend flag is accepted but never applied #1036
There is no backend name field set from the flag. scheduling.ConfigureRequest also has no top-level backend selector (only model + BackendConfiguration + runtime flags). So even if the flag were plumbed, the request shape would need a place to put it (for example how ModelConfigEntry.Backend is stored elsewhere).
Meanwhile compose metadata advertises --backend via commandParameters(upCmd), so Compose/UI consumers may show a backend selector that does nothing.
Expected
Either:
Plumb --backend into the configure/install path so non-default backends work under compose, or
Remove the flag from up and from metadata until the API can honor it (so metadata matches behaviour).
Impact
Users (or Compose integrations) that pass --backend vllm (or anything other than the default) get silent no-ops: the flag is accepted, metadata lists it, but configuration always follows the runner default.
Confirmed, the flag is bound but never read. There's already a draft PR removing it. Model-runner is being deprecated in favor of llmman, please open further work against docker/llmman instead.
Activity
fix(cli): remove unused backend flag from compose up
ericcurtin commentedon Sep 26, 2026
Confirmed, the flag is bound but never read. There's already a draft PR removing it. Model-runner is being deprecated in favor of llmman, please open further work against docker/llmman instead.