Skip to content

Conversation

@doringeman
Copy link
Contributor

On top of #45.

E.g.,

$ MODEL_RUNNER_HOST=http://localhost:8080 docker model run ai/smollm2 hi
$ MODEL_RUNNER_HOST=http://localhost:8080 docker model unload --all
Unloaded 1 model(s).
$ # run again
$ MODEL_RUNNER_HOST=http://localhost:8080 docker model unload ai/smollm2
Unloaded 1 model(s).
$ # run again
$ MODEL_RUNNER_HOST=http://localhost:8080 docker model unload --backend llama.cpp ai/smollm2
Unloaded 1 model(s).

Signed-off-by: Dorin Geman <dorin.geman@docker.com>
Signed-off-by: Dorin Geman <dorin.geman@docker.com>
Signed-off-by: Dorin Geman <dorin.geman@docker.com>
@doringeman doringeman changed the title Add /engines/df Add /engines/unload May 21, 2025
This was referenced May 21, 2025
@doringeman doringeman merged commit c818aab into docker:main May 21, 2025
ericcurtin referenced this pull request in ericcurtin/model-runner Sep 21, 2025
Configurable polyfills (including automatic tool call example), group inputs in struct, add strftime_now support
doringeman pushed a commit to doringeman/model-runner that referenced this pull request Oct 2, 2025
Add ce-release rule to support docker-ce-packaging
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants