Skip to content

Conversation

@doringeman
Copy link
Contributor

E.g.,

$ MODEL_RUNNER_HOST=http://localhost:8080 docker model ps
MODEL NAME                  BACKEND    MODE        LAST USED
ghcr.io/ilopezluna/smollm2  llama.cpp  completion  1 second ago
ai/smollm2                  llama.cpp  completion  17 seconds ago

Signed-off-by: Dorin Geman <dorin.geman@docker.com>
@doringeman doringeman mentioned this pull request May 21, 2025
@doringeman doringeman merged commit 105562e into docker:main May 21, 2025
ericcurtin referenced this pull request in ericcurtin/model-runner Sep 21, 2025
Avoid ostringstream::str which breaks openEuler build on llama.cpp
doringeman added a commit to doringeman/model-runner that referenced this pull request Oct 2, 2025
Set User-Agent to docker-model-cli/<version>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants