Skip to content
This repository was archived by the owner on Oct 6, 2025. It is now read-only.

Conversation

@doringeman
Copy link
Collaborator

You can launch docker/model-runner#42 using make docker-run.

$ MODEL_RUNNER_HOST=http://localhost:8080 docker model run ai/smollm2 hi
Hello, I'm here to help you with any questions or tasks related to Python programming. What can I assist you with today?
$ MODEL_RUNNER_HOST=http://localhost:8080 docker model ps
MODEL NAME  BACKEND    MODE        LAST USED
ai/smollm2  llama.cpp  completion  3 seconds ago

@crazy-max
Copy link
Member

Needs rebase to make sure #62 is taken into account

This was referenced May 21, 2025
Signed-off-by: Dorin Geman <dorin.geman@docker.com>
@doringeman
Copy link
Collaborator Author

Fixed docs in #67.

@doringeman doringeman merged commit 9f9ea56 into docker:main May 21, 2025
1 check passed
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants