Skip to content

Expose build_info in router mode#21835

Merged
ngxson merged 1 commit intoggml-org:masterfrom
gaspardpetit:feat/llama-server-exposes-build-info-in-router-mode
Apr 13, 2026
Merged

Expose build_info in router mode#21835
ngxson merged 1 commit intoggml-org:masterfrom
gaspardpetit:feat/llama-server-exposes-build-info-in-router-mode

Conversation

@gaspardpetit
Copy link
Copy Markdown
Contributor

@gaspardpetit gaspardpetit commented Apr 13, 2026

Overview

  • Include the build_info in llama-server 's /prop endpoint when running in router mode;
  • also expose params.models_max instead of dummy value and params.models_autoload

Requirements


For context, with this change, in router mode, for GET /props

BEFORE

{
  "role":"router",
  "max_instances":4,
  "model_alias":"llama-server",
  "model_path":"none",
  "default_generation_settings":{"params":null,"n_ctx":0},
  "webui_settings":{}
}

AFTER

{
  "role":"router",
  "max_instances":4,
  "models_autoload":true,
  "model_alias":"llama-server",
  "model_path":"none",
  "default_generation_settings":{"params":null,"n_ctx":0},
  "webui_settings":{},
  "build_info":"b8771-9ef1fab9c"
}

@gaspardpetit gaspardpetit requested a review from a team as a code owner April 13, 2026 01:58
@github-actions github-actions Bot added examples python python script changes server labels Apr 13, 2026
@ngxson ngxson merged commit ce8fd4b into ggml-org:master Apr 13, 2026
49 of 50 checks passed
cnsiva pushed a commit to saas-home/llama.cpp that referenced this pull request Apr 13, 2026
HermestoAizales pushed a commit to HermestoAizales/llama.cpp that referenced this pull request Apr 13, 2026
@gaspardpetit gaspardpetit deleted the feat/llama-server-exposes-build-info-in-router-mode branch April 13, 2026 22:08
ArberSephirotheca pushed a commit to ArberSephirotheca/llama.cpp that referenced this pull request Apr 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

examples python python script changes server

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants