Skip to content

Server becomes the source of truth for sampling parameter defaults#20558

Merged
allozaur merged 6 commits intoggml-org:masterfrom
ServeurpersoCom:webui/sampling-from-server
Mar 19, 2026
Merged

Server becomes the source of truth for sampling parameter defaults#20558
allozaur merged 6 commits intoggml-org:masterfrom
ServeurpersoCom:webui/sampling-from-server

Conversation

@ServeurpersoCom
Copy link
Copy Markdown
Contributor

Make sure to read the contributing guidelines before submitting a PR

Server becomes the source of truth for sampling parameter defaults

Sampling defaults in the webui are now empty strings instead of
hardcoded values duplicated from common.h. Empty means "not sent
in the request" (already handled by hasValue()), so the server
decides. Placeholders show the actual server/preset values via /props.

Fixes

Fixes the "Custom" badge that never appeared on sampling parameters
because client defaults always matched server defaults. Now any
user-set value that differs from the server is flagged.

Close #18129

@ServeurpersoCom
Copy link
Copy Markdown
Contributor Author

The single model mode still needs to be tested. We can also store overrides per model, but that needs to be done in a separate PR, it's a negative line PR, this simplifie le code. WDYT @allozaur

@ServeurpersoCom
Copy link
Copy Markdown
Contributor Author

It works in principle, but something doesn't sit right with me; the placeholder updates don't seem reliable.

@allozaur
Copy link
Copy Markdown
Contributor

It works in principle, but something doesn't sit right with me; the placeholder updates don't seem reliable.

just tested it on my end and things look normal on my end

Comment thread tools/server/webui/src/lib/constants/settings-config.ts Outdated
@allozaur allozaur force-pushed the webui/sampling-from-server branch from 543f1bf to 92b388a Compare March 19, 2026 11:56
@allozaur allozaur requested a review from a team as a code owner March 19, 2026 11:56
@allozaur allozaur merged commit 4065c1a into ggml-org:master Mar 19, 2026
6 checks passed
@ServeurpersoCom
Copy link
Copy Markdown
Contributor Author

It works in principle, but something doesn't sit right with me; the placeholder updates don't seem reliable.

just tested it on my end and things look normal on my end

Actually, it's just a matter of caching child process properties, but from a UX perspective, this PR does the job.

Ethan-a2 pushed a commit to Ethan-a2/llama.cpp that referenced this pull request Mar 20, 2026
…gml-org#20558)

* webui: make server the source of truth for sampling defaults

* webui: fix Custom badge for sampling parameters

* webui: log user overrides after server sync

* chore: update webui build output

* fix: Default values for sampling settings config object

* chore: update webui build output

---------

Co-authored-by: Aleksander Grygier <aleksander.grygier@gmail.com>
Seunghhon pushed a commit to Seunghhon/llama.cpp that referenced this pull request Apr 26, 2026
…gml-org#20558)

* webui: make server the source of truth for sampling defaults

* webui: fix Custom badge for sampling parameters

* webui: log user overrides after server sync

* chore: update webui build output

* fix: Default values for sampling settings config object

* chore: update webui build output

---------

Co-authored-by: Aleksander Grygier <aleksander.grygier@gmail.com>
rsenthilkumar6 pushed a commit to rsenthilkumar6/llama.cpp that referenced this pull request May 1, 2026
…gml-org#20558)

* webui: make server the source of truth for sampling defaults

* webui: fix Custom badge for sampling parameters

* webui: log user overrides after server sync

* chore: update webui build output

* fix: Default values for sampling settings config object

* chore: update webui build output

---------

Co-authored-by: Aleksander Grygier <aleksander.grygier@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Misc. bug: Web-Frontend overrides sampling parameters from models preset in router mode

2 participants