Skip to content

server : improve mtmd ctx checkpoints#20726

Merged
ggerganov merged 2 commits intomasterfrom
gg/server-fix-mtmd-ckpt-2
Mar 20, 2026
Merged

server : improve mtmd ctx checkpoints#20726
ggerganov merged 2 commits intomasterfrom
gg/server-fix-mtmd-ckpt-2

Conversation

@ggerganov
Copy link
Copy Markdown
Member

@ggerganov ggerganov commented Mar 18, 2026

fix #20720
cont #20232

  • Fix logic for end-of-prompt-checkpoints in the presence of mtmd chunks
  • Checkpoint spacing is now based on number of tokens, not on positions
  • Fix off-by-one in pos_min_thold logic

Comment thread tools/server/public/index.html.gz
@ggerganov ggerganov force-pushed the gg/server-fix-mtmd-ckpt-2 branch from d185c58 to 92a70fe Compare March 20, 2026 08:28
@ggerganov ggerganov merged commit ab9d4c3 into master Mar 20, 2026
48 of 52 checks passed
@ggerganov ggerganov deleted the gg/server-fix-mtmd-ckpt-2 branch March 20, 2026 09:13
@obn777
Copy link
Copy Markdown

obn777 commented Mar 20, 2026

просто , пусть не по теме, делюсь результатом:
{
"timestamp": "12:02:34",
"cpu_load": 0.5,
"ram_load": 32.0,
"gpu_temp": 38,
"gpu_load": 0,
"vram_mb": 4207,
"vector_integrity": 1.0,
"entropy": 0.0,
"status": "STABLE"
}
я перевел на нейронку nitro v 15

Ethan-a2 pushed a commit to Ethan-a2/llama.cpp that referenced this pull request Mar 20, 2026
* server : improve mtmd ctx checkpoints

* server : fix off-by-one in pos_min_thold
Seunghhon pushed a commit to Seunghhon/llama.cpp that referenced this pull request Apr 26, 2026
* server : improve mtmd ctx checkpoints

* server : fix off-by-one in pos_min_thold
rsenthilkumar6 pushed a commit to rsenthilkumar6/llama.cpp that referenced this pull request May 1, 2026
* server : improve mtmd ctx checkpoints

* server : fix off-by-one in pos_min_thold
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Eval bug: Qwen3.5-35B-A3B checkpoint not created after read images.

3 participants