Skip to content

metal : report OOM errors#16274

Merged
ggerganov merged 1 commit intomasterfrom
gg/metal-report-oom
Sep 26, 2025
Merged

metal : report OOM errors#16274
ggerganov merged 1 commit intomasterfrom
gg/metal-report-oom

Conversation

@ggerganov
Copy link
Copy Markdown
Member

cont #15832
fix #16253

We weren't checking the status of the compute command buffers, which is what we use in the Metal backend to detect OOM.

@github-actions github-actions Bot added ggml changes relating to the ggml tensor library for machine learning Apple Metal https://en.wikipedia.org/wiki/Metal_(API) labels Sep 26, 2025
@ggerganov ggerganov merged commit 54dbc37 into master Sep 26, 2025
64 of 66 checks passed
@ggerganov ggerganov deleted the gg/metal-report-oom branch September 26, 2025 11:14
struct pushed a commit to struct/llama.cpp that referenced this pull request Sep 26, 2025
pwilkin pushed a commit to pwilkin/llama.cpp that referenced this pull request Oct 23, 2025
Anico2 added a commit to Anico2/llama.cpp that referenced this pull request Jan 15, 2026
blime4 referenced this pull request in blime4/llama.cpp Feb 5, 2026
Seunghhon pushed a commit to Seunghhon/llama.cpp that referenced this pull request Apr 26, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Apple Metal https://en.wikipedia.org/wiki/Metal_(API) ggml changes relating to the ggml tensor library for machine learning

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants