Skip to content

metal : refactor kernel loading#15964

Merged
ggerganov merged 5 commits intomasterfrom
gg/metal-refactor-rms-add
Sep 13, 2025
Merged

metal : refactor kernel loading#15964
ggerganov merged 5 commits intomasterfrom
gg/metal-refactor-rms-add

Conversation

@ggerganov
Copy link
Copy Markdown
Member

cont #15857

Compile RMS_NORM and ADD kernels at inference time.

@github-actions github-actions Bot added devops improvements to build systems and github actions ggml changes relating to the ggml tensor library for machine learning Apple Metal https://en.wikipedia.org/wiki/Metal_(API) labels Sep 13, 2025
@ggerganov ggerganov force-pushed the gg/metal-refactor-rms-add branch from 29303ef to 19f8845 Compare September 13, 2025 12:11
@ggerganov ggerganov merged commit 55758b0 into master Sep 13, 2025
46 of 48 checks passed
@ggerganov ggerganov deleted the gg/metal-refactor-rms-add branch September 13, 2025 13:24
blime4 referenced this pull request in blime4/llama.cpp Feb 5, 2026
* metal : refactor bin kernels loading

ggml-ci

* metal : refactor rms kernel loading

ggml-ci

* ci : try to add memory leaks check

ggml-ci

* ci : try to enable memory leak detection for Mac

* cont : seems to be working
Seunghhon pushed a commit to Seunghhon/llama.cpp that referenced this pull request Apr 26, 2026
* metal : refactor bin kernels loading

ggml-ci

* metal : refactor rms kernel loading

ggml-ci

* ci : try to add memory leaks check

ggml-ci

* ci : try to enable memory leak detection for Mac

* cont : seems to be working
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Apple Metal https://en.wikipedia.org/wiki/Metal_(API) devops improvements to build systems and github actions ggml changes relating to the ggml tensor library for machine learning

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant