Skip to content

CUDA: fix MMQ stream-k for --split-mode row #8167#948

Closed
Nexesenex wants to merge 1 commit intoLostRuins:concedo_experimentalfrom
Nexesenex:split_row_fix
Closed

CUDA: fix MMQ stream-k for --split-mode row #8167#948
Nexesenex wants to merge 1 commit intoLostRuins:concedo_experimentalfrom
Nexesenex:split_row_fix

Conversation

@Nexesenex
Copy link
Copy Markdown

Courtesy of Johannes Gaessler, as usual.
PR came after refactor, but I think that it's important to have it merged now for those using split row.

ggml-org#8167

Co-Authored-By: Johannes Gäßler <johannesg@5d6.de>
@LostRuins
Copy link
Copy Markdown
Owner

Will merge the commit from upstream directly

@LostRuins LostRuins closed this Jun 30, 2024
@Nexesenex Nexesenex deleted the split_row_fix branch July 11, 2024 01:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants