Skip to content

[Runtime] Support PagedKVCache with tree attention#17049

Merged
tqchen merged 3 commits intoapache:mainfrom
MasterJH5574:tvm-dev/2024-05-31-paged-kv-tree-attn
Jun 1, 2024
Merged

[Runtime] Support PagedKVCache with tree attention#17049
tqchen merged 3 commits intoapache:mainfrom
MasterJH5574:tvm-dev/2024-05-31-paged-kv-tree-attn

Commits

Commits on May 31, 2024