Skip to content

[gptq] combine gptq and kv cache manager#4706

Merged
Xu-Kai merged 7 commits intohpcaitech:feature/quant-gptqfrom
Xu-Kai:gptq_infer
Sep 14, 2023
Merged

[gptq] combine gptq and kv cache manager#4706
Xu-Kai merged 7 commits intohpcaitech:feature/quant-gptqfrom
Xu-Kai:gptq_infer

Commits

Commits on Sep 13, 2023

Commits on Sep 14, 2023