Skip to content

[inference] add smoothquant llama attention#4850

Merged
Xu-Kai merged 5 commits intohpcaitech:feature/smoothquantfrom
Xu-Kai:feature/smoothquant
Oct 3, 2023
Merged

[inference] add smoothquant llama attention#4850
Xu-Kai merged 5 commits intohpcaitech:feature/smoothquantfrom
Xu-Kai:feature/smoothquant

Commits

Commits on Oct 3, 2023