Skip to content

[Kernels] add inference token attention kernel#4505

Merged
tiandiao123 merged 6 commits intohpcaitech:feature/colossal-inferencefrom
Xu-Kai:feature/colossal-inference
Aug 24, 2023
Merged

[Kernels] add inference token attention kernel#4505
tiandiao123 merged 6 commits intohpcaitech:feature/colossal-inferencefrom
Xu-Kai:feature/colossal-inference

Commits

Commits on Aug 24, 2023