[Kernels] add necessary kernels (llama & bloom) for attention forward and kv-cache manager #4485
Merged
tiandiao123 merged 22 commits intohpcaitech:feature/colossal-inferencefrom Aug 24, 2023
Commits
Commits on Aug 22, 2023
- committed
- committed
- committed
- committed
- committed
- committed
Commits on Aug 23, 2023
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
Commits on Aug 24, 2023
- committed
- committed
- committed
- committed