Skip to content

[Feature] The first PR to Add TP inference engine, kv-cache manager and related kernels for our inference system#4577

Merged
tiandiao123 merged 46 commits intomainfrom
feature/colossal-inference
Sep 11, 2023
Merged

[Feature] The first PR to Add TP inference engine, kv-cache manager and related kernels for our inference system#4577
tiandiao123 merged 46 commits intomainfrom
feature/colossal-inference

Commits

Commits on Sep 7, 2023

Commits on Sep 8, 2023

Commits on Sep 11, 2023