Skip to content

[Fix] optimize/shard model in TPInferEngine init#4684

Merged
tiandiao123 merged 3 commits intohpcaitech:feature/colossal-inferencefrom
yuanheng-zhao:colossal-inference/fix-pr
Sep 11, 2023
Merged

[Fix] optimize/shard model in TPInferEngine init#4684
tiandiao123 merged 3 commits intohpcaitech:feature/colossal-inferencefrom
yuanheng-zhao:colossal-inference/fix-pr

Commits

Commits on Sep 11, 2023