[Inference]Support dynamic batch for bloom model and add is_running function#4933
Merged
isky-cd merged 16 commits intohpcaitech:feature/dynamic_batchingfrom Oct 17, 2023
Merged
Commits
Commits on Oct 14, 2023
Commits on Oct 16, 2023
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed