Bestf#167

Merged

jamesthesnake merged 7 commits intomainfrom

Sep 13, 2023

Commits on Sep 9, 2023

[shardformer] update llama2/opt finetune example and fix llama2 policy (#4645)
flybird11111
authored

Commits on Sep 11, 2023

[devops] fix concurrency group (#4667)
ver217
authored
[legacy] move communication and nn to legacy and refactor logger (#4671)
ver217
authored
[shardformer]fix gpt2 double head (#4663)
flybird11111
authored
[Feature] The first PR to Add TP inference engine, kv-cache manager and related kernels for our inference system (#4577)

authored

Commits on Sep 12, 2023