Ra#193

Merged

jamesthesnake merged 51 commits intomostfrom

Nov 26, 2023

Commits on Sep 17, 2023

Merge pull request #169 from hpcaitech/main
jamesthesnake
authored

Commits on Oct 27, 2023

Commits on Oct 30, 2023

[Inference] Dynamic Batching Inference, online and offline (#4953)

authored
[Kernels]Updated Triton kernels into 2.1.0 and adding flash-decoding for llama token attention (#4965)

tiandiao123
and
lcq336
authored

Commits on Nov 1, 2023

Commits on Nov 2, 2023

Commits on Nov 3, 2023

[hotfix] Add layer norm gradients all-reduce for sequence parallel (#4926)

littsk
and
KKZ20
authored

Commits on Nov 6, 2023

[format] applied code formatting on changed files in pull request 4926 (#5007)

github-actions[bot]
and
github-actions
authored

Commits on Nov 7, 2023

[Inference] Fix bug in ChatGLM2 Tensor Parallelism (#5014)
CjhHa1
authored

Commits on Nov 8, 2023

Commits on Nov 9, 2023

Commits on Nov 10, 2023

Commits on Nov 14, 2023

fix wrong EOS token in ColossalChat
Orion-Zheng
committed

Commits on Nov 17, 2023

[hotfix]: modify create_ep_hierarchical_group and add test (#5032)
cwher
authored

Commits on Nov 18, 2023

[exampe] fix llama example' loss error when using gemini plugin (#5060)
flybird11111
authored

Commits on Nov 19, 2023

[inference] Refactor inference architecture (#5057)

authored

Commits on Nov 20, 2023

Commits on Nov 21, 2023

Commits on Nov 23, 2023

Commits on Nov 24, 2023

fix typo change lazy_iniy to lazy_init (#5099)
digger-yu
authored

Commits on Nov 26, 2023

Merge pull request #192 from hpcaitech/main
jamesthesnake
authored