From a3b0d60f330f76daf6b212dc25968ace0c6fed58 Mon Sep 17 00:00:00 2001 From: binmakeswell Date: Wed, 29 Mar 2023 02:28:22 +0800 Subject: [PATCH 1/3] [doc] add ColossalChat --- README.md | 19 ++++++++++++++----- docs/README-zh-Hans.md | 14 +++++++++++--- 2 files changed, 25 insertions(+), 8 deletions(-) diff --git a/README.md b/README.md index 3098d72b4591..7032ea48d341 100644 --- a/README.md +++ b/README.md @@ -66,7 +66,7 @@
  • Colossal-AI for Real World Applications @@ -214,15 +214,24 @@ Please visit our [documentation](https://www.colossalai.org/) and [examples](htt

    (back to top)

    ## Colossal-AI in the Real World -### ChatGPT -A low-cost [ChatGPT](https://openai.com/blog/chatgpt/) equivalent implementation process. [[code]](https://github.com/hpcaitech/ColossalAI/tree/main/applications/ChatGPT) [[blog]](https://www.hpc-ai.tech/blog/colossal-ai-chatgpt) -

    + +### ColossalChat + +

    + + + +
    + +[ColossalChat](https://github.com/hpcaitech/ColossalAI/tree/main/applications/Chat): An open-source solution for cloning [ChatGPT](https://openai.com/blog/chatgpt/) with a complete RLHF pipeline. [[code]](https://github.com/hpcaitech/ColossalAI/tree/main/applications/Chat) [[blog]](https://www.hpc-ai.tech/blog/colossal-ai-chatgpt) [[demo]](https://chat.colossalai.org) + +

    - Up to 7.73 times faster for single server training and 1.42 times faster for single-GPU inference -

    +

    diff --git a/docs/README-zh-Hans.md b/docs/README-zh-Hans.md index 81c45abfd833..edad349d4456 100644 --- a/docs/README-zh-Hans.md +++ b/docs/README-zh-Hans.md @@ -66,7 +66,7 @@
  • Colossal-AI 成功案例 @@ -212,8 +212,16 @@ Colossal-AI 为您提供了一系列并行组件。我们的目标是让您的

    (返回顶端)

    ## Colossal-AI 成功案例 -### ChatGPT -低成本复现[ChatGPT](https://openai.com/blog/chatgpt/)完整流程 [[代码]](https://github.com/hpcaitech/ColossalAI/tree/main/applications/ChatGPT) [[博客]](https://www.hpc-ai.tech/blog/colossal-ai-chatgpt) +### ColossalChat + +
    + + + +
    + +[ColossalChat](https://github.com/hpcaitech/ColossalAI/tree/main/applications/Chat): 完整RLHF流程0门槛克隆 [ChatGPT](https://openai.com/blog/chatgpt/) [[代码]](https://github.com/hpcaitech/ColossalAI/tree/main/applications/Chat) [[博客]](https://www.hpc-ai.tech/blog/colossal-ai-chatgpt) [[在线样例]](https://chat.colossalai.org) +

    From b4bc2567c2ee21d1a091ad76bdd9b4f9412e6503 Mon Sep 17 00:00:00 2001 From: binmakeswell Date: Wed, 29 Mar 2023 02:31:06 +0800 Subject: [PATCH 2/3] [doc] add ColossalChat --- README.md | 2 +- docs/README-zh-Hans.md | 6 +++--- 2 files changed, 4 insertions(+), 4 deletions(-) diff --git a/README.md b/README.md index 7032ea48d341..e52360fe9835 100644 --- a/README.md +++ b/README.md @@ -238,7 +238,7 @@ Please visit our [documentation](https://www.colossalai.org/) and [examples](htt - Up to 10.3x growth in model capacity on one GPU - A mini demo training process requires only 1.62GB of GPU memory (any consumer-grade GPU) -

    +

    diff --git a/docs/README-zh-Hans.md b/docs/README-zh-Hans.md index edad349d4456..56ce9ae1c4b2 100644 --- a/docs/README-zh-Hans.md +++ b/docs/README-zh-Hans.md @@ -222,20 +222,20 @@ Colossal-AI 为您提供了一系列并行组件。我们的目标是让您的 [ColossalChat](https://github.com/hpcaitech/ColossalAI/tree/main/applications/Chat): 完整RLHF流程0门槛克隆 [ChatGPT](https://openai.com/blog/chatgpt/) [[代码]](https://github.com/hpcaitech/ColossalAI/tree/main/applications/Chat) [[博客]](https://www.hpc-ai.tech/blog/colossal-ai-chatgpt) [[在线样例]](https://chat.colossalai.org) -

    +

    - 最高可提升单机训练速度7.73倍，单卡推理速度1.42倍 -

    +

    - 单卡模型容量最多提升10.3倍 - 最小demo训练流程最低仅需1.62GB显存 (任意消费级GPU) -

    +

    From 99fbeac406167d5856eaf8d6dfb095b42034c002 Mon Sep 17 00:00:00 2001 From: binmakeswell Date: Wed, 29 Mar 2023 02:32:24 +0800 Subject: [PATCH 3/3] [doc] add ColossalChat --- README.md | 2 +- docs/README-zh-Hans.md | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index e52360fe9835..77c3471d9d25 100644 --- a/README.md +++ b/README.md @@ -66,7 +66,7 @@
  • Colossal-AI for Real World Applications diff --git a/docs/README-zh-Hans.md b/docs/README-zh-Hans.md index 56ce9ae1c4b2..4be923eca024 100644 --- a/docs/README-zh-Hans.md +++ b/docs/README-zh-Hans.md @@ -66,7 +66,7 @@
  • Colossal-AI 成功案例