From f91c043b522ee3ab838c552b4d3ed7528dc2ce80 Mon Sep 17 00:00:00 2001 From: Yanjia0 <42895286+Yanjia0@users.noreply.github.com> Date: Wed, 17 May 2023 11:44:02 +0800 Subject: [PATCH 01/12] Update colotensor_concept.md --- docs/source/en/basics/colotensor_concept.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/source/en/basics/colotensor_concept.md b/docs/source/en/basics/colotensor_concept.md index 909c5e4d3c6f..050f2ef9f092 100644 --- a/docs/source/en/basics/colotensor_concept.md +++ b/docs/source/en/basics/colotensor_concept.md @@ -2,6 +2,8 @@ Author: [Jiarui Fang](https://github.com/feifeibear), [Hongxin Liu](https://github.com/ver217) and [Haichen Huang](https://github.com/1SAA) +> ⚠️ The information on this page is outdated and will be deprecated. + **Prerequisite:** - [Colossal-AI Overview](../concepts/colossalai_overview.md) - [Distributed Training](../concepts/distributed_training.md) From d5fb008c089d508364851180d639fb616d440938 Mon Sep 17 00:00:00 2001 From: Yanjia0 <42895286+Yanjia0@users.noreply.github.com> Date: Wed, 17 May 2023 11:44:25 +0800 Subject: [PATCH 02/12] Update configure_parallelization.md --- docs/source/en/basics/configure_parallelization.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/source/en/basics/configure_parallelization.md b/docs/source/en/basics/configure_parallelization.md index 4ac0299eac14..fd1e72ccd45a 100644 --- a/docs/source/en/basics/configure_parallelization.md +++ b/docs/source/en/basics/configure_parallelization.md @@ -2,6 +2,8 @@ Author: Shenggui Li, Siqi Mai +> ⚠️ The information on this page is outdated and will be deprecated. Please check [Booster Plugins](../basics/booster_plugins.md) for more information. + **Prerequisite:** - [Distributed Training](../concepts/distributed_training.md) - [Paradigms of Parallelism](../concepts/paradigms_of_parallelism.md) From d669505691ab68f572f4343562b1438ec4153084 Mon Sep 17 00:00:00 2001 From: Yanjia0 <42895286+Yanjia0@users.noreply.github.com> Date: Wed, 17 May 2023 11:44:47 +0800 Subject: [PATCH 03/12] Update define_your_config.md --- docs/source/en/basics/define_your_config.md | 3 +++ 1 file changed, 3 insertions(+) diff --git a/docs/source/en/basics/define_your_config.md b/docs/source/en/basics/define_your_config.md index d2569691b7dc..048ffcacbb8f 100644 --- a/docs/source/en/basics/define_your_config.md +++ b/docs/source/en/basics/define_your_config.md @@ -2,6 +2,9 @@ Author: Guangyang Lu, Shenggui Li, Siqi Mai +> ⚠️ The information on this page is outdated and will be deprecated. Please check [Booster API](../basics/booster_api.md) for more information. + + **Prerequisite:** - [Distributed Training](../concepts/distributed_training.md) - [Colossal-AI Overview](../concepts/colossalai_overview.md) From 5436bb44fb8ba0cb66c509a84352560f295d852b Mon Sep 17 00:00:00 2001 From: Yanjia0 <42895286+Yanjia0@users.noreply.github.com> Date: Wed, 17 May 2023 11:45:17 +0800 Subject: [PATCH 04/12] Update engine_trainer.md --- docs/source/en/basics/engine_trainer.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/source/en/basics/engine_trainer.md b/docs/source/en/basics/engine_trainer.md index bbe32ed5a3b5..d2f99563f042 100644 --- a/docs/source/en/basics/engine_trainer.md +++ b/docs/source/en/basics/engine_trainer.md @@ -2,6 +2,8 @@ Author: Shenggui Li, Siqi Mai +> ⚠️ The information on this page is outdated and will be deprecated. Please check [Booster API](../basics/booster_api.md) for more information. + **Prerequisite:** - [Initialize Features](./initialize_features.md) From 13f14087b9a6841d9d452781a2c9f6506f3479e7 Mon Sep 17 00:00:00 2001 From: Yanjia0 <42895286+Yanjia0@users.noreply.github.com> Date: Wed, 17 May 2023 11:45:39 +0800 Subject: [PATCH 05/12] Update initialize_features.md --- docs/source/en/basics/initialize_features.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/source/en/basics/initialize_features.md b/docs/source/en/basics/initialize_features.md index e768d2022ad8..b89017427476 100644 --- a/docs/source/en/basics/initialize_features.md +++ b/docs/source/en/basics/initialize_features.md @@ -2,6 +2,8 @@ Author: Shenggui Li, Siqi Mai +> ⚠️ The information on this page is outdated and will be deprecated. Please check [Booster API](../basics/booster_api.md) for more information. + **Prerequisite:** - [Distributed Training](../concepts/distributed_training.md) - [Colossal-AI Overview](../concepts/colossalai_overview.md) From 1bf59add678c5556a8182f41ce39a5eaf25611b2 Mon Sep 17 00:00:00 2001 From: Yanjia0 <42895286+Yanjia0@users.noreply.github.com> Date: Wed, 17 May 2023 11:46:05 +0800 Subject: [PATCH 06/12] Update model_checkpoint.md --- docs/source/en/basics/model_checkpoint.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/source/en/basics/model_checkpoint.md b/docs/source/en/basics/model_checkpoint.md index 09d44e7c2709..70334f1c41e7 100644 --- a/docs/source/en/basics/model_checkpoint.md +++ b/docs/source/en/basics/model_checkpoint.md @@ -2,6 +2,8 @@ Author : Guangyang Lu +> ⚠️ The information on this page is outdated and will be deprecated. Please check [Booster Checkpoint](../basics/booster_checkpoint.md) for more information. + **Prerequisite:** - [Launch Colossal-AI](./launch_colossalai.md) - [Initialize Colossal-AI](./initialize_features.md) From e309a759e4c9fe92327379aca1267e9d1a5abf0d Mon Sep 17 00:00:00 2001 From: Yanjia0 <42895286+Yanjia0@users.noreply.github.com> Date: Wed, 17 May 2023 11:46:55 +0800 Subject: [PATCH 07/12] Update colotensor_concept.md --- docs/source/zh-Hans/basics/colotensor_concept.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/source/zh-Hans/basics/colotensor_concept.md b/docs/source/zh-Hans/basics/colotensor_concept.md index d6a332df2e9c..b725e48a7cb1 100644 --- a/docs/source/zh-Hans/basics/colotensor_concept.md +++ b/docs/source/zh-Hans/basics/colotensor_concept.md @@ -2,6 +2,8 @@ Author: [Jiarui Fang](https://github.com/feifeibear), [Hongxin Liu](https://github.com/ver217) and [Haichen Huang](https://github.com/1SAA) +> ⚠️ 此页面上的信息已经过时并将被废弃。 + **Prerequisite:** - [Colossal-AI Overview](../concepts/colossalai_overview.md) - [Distributed Training](../concepts/distributed_training.md) From a702684e03aad7a50d5c1cde99e87292b82a9b46 Mon Sep 17 00:00:00 2001 From: Yanjia0 <42895286+Yanjia0@users.noreply.github.com> Date: Wed, 17 May 2023 11:47:17 +0800 Subject: [PATCH 08/12] Update configure_parallelization.md --- docs/source/zh-Hans/basics/configure_parallelization.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/source/zh-Hans/basics/configure_parallelization.md b/docs/source/zh-Hans/basics/configure_parallelization.md index eb4b38f48ddb..0c2a66572d60 100644 --- a/docs/source/zh-Hans/basics/configure_parallelization.md +++ b/docs/source/zh-Hans/basics/configure_parallelization.md @@ -2,6 +2,8 @@ 作者: Shenggui Li, Siqi Mai +> ⚠️ 此页面上的信息已经过时并将被废弃。请在[Booster插件](../basics/booster_plugins.md)页面查阅更新。 + **预备知识:** - [分布式训练](../concepts/distributed_training.md) - [并行技术](../concepts/paradigms_of_parallelism.md) From ce439eb75df9ae3927154deb7a7e4a30ff8ce945 Mon Sep 17 00:00:00 2001 From: Yanjia0 <42895286+Yanjia0@users.noreply.github.com> Date: Wed, 17 May 2023 11:47:42 +0800 Subject: [PATCH 09/12] Update define_your_config.md --- docs/source/zh-Hans/basics/define_your_config.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/source/zh-Hans/basics/define_your_config.md b/docs/source/zh-Hans/basics/define_your_config.md index d7e49cbf23de..720e75805e8d 100644 --- a/docs/source/zh-Hans/basics/define_your_config.md +++ b/docs/source/zh-Hans/basics/define_your_config.md @@ -2,6 +2,8 @@ 作者: Guangyang Lu, Shenggui Li, Siqi Mai +> ⚠️ 此页面上的信息已经过时并将被废弃。请在[Booster API](../basics/booster_api.md)页面查阅更新。 + **预备知识:** - [分布式训练](../concepts/distributed_training.md) - [Colossal-AI 总览](../concepts/colossalai_overview.md) From ac545a64cc41e24cacca7d7716778fde6a51624c Mon Sep 17 00:00:00 2001 From: Yanjia0 <42895286+Yanjia0@users.noreply.github.com> Date: Wed, 17 May 2023 11:47:59 +0800 Subject: [PATCH 10/12] Update engine_trainer.md --- docs/source/zh-Hans/basics/engine_trainer.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/source/zh-Hans/basics/engine_trainer.md b/docs/source/zh-Hans/basics/engine_trainer.md index a7519bfca14f..a35bd87c44e1 100644 --- a/docs/source/zh-Hans/basics/engine_trainer.md +++ b/docs/source/zh-Hans/basics/engine_trainer.md @@ -2,6 +2,8 @@ 作者: Shenggui Li, Siqi Mai +> ⚠️ 此页面上的信息已经过时并将被废弃。请在[Booster API](../basics/booster_api.md)页面查阅更新。 + **预备知识:** - [初始化功能](./initialize_features.md) From 27a763b9e975763c274e5dc432546452f8c63237 Mon Sep 17 00:00:00 2001 From: Yanjia0 <42895286+Yanjia0@users.noreply.github.com> Date: Wed, 17 May 2023 11:48:20 +0800 Subject: [PATCH 11/12] Update initialize_features.md --- docs/source/zh-Hans/basics/initialize_features.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/source/zh-Hans/basics/initialize_features.md b/docs/source/zh-Hans/basics/initialize_features.md index 67ea114b42b2..1c28d658e1bc 100644 --- a/docs/source/zh-Hans/basics/initialize_features.md +++ b/docs/source/zh-Hans/basics/initialize_features.md @@ -2,6 +2,8 @@ 作者: Shenggui Li, Siqi Mai +> ⚠️ 此页面上的信息已经过时并将被废弃。请在[Booster API](../basics/booster_api.md)页面查阅更新。 + **预备知识:** - [分布式训练](../concepts/distributed_training.md) - [Colossal-AI 总览](../concepts/colossalai_overview.md) From 8e4516303c2e70fb5e25dfadb3a511c42bcbe06b Mon Sep 17 00:00:00 2001 From: Yanjia0 <42895286+Yanjia0@users.noreply.github.com> Date: Wed, 17 May 2023 11:49:44 +0800 Subject: [PATCH 12/12] Update model_checkpoint.md --- docs/source/zh-Hans/basics/model_checkpoint.md | 10 ++++++---- 1 file changed, 6 insertions(+), 4 deletions(-) diff --git a/docs/source/zh-Hans/basics/model_checkpoint.md b/docs/source/zh-Hans/basics/model_checkpoint.md index cec12d451989..a5374b7509c9 100644 --- a/docs/source/zh-Hans/basics/model_checkpoint.md +++ b/docs/source/zh-Hans/basics/model_checkpoint.md @@ -1,7 +1,9 @@ -# 模型检查点 +# 模型Checkpoint 作者 : Guangyang Lu +> ⚠️ 此页面上的信息已经过时并将被废弃。请在[Booster Checkpoint](../basics/booster_checkpoint.md)页面查阅更新。 + **预备知识:** - [Launch Colossal-AI](./launch_colossalai.md) - [Initialize Colossal-AI](./initialize_features.md) @@ -13,9 +15,9 @@ ## 简介 -本教程将介绍如何保存和加载模型检查点。 +本教程将介绍如何保存和加载模型Checkpoint。 -为了充分利用Colossal-AI的强大并行策略，我们需要修改模型和张量，可以直接使用 `torch.save` 或者 `torch.load` 保存或加载模型检查点。在Colossal-AI中，我们提供了应用程序接口实现上述同样的效果。 +为了充分利用Colossal-AI的强大并行策略，我们需要修改模型和张量，可以直接使用 `torch.save` 或者 `torch.load` 保存或加载模型Checkpoint。在Colossal-AI中，我们提供了应用程序接口实现上述同样的效果。 但是，在加载时，你不需要使用与存储相同的保存策略。 @@ -24,7 +26,7 @@ ### 保存 有两种方法可以使用Colossal-AI训练模型，即使用engine或使用trainer。 -**注意我们只保存 `state_dict`.** 因此，在加载检查点时，需要首先定义模型。 +**注意我们只保存 `state_dict`.** 因此，在加载Checkpoint时，需要首先定义模型。 #### 同 engine 保存