[shardformer, pipeline] add gradient_checkpointing_ratio and heterogenous shard policy for llama#5508
Merged
cwher merged 21 commits intohpcaitech:mainfrom Apr 1, 2024
Merged
[shardformer, pipeline] add gradient_checkpointing_ratio and heterogenous shard policy for llama#5508cwher merged 21 commits intohpcaitech:mainfrom
gradient_checkpointing_ratio and heterogenous shard policy for llama#5508cwher merged 21 commits intohpcaitech:mainfrom
Commits
Commits on Mar 27, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
Commits on Mar 29, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed