## Overview A design of sharded optimizer checkpoint is decribed in https://github.com/hpcaitech/ColossalAI/discussions/3339. ## Goal Implement general sharded optimizer checkpoint.
Overview
A design of sharded optimizer checkpoint is decribed in #3339.
Goal
Implement general sharded optimizer checkpoint.