[gemini] support amp o3 for gemini#4872

Merged

ver217 merged 8 commits intohpcaitech:mainfrom

ver217:feature/gemini-master-weight

Oct 12, 2023

Commits on Oct 7, 2023

[gemini] support no reuse fp16 chunk
ver217
committed

Commits on Oct 9, 2023

[plugin] update gemini plugin
ver217
committed

Commits on Oct 10, 2023

[test] fix gemini checkpointio test
ver217
committed

Commits on Oct 11, 2023

[test] fix gemini checkpoint io
ver217
committed