You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
There are 4 existing strategies implemented in coati/strategies/....
The issue aims to refactor DDPStrategy and ColossalAIStrategy classes with the new booster API.
TODOs
Refactor base Strategy class with booster API.
Refactor NaiveStrategy class using plugin=None.
Refactor DDPStrategy class using TorchDDPPlugin.
Refactor ColossalAIStrategy class using GeminiPlugin, LowLevelZeroPlugin.
Description
There are 4 existing strategies implemented in
coati/strategies/....The issue aims to refactor
DDPStrategyandColossalAIStrategyclasses with the new booster API.TODOs
Strategyclass with booster API.NaiveStrategyclass usingplugin=None.DDPStrategyclass usingTorchDDPPlugin.ColossalAIStrategyclass usingGeminiPlugin,LowLevelZeroPlugin.