Skip to content

Support AdamW optimizer type#670

Merged
tjruwase merged 2 commits intomasterfrom
olruwase/adam_types
Jan 15, 2021
Merged

Support AdamW optimizer type#670
tjruwase merged 2 commits intomasterfrom
olruwase/adam_types

Conversation

@tjruwase
Copy link
Contributor

Support AdamW optimizer type and ZeRO supported.

@tjruwase tjruwase linked an issue Jan 15, 2021 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Adam vs AdamW - request to simplify the configuration

2 participants