Skip to content

Allow turning off loss scaling wrt GAS + update tput calculator#2140

Merged
jeffra merged 5 commits intomasterfrom
jeffra/fs-gas-fix-v3
Jul 26, 2022
Merged

Allow turning off loss scaling wrt GAS + update tput calculator#2140
jeffra merged 5 commits intomasterfrom
jeffra/fs-gas-fix-v3

Conversation

@jeffra
Copy link
Collaborator

@jeffra jeffra commented Jul 26, 2022

  • Let the client turn on/off loss scaling when gradient accumulation is enabled
  • Current tput calculator is a running average, update print to show both current and average tput values

@jeffra jeffra merged commit 5bd09a8 into master Jul 26, 2022
@jeffra jeffra deleted the jeffra/fs-gas-fix-v3 branch July 26, 2022 20:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants