Skip to content

DDP training code and logging the metrics in wandb.#47

Open
surajiitd wants to merge 2 commits intodrinkingcoder:mainfrom
surajiitd:main
Open

DDP training code and logging the metrics in wandb.#47
surajiitd wants to merge 2 commits intodrinkingcoder:mainfrom
surajiitd:main

Conversation

@surajiitd
Copy link

@surajiitd surajiitd commented Feb 23, 2024

Just made these changes:

  1. written DDP code for training and validation for faster training and validation.
  2. resolved bug in gma.py and encoders.py (these modules were not used while forward, so it was giving "all params not reduced after one step" error.
  3. written wandb logging code for training and validation metrics.

@mahao18cm mahao18cm mentioned this pull request Jun 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant