DFM Performance Improvements#45

Merged

abhinavg4 merged 92 commits intomainfrom

pmannan/dfm_perf

Nov 21, 2025

Commits on Oct 30, 2025

first commit
Huy Vu2
committed
workable code
Huy Vu2
committed

Commits on Oct 31, 2025

workable thd
Huy Vu2
committed
clean up, remove all CP for sbhd, CP now is only for thd
Huy Vu2
committed
run outside of Mbridge
Huy Vu2
committed

Commits on Nov 3, 2025

Commits on Nov 4, 2025

refactor attention submodules + reorder files locations
Huy Vu2
committed
update refactor
Huy Vu2
committed
update refactor
Huy Vu2
committed
reorganize files
Huy Vu2
committed
reorganize files
Huy Vu2
committed

Commits on Nov 5, 2025

refactoring code
Huy Vu2
committed
add README for perf test
Huy Vu2
committed
using vae, t5, scheduler from Diffusers
Huy Vu2
committed
update repo, remove Wan's Github moduels
Huy Vu2
committed

Commits on Nov 6, 2025

Merge remote-tracking branch 'origin/main' into huvu/mcore_wan
Huy Vu2
committed
fix Ruff
Huy Vu2
committed
fix ruff + copyright
Huy Vu2
committed
fix Ruff + Lint
Huy Vu2
committed
fix Ruff + Lint
Huy Vu2
committed
fix Ruff + Lint
Huy Vu2
committed
fix Ruff + Lint
Huy Vu2
committed
fix Ruff + Lint
Huy Vu2
committed
fix Ruff + Lint
Huy Vu2
committed
fix Ruff + Lint
Huy Vu2
committed
fix Ruff + Lint
Huy Vu2
committed
Merge remote-tracking branch 'origin/main' into huvu/mcore_wan
Huy Vu2
committed
merged main + address comments
Huy Vu2
committed
remove example_commands.md, Google waits until mid Nov
Huy Vu2
committed
refactor inference_configs + mockdatamodule
root
committed
add dit_embeddings.py
Huy Vu2
committed
fix lint ruff
Huy Vu2
committed

Commits on Nov 7, 2025

add 'average_gradients_across_tp_domain' to torch.nn for when running sequence_parallelism
Huy Vu2
committed
merge from main
Huy Vu2
committed
add english negative prompt
Huy Vu2
committed
fix ruff lint
Huy Vu2
committed
Update uv.lock for deps: diffusers==0.35.1, easydict, imageio
root
committed
update dfm/src/megatron/data/dit
Huy Vu2
committed

Commits on Nov 8, 2025

change english negative prompt
Huy Vu2
committed

Commits on Nov 10, 2025

seem to workable seq_packing
Huy Vu2
committed
refactor with Sajad's PR - DiT data to common dir
Huy Vu2
committed
fix Ruff, lint
Huy Vu2
committed
fix Ruff, lint
Huy Vu2
committed
fix Ruff, lint
Huy Vu2
committed

Commits on Nov 11, 2025

workable mock datamodule (doesn't need setting path); updated training algo + hyper-parameters aligning with Linnan; tested training with anime dataset finetung
Huy Vu2
committed
merge main
Huy Vu2
committed
bring wan_task encoders features to common, sharing with dit
Huy Vu2
committed
lint, ruff
Huy Vu2
committed
lint, ruff
Huy Vu2
committed
lint, ruff
Huy Vu2
committed

Commits on Nov 12, 2025

fix CP error (input of thd_split_inputs_cp to be cu_seqlens_q_padded instead of cu_seqlens_q)
Huy Vu2
committed
udpate README_perf_test.md
Huy Vu2
committed
fix lint, ruff
Huy Vu2
committed
update uv.lock, merge main
Huy Vu2
committed
update uv.lock, merge main
Huy Vu2
committed
uv.lock
Huy Vu2
committed
uv.lock
Huy Vu2
committed
uv.lock
Huy Vu2
committed
update uv.lock [using ci]
pablo-garay
committed

Commits on Nov 13, 2025

Performance improvements to Wan
parthmannan
committed

Commits on Nov 15, 2025

Commits on Nov 17, 2025

Commits on Nov 18, 2025

Commits on Nov 20, 2025

Commits on Nov 21, 2025