[autoparallel] modify comm nodes' memory cost in construct chain#2263

Merged

Cypher30 merged 4 commits intohpcaitech:debug/ckpt-autoparallelfrom

Cypher30:debug/ckpt-autoparallel

Jan 3, 2023

Commits on Jan 3, 2023

[autoparallel] align the data_ptr with the old version of auto activation checkpoint pipeline
Cypher30
committed
[autoparallel] using fwd_time and bwd_time instead of fwd_flop and bwd_flop
Cypher30
committed
[autoparallel] specifycomm nodes' memory cost in construct chain
Cypher30
committed
Merge branch 'hpcaitech:debug/ckpt-autoparallel' into debug/ckpt-autoparallel
Cypher30
authored