[autoparallel] bypass MetaInfo when unavailable and modify BCAST_FUNC_OP metainfo#2293

Merged

Cypher30 merged 11 commits intohpcaitech:debug/ckpt-autoparallelfrom

Cypher30:debug/ckpt-autoparallel

Jan 3, 2023

Commits on Jan 3, 2023

[autoparallel] align the data_ptr with the old version of auto activation checkpoint pipeline
Cypher30
committed
[autoparallel] using fwd_time and bwd_time instead of fwd_flop and bwd_flop
Cypher30
committed
[autoparallel] specifycomm nodes' memory cost in construct chain
Cypher30
committed
Merge branch 'hpcaitech:debug/ckpt-autoparallel' into debug/ckpt-autoparallel
Cypher30
authored
[autoparallel] fix wrong runtime apply calculation
Cypher30
committed
[autoparallel] fix wrong runtime apply calculation
Cypher30
committed
[autoparallel] fix wrong runtime apply calculation
Cypher30
committed
Merge branch 'hpcaitech:debug/ckpt-autoparallel' into debug/ckpt-autoparallel
Cypher30
authored
[autoparallel] bypass metainfo when available and modify BCAST_FUNC_OP
Cypher30
committed
Merge branch 'hpcaitech:debug/ckpt-autoparallel' into debug/ckpt-autoparallel
Cypher30
authored
Merge branch 'debug/ckpt-autoparallel' of github.com:Cypher30/ColossalAI into debug/ckpt-autoparallel
Cypher30
committed