[autockpt] provide option for activation checkpoint search in SPMD solver#2258

Merged

Cypher30 merged 10 commits intomainfrom

debug/ckpt-autoparallel

Jan 4, 2023

Commits on Jan 2, 2023

[autoparallel] Hook all meta information on ResNet nodes for auto activation checkpoint (#2248)
Cypher30
authored
[autoparallel] modify construct chain in rotor solver (#2254)
Cypher30
authored
[autockpt] make it work. (#2257)
super-dainiu
authored

Commits on Jan 3, 2023

[autoparallel] align the data_ptr with the old version of auto activation checkpoint pipeline (#2261)
Cypher30
authored
[autoparallel] modify comm nodes' memory cost in construct chain (#2263)
Cypher30
authored
[autockpt] linearize / merge shape-consistency nodes. (#2271)
super-dainiu
authored
[autockpt] considering parameter and optimizer weights. (#2279)
super-dainiu
authored
[autoparallel] fix runtime apply memory estimation (#2281)
Cypher30
authored
[hotfix] pass a parameter. (#2288)
super-dainiu
authored
[autoparallel] bypass MetaInfo when unavailable and modify BCAST_FUNC_OP metainfo (#2293)
Cypher30
authored