Skip to content

[autockpt] make solver work on resnet.#2257

Merged
super-dainiu merged 1 commit intohpcaitech:debug/ckpt-autoparallelfrom
super-dainiu:debug/ckpt-autoparallel
Jan 2, 2023
Merged

[autockpt] make solver work on resnet.#2257
super-dainiu merged 1 commit intohpcaitech:debug/ckpt-autoparallelfrom
super-dainiu:debug/ckpt-autoparallel

Conversation

@super-dainiu
Copy link
Copy Markdown
Contributor

Append these few lines after SPMD solver. It works now.

Config:
ResNet50, bs = 512, device_mesh = [[0, 1], [2, 3]]

solver = CheckpointSolverRotor(gm.graph, free_memory=10*1024**3)
solver.print_chain()
gm.graph = solver.solve()
print(gm.code)

@super-dainiu super-dainiu merged commit 3ccf58a into hpcaitech:debug/ckpt-autoparallel Jan 2, 2023
@super-dainiu super-dainiu changed the title [autockpt] make it work. [autockpt] make solver work on resnet. Jan 2, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant