Skip to content

[fx] refactor tracer to trace complete graph#1342

Merged
FrankLeeeee merged 35 commits intohpcaitech:mainfrom
YuliangLiu0306:feature/refactor_tracer_to_trace_complete_graph
Jul 20, 2022
Merged

[fx] refactor tracer to trace complete graph#1342
FrankLeeeee merged 35 commits intohpcaitech:mainfrom
YuliangLiu0306:feature/refactor_tracer_to_trace_complete_graph

Conversation

@YuliangLiu0306
Copy link
Copy Markdown
Contributor

Previously, when we call ColoProxy.shape, a torch.Size instance will be returned, instead of another ColoProxy as expected. It may leads to the tracing process temporarily stop until the forward function uses other ColoProxys.
To solve this issue, in this PR, we will create a new ColoProxy for getattr function, then tracing process could get complete graph.

YuliangLiu0306 and others added 30 commits April 13, 2022 17:30
Comment thread colossalai/fx/tracer/tracer.py
Comment thread colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py Outdated
Comment thread colossalai/fx/tracer/_tracer_utils.py
@FrankLeeeee
Copy link
Copy Markdown
Contributor

test_transform_mlp_pass.py has been deleted, resolve the conflict.

@YuliangLiu0306
Copy link
Copy Markdown
Contributor Author

image

@FrankLeeeee FrankLeeeee merged commit 942c8cd into hpcaitech:main Jul 20, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants