Skip to content

[autoparallel] adapt autoparallel with new analyzer#3261

Merged
FrankLeeeee merged 4 commits intohpcaitech:mainfrom
YuliangLiu0306:feature/test_new_tracer_on_auto_parallel
Mar 30, 2023
Merged

[autoparallel] adapt autoparallel with new analyzer#3261
FrankLeeeee merged 4 commits intohpcaitech:mainfrom
YuliangLiu0306:feature/test_new_tracer_on_auto_parallel

Conversation

@YuliangLiu0306
Copy link
Copy Markdown
Contributor

@YuliangLiu0306 YuliangLiu0306 commented Mar 27, 2023

📌 Checklist before creating the PR

  • I have created an issue for this PR for traceability
  • The title follows the standard format: [doc/gemini/tensor/...]: A concise description
  • I have added relevant tags if possible for us to better distinguish different PRs

🚨 Issue number

Link this PR to your issue with words like fixed to automatically close the linked issue upon merge

e.g. fixed #1234, closed #1234, resolved #1234

part of #3278

📝 What does this PR do?

Summarize your work here.
if you have any plots/diagrams/screenshots/tables, please attach them here.

💥 Checklist before requesting a review

  • I have linked my PR to an issue (instruction)
  • My issue clearly describes the problem/feature/proposal, with diagrams/charts/table/code if possible
  • I have performed a self-review of my code
  • I have added thorough tests.
  • I have added docstrings for all the functions/methods I implemented

⭐️ Do you enjoy contributing to Colossal-AI?

  • 🌝 Yes, I do.
  • 🌚 No, I don't.

Tell us more if you don't enjoy contributing to Colossal-AI.

@YuliangLiu0306 YuliangLiu0306 added Run Build and Test auto-parallel related to the auto-parallel feature labels Mar 27, 2023
@github-actions
Copy link
Copy Markdown
Contributor

The code coverage for the changed files is 19%.

Click me to view the complete report
Name                                                                                       Stmts   Miss  Cover
--------------------------------------------------------------------------------------------------------------
colossalai/_analyzer/_subclasses/_meta_registration.py                                       232    214     8%
colossalai/_analyzer/fx/passes/shape_prop.py                                                  84     60    29%
colossalai/auto_parallel/meta_profiler/metainfo.py                                            63     44    30%
colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py                             56     35    38%
colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py     388    319    18%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_getitem_handler.py         117     81    31%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_matmul_handler.py           93     77    17%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_sum_handler.py             182    152    16%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/utils.py                        125    106    15%
--------------------------------------------------------------------------------------------------------------
TOTAL                                                                                       1340   1088    19%

@github-actions
Copy link
Copy Markdown
Contributor

The code coverage for the changed files is 21%.

Click me to view the complete report
Name                                                                                                 Stmts   Miss  Cover
------------------------------------------------------------------------------------------------------------------------
colossalai/_analyzer/_subclasses/_meta_registration.py                                                 227    209     8%
colossalai/_analyzer/fx/passes/shape_prop.py                                                           101     76    25%
colossalai/_analyzer/fx/tracer/bias_addition.py                                                         78     53    32%
colossalai/auto_parallel/meta_profiler/metainfo.py                                                      63     44    30%
colossalai/auto_parallel/passes/runtime_preparation_pass.py                                            296    183    38%
colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py                                       56     35    38%
colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py               388    319    18%
colossalai/fx/_meta_regist_12.py                                                                       257    257     0%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_addmm_handler.py                     116     85    27%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_batch_norm_handler.py                 70     47    33%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_bias_linear_function_node.py         106     78    26%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_bias_linear_module_node.py           103     77    25%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_binary_elementwise_handler.py        176    137    22%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_bmm_handler.py                       144    114    21%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_conv_handler.py                      196    165    16%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_default_reshape_handler.py            52     36    31%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_embedding_handler.py                 182    146    20%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_getattr_handler.py                    49     34    31%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_getitem_handler.py                   117     81    31%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_layer_norm_handler.py                 73     49    33%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_linear_handler.py                    206    177    14%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_matmul_handler.py                     93     77    17%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_norm_pooling_handler.py               42     28    33%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_output_handler.py                     44     26    41%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_permute_and_transpose_handler.py     250    216    14%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_placeholder_handler.py                50     32    36%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_shard_option.py                       72     54    25%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_softmax_handler.py                   130    100    23%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_split_handler.py                     191    157    18%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_sum_handler.py                       181    152    16%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_tensor_constructor.py                 43     28    35%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_unary_element_wise_handler.py         53     37    30%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_view_handler.py                      190    157    17%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/test_where_handler.py                      57     42    26%
tests/test_auto_parallel/test_tensor_shard/test_node_handler/utils.py                                  125    106    15%
tests/test_fx/test_pipeline/test_topo/test_topo.py                                                      26     17    35%
------------------------------------------------------------------------------------------------------------------------
TOTAL                                                                                                 4603   3631    21%

@FrankLeeeee FrankLeeeee merged commit fee2af8 into hpcaitech:main Mar 30, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto-parallel related to the auto-parallel feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants