[autoparallel]integrate auto parallel feature with new tracer

[YuliangLiu0306]

📌 Checklist before creating the PR

• I have created an issue for this PR for traceability
• The title follows the standard format: [doc/gemini/tensor/...]: A concise description
• I have added relevant tags if possible for us to better distinguish different PRs

🚨 Issue number

part of #3278

📝 What does this PR do?

Summarize your work here.
if you have any plots/diagrams/screenshots/tables, please attach them here.

💥 Checklist before requesting a review

• I have linked my PR to an issue (instruction)
• My issue clearly describes the problem/feature/proposal, with diagrams/charts/table/code if possible
• I have performed a self-review of my code
• I have added thorough tests.
• I have added docstrings for all the functions/methods I implemented

⭐️ Do you enjoy contributing to Colossal-AI?

• 🌝 Yes, I do.
• 🌚 No, I don't.

Tell us more if you don't enjoy contributing to Colossal-AI.

[github-actions]

The code coverage for the changed files is 25%.

Click me to view the complete report

Name                                                                                   Stmts   Miss  Cover
----------------------------------------------------------------------------------------------------------
colossalai/_analyzer/_subclasses/flop_tensor.py                                          252    218    13%
colossalai/_analyzer/fx/codegen.py                                                       244    223     9%
colossalai/_analyzer/fx/node_util.py                                                      97     50    48%
colossalai/_analyzer/fx/passes/shape_prop.py                                             104     79    24%
colossalai/_analyzer/fx/tracer/bias_addition.py                                           60     35    42%
colossalai/_analyzer/fx/tracer/tracer.py                                                 222    174    22%
colossalai/auto_parallel/meta_profiler/__init__.py                                         3      0   100%
colossalai/auto_parallel/meta_profiler/meta_registry/activation.py                        28     15    46%
colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py            26     16    38%
colossalai/auto_parallel/meta_profiler/meta_registry/conv.py                              48     33    31%
colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py                         23     14    39%
colossalai/auto_parallel/meta_profiler/meta_registry/linear.py                           114    100    12%
colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py                          15      4    73%
colossalai/auto_parallel/meta_profiler/meta_registry/norm.py                              57     43    25%
colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py                           51     36    29%
colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py                            25     12    52%
colossalai/auto_parallel/meta_profiler/meta_registry/where.py                             25     16    36%
colossalai/auto_parallel/meta_profiler/shard_metainfo.py                                  63     44    30%
colossalai/auto_parallel/passes/comm_metainfo_pass.py                                     60     60     0%
colossalai/auto_parallel/passes/meta_info_prop.py                                         94     94     0%
colossalai/auto_parallel/passes/runtime_apply_pass.py                                    148    129    13%
colossalai/auto_parallel/passes/runtime_preparation_pass.py                              297    227    24%
colossalai/auto_parallel/tensor_shard/initialize.py                                      123    116     6%
colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py                  28     15    46%
colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py                       164    136    17%
colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py                   116     97    16%
tests/test_analyzer/__init__.py                                                            0      0   100%
tests/test_auto_parallel/test_pass/test_size_value_converting_pass.py                     55     39    29%
tests/test_auto_parallel/test_tensor_shard/test_bias_addition_forward.py                  69     41    41%
tests/test_auto_parallel/test_tensor_shard/test_checkpoint.py                             55     26    53%
tests/test_auto_parallel/test_tensor_shard/test_compatibility_with_ddp.py                 81     55    32%
tests/test_auto_parallel/test_tensor_shard/test_compatibility_with_gemini.py              87     57    34%
tests/test_auto_parallel/test_tensor_shard/test_find_repeat_block.py                      78     47    40%
tests/test_auto_parallel/test_tensor_shard/test_gpt/test_runtime_with_gpt_modules.py     140     96    31%
tests/test_auto_parallel/test_tensor_shard/test_gpt/test_solver_with_gpt_module.py        67     46    31%
tests/test_auto_parallel/test_tensor_shard/test_liveness_analysis.py                      40     27    32%
tests/test_auto_parallel/test_tensor_shard/test_metainfo/test_embedding_metainfo.py       45     26    42%
tests/test_auto_parallel/test_tensor_shard/test_metainfo/test_linear_metainfo.py          59     29    51%
tests/test_auto_parallel/test_tensor_shard/test_metainfo/test_matmul_metainfo.py          48     28    42%
tests/test_auto_parallel/test_tensor_shard/test_metainfo/test_norm_metainfo.py            68     44    35%
tests/test_auto_parallel/test_tensor_shard/test_metainfo/test_tensor_metainfo.py          50     28    44%
tests/test_auto_parallel/test_tensor_shard/test_metainfo/test_where_metainfo.py           51     33    35%
tests/test_auto_parallel/test_tensor_shard/test_metainfo/utils.py                         94     77    18%
tests/test_auto_parallel/test_tensor_shard/test_solver_with_resnet_v2.py                  56     42    25%
----------------------------------------------------------------------------------------------------------
TOTAL                                                                                   3630   2727    25%