Tracking issues for migrating integration tests

[CharlesCheung96]

This issues is used to track the progress of integration test migration. We plan to support all necessary integration tests by the end of February.

If you intend to help migrate a specific integration test, please @ yourself at the end of the case name to avoid conflicts in work.

P0 (1 / 1 task)

• Migrate the integration test framework

P1 ( 73 / 73 tasks, mysql sink type)

• api_v2 @asddongmen test: fix more it cases #839
• autorandom
• bank
• batch_add_table
• batch_update_to_no_batch
• bdr_mode @wk989898
• cdc found ineligible table in the downstream #898
• cdc_server_tips
• changefeed_finish
• changefeed_pause_resume @hongyunyan
• changefeed_reconstruct
• charset_gbk
• ci_collation_compatibility
• cli_tls_with_auth cdc exit after deleting service-gc-safepoint #862 @wk989898 @asddongmen test: fix a couple of cli it cases #869
• cli_with_auth cdc exit after deleting service-gc-safepoint #862 @wk989898 @asddongmen test: fix a couple of cli it cases #869
• clustered_index @asddongmen (Not useful for new arch, since the tidb_enable_clustered_index is set to on by default in TiDB since v7.1.0. ) test: fix some integration tests 1 #793
• common_1 @asddongmen test: fix some integration tests 1 #793
• consistent_replicate_nfs
• ddl_attributes @wk989898 test: add more storage integration tests #1608
• ddl_puller_lag [Not useful for new arch] @asddongmen test: fix some integration tests 1 #793
• ddl_reentrant
• ddl_sequence
• default_value @asddongmen @lidezhu cdc panic at region_event_handler.go #794
• drop_many_tables @asddongmen tests: add more integration test cases #802
• force_replicate_table @asddongmen
• foreign_key @asddongmen test: fix some integration tests 1 #793
• generate_column @asddongmen test: fix generate_column integration test case #797
• http_api @asddongmen test: fix more it cases #839
• http_api_tls @asddongmen test: fix more http api related test cases #857
• http_api_tls_with_user_auth @asddongmen test: fix more http api related test cases #857
• http_proxies @asddongmen ci: add test case http_proxies #863
• many_pk_or_uk @asddongmen tests: add more integration test cases #802
• move_table @asddongmen api: fix move table API #906
• multi_capture
• multi_cdc_cluster
• multi_rocks
• multi_source @hongyunyan
• multi_tables_ddl @lidezhu @hongyunyan Support to pass error in ddlEvent #937 test: enable multi_tables_ddl test #949
• new_ci_collation @asddongmen tests: add more integration test cases #802
• partition_table @asddongmen @lidezhu
• region_merge @asddongmen tests: add more integration test cases #802
• resolve_lock resolvedTs is fallen back in subscription client #866 @wk989898 @lidezhu
• resource control
• row_format
• safe_mode test: fix safe mode test  #809
• savepoint
• sequence
• server_config_compatibility
• simple @wk989898
• split_region
• sql_mode
• tidb_mysql_test
• tiflash
• vector
• fail_over @hongyunyan
• fail_over_ddl_A @hongyunyan
• fail_over_ddl_B @hongyunyan
• fail_over_ddl_C @hongyunyan
• fail_over_ddl_D @hongyunyan
• fail_over_ddl_E @hongyunyan
• fail_over_ddl_F @hongyunyan
• fail_over_ddl_G @hongyunyan
• fail_over_ddl_H @hongyunyan
• fail_over_ddl_I @hongyunyan
• fail_over_ddl_J @hongyunyan
• fail_over_ddl_K @hongyunyan
• fail_over_ddl_L @hongyunyan
• fail_over_ddl_M @hongyunyan
• fail_over_ddl_N @hongyunyan
• fail_over_ddl_O @hongyunyan
• fail_over_ddl_mix @hongyunyan
• fail_over_ddl_mix_with_syncpoint @hongyunyan
• overwrite_resume_with_syncpoint @hongyunyan

P2 (35 / 35 tasks, no mysql sink type)

• avro_basic @wk989898
• canal_json_adapter_compatibility
• canal_json_basic @wk989898
• canal_json_claim_check @wk989898
• canal_json_content_compatible @wk989898
• canal_json_handle_key_only @wk989898
• canal_json_storage_basic @wk989898
• canal_json_storage_partition_table
• csv_storage_basic @wk989898
• csv_storage_multi_tables_ddl @wk989898
• csv_storage_partition_table
• csv_storage_update_pk_clustered ticdc should split primary or unique key UPDATE events for non-MySQL sinks #983
• csv_storage_update_pk_nonclustered ticdc should split primary or unique key UPDATE events for non-MySQL sinks #983
• debezium @wk989898
• debezium_basic @wk989898
• kafka_big_messages kafka dml worker batch failed #872 @wk989898
• kafka_big_messages_v2 kafka dml worker batch failed #872 @wk989898
• kafka_column_selector @wk989898
• kafka_column_selector_avro
• kafka_compression @wk989898
• kafka_messages @wk989898
• kafka_simple_basic @wk989898
• kafka_simple_basic_avro @wk989898
• kafka_simple_claim_check @wk989898
• kafka_simple_claim_check_avro @wk989898
• kafka_simple_handle_key_only @wk989898
• kafka_simple_handle_key_only_avro @wk989898
• lossy_ddl @wk989898
• mq_sink_dispatcher @wk989898
• multi_topics test: fix multi_topics test #1058 @wk989898
• multi_topics_v2 @wk989898
• open_protocol_claim_check coordinator: send checkpointTs message when changefeed state is finished #1039 @wk989898
• open_protocol_handle_key_only @wk989898
• storage_cleanup sink: add checkpointTs message for storage sink #1035 @wk989898
• storage_csv_update ticdc should split primary or unique key UPDATE events for non-MySQL sinks #983

P3(30 / 32 tasks, With failpoint enabled)

• availability @asddongmen test: fix more it cases #839
• capture_session_done_during_task @asddongmen *: Improve cdc server exit logic #926
• capture_suicide_while_balance_table @asddongmen test: fix integration test capture_suicide_while_balance_table  #952
• changefeed_auto_stop [Not useful for new arch] @asddongmen *: fix several integration test cases #943
• changefeed_dup_error_restart @asddongmen *: fix several integration test cases #943
• changefeed_error @asddongmen test: fix integration test changefeed_error #930
• changefeed_fast_fail @asddongmen test: fix intetragion test case changefeed_fast_fail #916
• changefeed_resume_with_checkpoint_ts @asddongmen test: fix integration test capture_suicide_while_balance_table  #952
• consistent_partition_table
• consistent_replicate_ddl
• consistent_replicate_gbk
• consistent_replicate_storage_file
• consistent_replicate_storage_file_large_value
• consistent_replicate_storage_s3
• ddl_manager [Not useful for new arch] @asddongmen test: fix some integration tests 1 #793
• ddl_only_block_related_table [Not useful for new arch] @asddongmen test: fix some integration tests 1 #793
• event_filter feat(filter): Implement a Efficient DML/DDL Event Filtering Mechanism #1612
• gc_safepoint @asddongmen test: fix gc_safepoint  #950
• mq_sink_error_resume test: fix incorrect failpoint injection #1481
• kill_owner_with_ddl [Included in failover cases] @hongyunyan
• kv_client_stream_reconnect @asddongmen test: fix integration test capture_suicide_while_balance_table  #952
• owner_remove_table_error [Not useful for new arch] @asddongmen test: fix integration test capture_suicide_while_balance_table  #952
• owner_resign [Included in availability case] @asddongmen
• processor_err_chan [Not useful for new arch] @asddongmen test: remove useless it cases #799
• processor_etcd_worker_delay [Not useful for new arch] @asddongmen test: remove useless it cases #799
• processor_resolved_ts_fallback [Not useful for new arch] @asddongmen test: remove useless it cases #799
• processor_stop_delay [Not useful for new arch] @asddongmen test: remove useless it cases #799
• sink_hang [already included in mysql_sink_retry] @asddongmen *: fix several integration test cases #943
• mysql_sink_retry @asddongmen *: fix several integration test cases #943
• synced_status feat(api): add /synced api to check changefeed synchronization status #2602
• synced_status_with_redo feat(api): add /synced api to check changefeed synchronization status #2602
• syncpoint @hongyunyan

P4 (0 / 1 task)

• Refactor the test framework (if necessary), eg: deploy the test cluster with docker compose

[asddongmen]

-----------Total Summary-------------
Task Completion Statistics: 2025-01-13

Total tasks: 140
Completed tasks: 69
Completion rate: 49.3%