[fix](routine load) reset Kafka progress cache when routine load job topic change (#38474)

[sollhui]

pick (#38474)

When change routine load job topic from test_topic_before to test_topic_after by

ALTER ROUTINE LOAD FOR test_topic_change FROM KAFKA("kafka_topic" = "test_topic_after");

(test_topic_before has 5 rows and test_topic_after has 1 rows)

Exception happened, which cannot consume any data:

2024-07-29 15:57:28,122 WARN (Routine load task scheduler|55) [KafkaRoutineLoadJob.hasMoreDataToConsume():792] Kafka offset fallback. partition: 0, cache offset: 5 get latest of
fset: 1, task 16656914-ba0a-465d-8e79-8252b423b0fc, job 16615
2024-07-29 15:57:28,123 WARN (Routine load task scheduler|55) [KafkaRoutineLoadJob.hasMoreDataToConsume():792] Kafka offset fallback. partition: 0, cache offset: 5 get latest of
fset: 1, task 16656914-ba0a-465d-8e79-8252b423b0fc, job 16615
2024-07-29 15:57:28,125 WARN (Routine load task scheduler|55) [KafkaRoutineLoadJob.hasMoreDataToConsume():792] Kafka offset fallback. partition: 0, cache offset: 5 get latest of
fset: 1, task 16656914-ba0a-465d-8e79-8252b423b0fc, job 16615
2024-07-29 15:57:28,126 WARN (Routine load task scheduler|55) [KafkaRoutineLoadJob.hasMoreDataToConsume():792] Kafka offset fallback. partition: 0, cache offset: 5 get latest of
fset: 1, task 16656914-ba0a-465d-8e79-8252b423b0fc, job 16615
2024-07-29 15:57:28,128 WARN (Routine load task scheduler|55) [KafkaRoutineLoadJob.hasMoreDataToConsume():792] Kafka offset fallback. partition: 0, cache offset: 5 get latest of
fset: 1, task 16656914-ba0a-465d-8e79-8252b423b0fc, job 16615
2024-07-29 15:57:28,129 WARN (Routine load task scheduler|55) [KafkaRoutineLoadJob.hasMoreDataToConsume():792] Kafka offset fallback. partition: 0, cache offset: 5 get latest of
fset: 1, task 16656914-ba0a-465d-8e79-8252b423b0fc, job 16615
2024-07-29 15:57:28,131 WARN (Routine load task scheduler|55) [KafkaRoutineLoadJob.hasMoreDataToConsume():792] Kafka offset fallback. partition: 0, cache offset: 5 get latest of
fset: 1, task 16656914-ba0a-465d-8e79-8252b423b0fc, job 16615
2024-07-29 15:57:28,133 WARN (Routine load task scheduler|55) [KafkaRoutineLoadJob.hasMoreDataToConsume():792] Kafka offset fallback. partition: 0, cache offset: 5 get latest of
fset: 1, task 16656914-ba0a-465d-8e79-8252b423b0fc, job 16615
2024-07-29 15:57:28,134 WARN (Routine load task scheduler|55) [KafkaRoutineLoadJob.hasMoreDataToConsume():792] Kafka offset fallback. partition: 0, cache offset: 5 get latest of
fset: 1, task 16656914-ba0a-465d-8e79-8252b423b0fc, job 16615
2024-07-29 15:57:28,136 WARN (Routine load task scheduler|55) [KafkaRoutineLoadJob.hasMoreDataToConsume():792] Kafka offset fallback. partition: 0, cache offset: 5 get latest of
fset: 1, task 16656914-ba0a-465d-8e79-8252b423b0fc, job 16615
2024-07-29 15:57:28,137 WARN (Routine load task scheduler|55) [KafkaRoutineLoadJob.hasMoreDataToConsume():792] Kafka offset fallback. partition: 0, cache offset: 5 get latest of
fset: 1, task 16656914-ba0a-465d-8e79-8252b423b0fc, job 16615

It is necessary to reset Kafka progress cache when routine load job topic change.

[doris-robot]

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

[sollhui]

run buildall

[doris-robot]

TPC-H: Total hot run time: 50762 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5aecd928ded35fd09bb5d0c30b506c8ab5a8e96a, data reload: false

------ Round 1 ----------------------------------
q1	18136	5002	4437	4437
q2	2104	198	187	187
q3	10380	1927	1956	1927
q4	10396	1258	1336	1258
q5	8445	3948	3958	3948
q6	268	143	142	142
q7	2088	1679	1663	1663
q8	9526	2774	2754	2754
q9	14044	10526	10552	10526
q10	8704	3566	3548	3548
q11	435	265	279	265
q12	499	328	338	328
q13	18376	3965	4020	3965
q14	381	350	350	350
q15	559	507	501	501
q16	683	590	597	590
q17	1148	949	942	942
q18	7327	6976	6978	6976
q19	1772	1638	1608	1608
q20	560	365	330	330
q21	4443	4101	4079	4079
q22	537	438	442	438
Total cold run time: 120811 ms
Total hot run time: 50762 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4430	4420	4381	4381
q2	362	267	269	267
q3	4166	4134	4127	4127
q4	2911	2766	2779	2766
q5	7180	7221	7154	7154
q6	254	140	139	139
q7	3302	2930	2844	2844
q8	4381	4510	4554	4510
q9	17411	17199	17173	17173
q10	4269	4278	4325	4278
q11	810	708	731	708
q12	1031	889	882	882
q13	7414	3723	3758	3723
q14	465	448	445	445
q15	547	500	510	500
q16	768	715	726	715
q17	3866	3842	3831	3831
q18	8834	8884	8950	8884
q19	1817	1722	1689	1689
q20	2474	2216	2129	2129
q21	8469	8440	8523	8440
q22	1024	941	977	941
Total cold run time: 86185 ms
Total hot run time: 80526 ms

[doris-robot]

TPC-DS: Total hot run time: 208736 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5aecd928ded35fd09bb5d0c30b506c8ab5a8e96a, data reload: false

query1	978	422	415	415
query2	6761	2559	2190	2190
query3	6943	232	220	220
query4	20072	18366	18229	18229
query5	19931	6669	6674	6669
query6	321	253	280	253
query7	4217	337	351	337
query8	505	452	455	452
query9	3271	2798	2761	2761
query10	503	391	370	370
query11	11557	10817	10794	10794
query12	164	115	113	113
query13	5676	739	744	739
query14	17857	14107	13554	13554
query15	416	265	254	254
query16	6519	326	305	305
query17	1648	1483	939	939
query18	2339	492	481	481
query19	257	182	190	182
query20	119	114	112	112
query21	246	149	150	149
query22	5105	4956	5063	4956
query23	32785	31994	32057	31994
query24	7117	6561	6597	6561
query25	586	496	495	495
query26	557	207	199	199
query27	1831	339	340	339
query28	6085	2408	2383	2383
query29	3007	2820	2737	2737
query30	295	210	205	205
query31	999	867	829	829
query32	103	94	93	93
query33	482	335	336	335
query34	920	556	547	547
query35	1195	998	1013	998
query36	1599	1186	1131	1131
query37	120	90	92	90
query38	3072	2940	3003	2940
query39	1493	1432	1432	1432
query40	258	148	147	147
query41	157	160	155	155
query42	109	109	113	109
query43	754	626	648	626
query44	1216	791	778	778
query45	284	267	264	264
query46	1286	1022	1023	1022
query47	2154	1755	1749	1749
query48	1044	748	738	738
query49	841	594	604	594
query50	957	680	670	670
query51	4812	4750	4784	4750
query52	114	110	112	110
query53	504	385	381	381
query54	2750	2528	2539	2528
query55	112	108	105	105
query56	322	302	288	288
query57	1275	1220	1180	1180
query58	338	312	318	312
query59	3652	3373	3199	3199
query60	299	283	293	283
query61	167	162	161	161
query62	876	595	533	533
query63	574	420	411	411
query64	2736	1732	1642	1642
query65	3663	3597	3606	3597
query66	1228	833	818	818
query67	15759	15506	14830	14830
query68	10455	696	713	696
query69	646	427	426	426
query70	2404	1571	1622	1571
query71	471	364	366	364
query72	6622	3529	3558	3529
query73	797	369	368	368
query74	6419	6036	5912	5912
query75	5642	3772	3847	3772
query76	6898	1229	1229	1229
query77	1351	432	429	429
query78	13042	11718	13013	11718
query79	12602	712	695	695
query80	1157	565	557	557
query81	538	278	277	277
query82	1057	129	133	129
query83	283	221	220	220
query84	291	99	100	99
query85	976	420	420	420
query86	374	334	342	334
query87	3332	3037	3037	3037
query88	5573	2555	2537	2537
query89	522	340	354	340
query90	2030	268	263	263
query91	206	166	163	163
query92	90	88	86	86
query93	6033	641	629	629
query94	769	257	253	253
query95	1190	1117	1119	1117
query96	667	348	344	344
query97	6686	6342	6538	6342
query98	213	214	202	202
query99	2836	1035	916	916
Total cold run time: 328064 ms
Total hot run time: 208736 ms

[doris-robot]

ClickBench: Total hot run time: 31.8 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5aecd928ded35fd09bb5d0c30b506c8ab5a8e96a, data reload: false

query1	0.02	0.02	0.01
query2	0.07	0.03	0.02
query3	0.24	0.05	0.05
query4	1.78	0.06	0.06
query5	0.57	0.52	0.52
query6	1.29	0.63	0.62
query7	0.02	0.01	0.01
query8	0.04	0.04	0.03
query9	0.52	0.48	0.49
query10	0.55	0.55	0.55
query11	0.14	0.09	0.10
query12	0.12	0.10	0.10
query13	0.63	0.63	0.61
query14	0.78	0.80	0.80
query15	0.78	0.77	0.77
query16	0.37	0.36	0.37
query17	1.05	1.01	1.02
query18	0.24	0.25	0.25
query19	1.93	1.84	1.85
query20	0.01	0.01	0.02
query21	15.48	0.58	0.58
query22	1.92	1.94	2.19
query23	17.26	0.89	1.10
query24	4.84	1.02	1.34
query25	0.34	0.12	0.05
query26	0.60	0.18	0.18
query27	0.05	0.05	0.05
query28	7.82	0.78	0.77
query29	12.62	2.35	2.32
query30	0.74	0.72	0.76
query31	2.81	0.40	0.40
query32	3.37	0.52	0.52
query33	3.10	3.15	3.08
query34	15.27	4.82	4.83
query35	4.86	4.86	4.85
query36	1.08	1.05	1.03
query37	0.08	0.06	0.06
query38	0.04	0.05	0.04
query39	0.03	0.04	0.03
query40	0.19	0.17	0.17
query41	0.09	0.04	0.03
query42	0.04	0.03	0.03
query43	0.04	0.03	0.04
Total cold run time: 103.82 s
Total hot run time: 31.8 s

[doris-robot]

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 5aecd928ded35fd09bb5d0c30b506c8ab5a8e96a with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s

[dataroaring]

run buildall

[doris-robot]

TPC-H: Total hot run time: 50665 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e86f29c1980e6addf053a90495febb463d5a9b65, data reload: false

------ Round 1 ----------------------------------
q1	18160	4435	4376	4376
q2	2099	205	196	196
q3	10367	1924	1950	1924
q4	10365	1269	1348	1269
q5	8448	3913	3936	3913
q6	271	145	144	144
q7	2080	1662	1669	1662
q8	9580	2782	2749	2749
q9	14355	10621	10558	10558
q10	8685	3603	3541	3541
q11	446	281	282	281
q12	502	337	337	337
q13	18353	4024	4077	4024
q14	383	347	349	347
q15	555	510	514	510
q16	708	607	600	600
q17	1160	1006	899	899
q18	7220	6852	6916	6852
q19	1746	1669	1600	1600
q20	556	345	330	330
q21	4496	4146	4132	4132
q22	544	432	421	421
Total cold run time: 121079 ms
Total hot run time: 50665 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4400	4370	4346	4346
q2	354	269	273	269
q3	4187	4142	4196	4142
q4	2792	2762	2766	2762
q5	7260	7179	7233	7179
q6	261	140	141	140
q7	3253	2882	2876	2876
q8	4427	4518	4606	4518
q9	17414	17218	17065	17065
q10	4243	4322	4297	4297
q11	766	751	693	693
q12	1048	888	892	888
q13	6748	3798	3769	3769
q14	475	448	445	445
q15	548	517	503	503
q16	786	716	708	708
q17	3865	3858	3936	3858
q18	8821	8894	8780	8780
q19	1777	1786	1765	1765
q20	2401	2150	2152	2150
q21	8569	8462	8514	8462
q22	1126	986	970	970
Total cold run time: 85521 ms
Total hot run time: 80585 ms

[doris-robot]

TPC-DS: Total hot run time: 209980 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e86f29c1980e6addf053a90495febb463d5a9b65, data reload: false

query1	977	422	411	411
query2	6778	2390	2127	2127
query3	6953	233	225	225
query4	20034	18219	18325	18219
query5	19942	6772	6713	6713
query6	324	261	285	261
query7	4191	340	339	339
query8	499	466	492	466
query9	3215	2798	2747	2747
query10	504	370	363	363
query11	11501	10879	10867	10867
query12	162	119	110	110
query13	5689	745	737	737
query14	18482	13763	13734	13734
query15	380	263	252	252
query16	6516	325	305	305
query17	1583	1497	929	929
query18	2336	490	478	478
query19	242	182	185	182
query20	108	119	118	118
query21	241	149	153	149
query22	5436	5164	5075	5075
query23	32735	32155	32228	32155
query24	7058	6646	6626	6626
query25	587	471	460	460
query26	554	195	193	193
query27	1845	327	327	327
query28	6094	2429	2382	2382
query29	3041	2637	2995	2637
query30	289	215	232	215
query31	1015	837	827	827
query32	102	94	93	93
query33	482	351	342	342
query34	913	531	527	527
query35	1203	1002	996	996
query36	1380	1124	1133	1124
query37	118	87	95	87
query38	3098	2930	3029	2930
query39	1509	1434	1433	1433
query40	260	157	148	148
query41	163	156	155	155
query42	110	113	109	109
query43	657	657	677	657
query44	1196	794	784	784
query45	281	271	270	270
query46	1307	1006	1028	1006
query47	2057	1856	1853	1853
query48	1048	749	727	727
query49	846	588	598	588
query50	945	706	686	686
query51	4877	4787	4721	4721
query52	119	108	116	108
query53	503	380	379	379
query54	2710	2541	2599	2541
query55	108	98	101	98
query56	317	313	293	293
query57	1267	1325	1214	1214
query58	305	321	326	321
query59	3497	3329	3284	3284
query60	304	297	277	277
query61	168	169	159	159
query62	902	525	583	525
query63	543	396	397	396
query64	2755	1720	1652	1652
query65	3716	3610	3589	3589
query66	1263	830	826	826
query67	15753	15136	16514	15136
query68	9505	702	714	702
query69	622	423	405	405
query70	1760	1430	1451	1430
query71	481	360	378	360
query72	6657	3566	3601	3566
query73	787	372	373	372
query74	6391	5939	5932	5932
query75	5479	3851	3796	3796
query76	5985	1185	1275	1185
query77	1188	424	416	416
query78	12805	12132	12239	12132
query79	10073	717	710	710
query80	1184	556	576	556
query81	533	279	281	279
query82	1658	133	126	126
query83	265	221	222	221
query84	288	99	102	99
query85	989	433	427	427
query86	356	336	326	326
query87	3324	3061	3049	3049
query88	5320	2538	2540	2538
query89	530	354	351	351
query90	1983	257	253	253
query91	198	168	163	163
query92	91	87	84	84
query93	6657	623	615	615
query94	709	259	265	259
query95	1153	1117	1107	1107
query96	669	339	341	339
query97	6621	6476	6455	6455
query98	239	212	211	211
query99	2949	853	893	853
Total cold run time: 323542 ms
Total hot run time: 209980 ms

[doris-robot]

ClickBench: Total hot run time: 31.08 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e86f29c1980e6addf053a90495febb463d5a9b65, data reload: false

query1	0.02	0.02	0.02
query2	0.08	0.02	0.03
query3	0.25	0.06	0.06
query4	1.76	0.09	0.08
query5	0.54	0.53	0.52
query6	1.27	0.63	0.62
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.53	0.48	0.47
query10	0.55	0.55	0.53
query11	0.13	0.09	0.10
query12	0.12	0.10	0.10
query13	0.64	0.63	0.62
query14	0.81	0.80	0.82
query15	0.80	0.76	0.77
query16	0.37	0.37	0.37
query17	1.03	1.01	1.02
query18	0.23	0.25	0.25
query19	1.91	1.89	1.83
query20	0.02	0.01	0.02
query21	15.48	0.56	0.56
query22	2.13	2.82	1.59
query23	16.92	1.06	1.06
query24	6.09	0.76	0.99
query25	0.36	0.06	0.06
query26	0.68	0.15	0.17
query27	0.04	0.05	0.04
query28	7.27	0.80	0.75
query29	12.64	2.21	2.34
query30	0.73	0.69	0.75
query31	2.84	0.40	0.38
query32	3.37	0.51	0.50
query33	3.10	3.06	3.11
query34	15.27	4.84	4.83
query35	4.88	4.83	4.87
query36	1.04	1.03	1.03
query37	0.07	0.06	0.06
query38	0.06	0.04	0.04
query39	0.03	0.03	0.03
query40	0.18	0.17	0.19
query41	0.08	0.03	0.03
query42	0.04	0.02	0.03
query43	0.05	0.04	0.03
Total cold run time: 104.47 s
Total hot run time: 31.08 s

[doris-robot]

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit e86f29c1980e6addf053a90495febb463d5a9b65 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.2 seconds inserted 10000000 Rows, about 471K ops/s

[sollhui]

run buildall

[doris-robot]

TPC-H: Total hot run time: 49980 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0a8956530575a163baf08d21843add1a0626e218, data reload: false

------ Round 1 ----------------------------------
q1	18204	4422	4346	4346
q2	2086	207	192	192
q3	10162	1914	1919	1914
q4	10378	1244	1347	1244
q5	8519	3886	3927	3886
q6	274	142	143	142
q7	2093	1671	1663	1663
q8	9577	2803	2758	2758
q9	13603	10349	10054	10054
q10	8689	3592	3567	3567
q11	441	276	285	276
q12	499	334	332	332
q13	18361	4001	4055	4001
q14	384	357	347	347
q15	563	507	511	507
q16	706	614	608	608
q17	1135	953	932	932
q18	7294	6960	6791	6791
q19	1768	1625	1559	1559
q20	562	349	336	336
q21	4433	4187	4087	4087
q22	537	438	438	438
Total cold run time: 120268 ms
Total hot run time: 49980 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4358	4320	4320	4320
q2	363	284	266	266
q3	4190	4124	4157	4124
q4	2760	2745	2779	2745
q5	7165	7121	7139	7121
q6	257	137	139	137
q7	3273	2889	2879	2879
q8	4431	4504	4529	4504
q9	16956	16862	16798	16798
q10	4279	4302	4269	4269
q11	766	727	700	700
q12	1062	869	879	869
q13	7169	3725	3763	3725
q14	470	452	457	452
q15	554	505	500	500
q16	771	719	706	706
q17	3839	3847	3898	3847
q18	8734	8868	8752	8752
q19	1803	1706	1716	1706
q20	2433	2186	2153	2153
q21	8468	8542	8563	8542
q22	1033	950	963	950
Total cold run time: 85134 ms
Total hot run time: 80065 ms

[doris-robot]

TPC-DS: Total hot run time: 208935 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0a8956530575a163baf08d21843add1a0626e218, data reload: false

query1	986	422	415	415
query2	6759	2512	2119	2119
query3	6942	229	226	226
query4	20077	18203	18233	18203
query5	19947	6703	6670	6670
query6	312	252	269	252
query7	4195	332	345	332
query8	484	471	432	432
query9	3235	2818	2768	2768
query10	483	396	390	390
query11	11404	10904	10913	10904
query12	163	113	112	112
query13	5663	725	739	725
query14	18256	13553	13746	13553
query15	394	256	250	250
query16	6516	328	307	307
query17	1616	1472	919	919
query18	2335	474	491	474
query19	230	193	183	183
query20	112	116	115	115
query21	242	149	147	147
query22	5283	4977	5045	4977
query23	32575	32009	31912	31912
query24	7039	6613	6633	6613
query25	593	474	474	474
query26	672	186	190	186
query27	2009	332	334	332
query28	6045	2435	2387	2387
query29	3026	2831	2852	2831
query30	279	211	206	206
query31	1024	820	845	820
query32	102	92	96	92
query33	477	336	341	336
query34	910	515	527	515
query35	1159	967	953	953
query36	1308	1179	1220	1179
query37	119	90	92	90
query38	3134	2946	2921	2921
query39	1471	1444	1449	1444
query40	360	146	146	146
query41	159	159	154	154
query42	111	117	113	113
query43	663	595	688	595
query44	1202	798	793	793
query45	288	269	270	269
query46	1275	1021	1048	1021
query47	2023	1964	1984	1964
query48	1061	751	736	736
query49	855	590	575	575
query50	945	663	663	663
query51	4781	4769	4765	4765
query52	127	103	109	103
query53	495	370	379	370
query54	2724	2538	2553	2538
query55	115	101	105	101
query56	307	302	279	279
query57	1315	1131	1158	1131
query58	324	307	296	296
query59	3466	3285	3380	3285
query60	294	281	307	281
query61	161	155	161	155
query62	828	534	512	512
query63	544	396	392	392
query64	2709	1702	1614	1614
query65	3680	3634	3639	3634
query66	1257	815	809	809
query67	15356	15132	15238	15132
query68	10494	701	683	683
query69	637	416	408	408
query70	2051	1426	1480	1426
query71	473	364	370	364
query72	6589	3561	3594	3561
query73	771	374	367	367
query74	6352	5934	5927	5927
query75	5572	3759	3798	3759
query76	6926	1175	1257	1175
query77	1349	428	425	425
query78	12660	11895	11705	11705
query79	8840	688	681	681
query80	1082	547	542	542
query81	538	278	279	278
query82	1332	124	126	124
query83	256	220	218	218
query84	286	100	98	98
query85	980	411	408	408
query86	374	324	327	324
query87	3256	3101	3091	3091
query88	4902	2533	2525	2525
query89	535	363	356	356
query90	2006	247	258	247
query91	190	158	174	158
query92	93	86	87	86
query93	7306	684	598	598
query94	746	254	256	254
query95	1148	1113	1101	1101
query96	667	345	344	344
query97	6400	6390	6359	6359
query98	221	211	210	210
query99	2988	943	966	943
Total cold run time: 323021 ms
Total hot run time: 208935 ms

[doris-robot]

ClickBench: Total hot run time: 31.35 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0a8956530575a163baf08d21843add1a0626e218, data reload: false

query1	0.03	0.02	0.02
query2	0.07	0.03	0.02
query3	0.25	0.06	0.06
query4	1.78	0.11	0.09
query5	0.54	0.53	0.53
query6	1.37	0.62	0.62
query7	0.02	0.01	0.01
query8	0.04	0.04	0.02
query9	0.53	0.50	0.49
query10	0.54	0.54	0.54
query11	0.13	0.09	0.09
query12	0.12	0.10	0.10
query13	0.63	0.61	0.62
query14	0.79	0.80	0.78
query15	0.79	0.77	0.78
query16	0.37	0.39	0.37
query17	1.00	1.00	1.02
query18	0.24	0.25	0.24
query19	1.94	1.86	1.89
query20	0.02	0.02	0.01
query21	15.50	0.57	0.55
query22	2.34	2.09	1.85
query23	17.06	0.86	1.12
query24	5.48	0.85	0.89
query25	0.39	0.13	0.06
query26	0.52	0.16	0.16
query27	0.05	0.04	0.04
query28	7.85	0.75	0.75
query29	12.74	2.30	2.33
query30	0.70	0.71	0.73
query31	2.83	0.40	0.39
query32	3.35	0.51	0.51
query33	3.06	3.06	3.07
query34	15.27	4.79	4.82
query35	4.86	4.83	4.85
query36	1.06	1.02	1.02
query37	0.07	0.06	0.06
query38	0.06	0.03	0.03
query39	0.04	0.03	0.03
query40	0.19	0.17	0.18
query41	0.09	0.03	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.04
Total cold run time: 104.79 s
Total hot run time: 31.35 s

[doris-robot]

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 0a8956530575a163baf08d21843add1a0626e218 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.3 seconds inserted 10000000 Rows, about 469K ops/s