Skip to content

Conversation

@suxiaogang223
Copy link
Contributor

@suxiaogang223 suxiaogang223 commented Apr 9, 2025

What problem does this PR solve?

Release note

relate pr: #43255

Improved ACID table column handling

  • Added support for ACID column prefix in ORC column initialization
  • Fixed column name handling for ACID tables
  • Improved type mapping for ACID table columns

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Apr 9, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@suxiaogang223
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TeamCity cloud ut coverage result:
Function Coverage: 83.07% (1089/1311)
Line Coverage: 66.06% (18159/27489)
Region Coverage: 65.49% (8944/13657)
Branch Coverage: 55.36% (4821/8708)
Coverage Report: http://coverage.selectdb-in.cc/coverage/ae57d90fa06b95cfc5924caa96873bb067bc5c22_ae57d90fa06b95cfc5924caa96873bb067bc5c22_cloud/report/index.html

@suxiaogang223
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TeamCity cloud ut coverage result:
Function Coverage: 83.07% (1089/1311)
Line Coverage: 66.08% (18165/27489)
Region Coverage: 65.52% (8948/13657)
Branch Coverage: 55.42% (4826/8708)
Coverage Report: http://coverage.selectdb-in.cc/coverage/528dac8c6c5586d1b240d0e9c48a75fb4cb5698b_528dac8c6c5586d1b240d0e9c48a75fb4cb5698b_cloud/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 35234 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 528dac8c6c5586d1b240d0e9c48a75fb4cb5698b, data reload: false

------ Round 1 ----------------------------------
q1	26336	5317	5186	5186
q2	2110	288	193	193
q3	10370	1255	706	706
q4	10216	994	522	522
q5	7548	2398	2334	2334
q6	196	165	134	134
q7	926	750	604	604
q8	9329	1323	1130	1130
q9	6746	5078	5105	5078
q10	6841	2319	1885	1885
q11	493	294	277	277
q12	357	366	227	227
q13	17771	3700	3095	3095
q14	240	225	205	205
q15	535	478	481	478
q16	641	623	606	606
q17	615	864	384	384
q18	7901	7369	7200	7200
q19	1257	965	587	587
q20	344	352	233	233
q21	4240	3396	3178	3178
q22	1049	1035	992	992
Total cold run time: 116061 ms
Total hot run time: 35234 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5139	5078	5352	5078
q2	233	326	225	225
q3	2164	2667	2304	2304
q4	1578	1976	1469	1469
q5	4589	4489	4419	4419
q6	216	170	135	135
q7	1960	1961	1772	1772
q8	2620	2663	2663	2663
q9	7257	7075	7159	7075
q10	2971	3187	2780	2780
q11	580	533	486	486
q12	697	795	628	628
q13	3439	3927	3355	3355
q14	281	302	273	273
q15	519	481	466	466
q16	663	697	639	639
q17	1168	1492	1444	1444
q18	7758	7639	7539	7539
q19	836	865	952	865
q20	1983	2018	1925	1925
q21	5396	5012	4913	4913
q22	1133	1100	1023	1023
Total cold run time: 53180 ms
Total hot run time: 51476 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193813 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 528dac8c6c5586d1b240d0e9c48a75fb4cb5698b, data reload: false

query1	1390	1075	1048	1048
query2	6079	1938	1963	1938
query3	11041	4733	4702	4702
query4	25676	23704	23175	23175
query5	5457	639	456	456
query6	304	217	192	192
query7	3995	495	278	278
query8	308	247	226	226
query9	8543	2566	2555	2555
query10	539	330	272	272
query11	15699	15136	14868	14868
query12	162	112	106	106
query13	1566	519	392	392
query14	9369	6429	6402	6402
query15	219	185	165	165
query16	7600	651	512	512
query17	1106	789	620	620
query18	2066	426	351	351
query19	208	210	171	171
query20	133	131	124	124
query21	211	130	118	118
query22	4455	4679	4278	4278
query23	34490	33536	33464	33464
query24	8576	2427	2465	2427
query25	507	488	417	417
query26	1057	273	150	150
query27	3020	505	334	334
query28	4633	2426	2428	2426
query29	677	584	426	426
query30	276	216	199	199
query31	914	887	837	837
query32	103	62	70	62
query33	537	400	327	327
query34	801	906	542	542
query35	836	880	808	808
query36	1011	1029	910	910
query37	127	106	81	81
query38	4191	4309	4234	4234
query39	1508	1435	1432	1432
query40	215	122	107	107
query41	55	55	58	55
query42	122	106	113	106
query43	496	516	488	488
query44	1363	848	822	822
query45	181	180	179	179
query46	849	1042	643	643
query47	1822	1885	1769	1769
query48	392	421	342	342
query49	762	566	459	459
query50	656	708	402	402
query51	4258	4275	4259	4259
query52	115	108	102	102
query53	241	270	202	202
query54	584	593	511	511
query55	86	81	85	81
query56	340	324	308	308
query57	1186	1199	1091	1091
query58	286	269	283	269
query59	2761	2896	2668	2668
query60	343	330	308	308
query61	139	136	145	136
query62	777	710	676	676
query63	227	189	187	187
query64	3832	1065	739	739
query65	4500	4349	4345	4345
query66	844	417	325	325
query67	16348	15574	15251	15251
query68	9331	904	515	515
query69	516	310	280	280
query70	1223	1153	1112	1112
query71	492	318	294	294
query72	5700	4766	4598	4598
query73	730	610	351	351
query74	9299	8866	9035	8866
query75	4531	3226	2714	2714
query76	3749	1197	767	767
query77	898	385	280	280
query78	10007	10383	9367	9367
query79	2202	813	594	594
query80	799	519	458	458
query81	478	257	236	236
query82	451	128	98	98
query83	282	261	243	243
query84	294	97	85	85
query85	749	358	320	320
query86	343	319	292	292
query87	4581	4720	4472	4472
query88	3424	2295	2208	2208
query89	403	314	279	279
query90	1910	220	219	219
query91	144	153	116	116
query92	78	62	59	59
query93	1501	974	590	590
query94	660	403	376	376
query95	359	297	294	294
query96	482	574	273	273
query97	3237	3212	3107	3107
query98	228	208	198	198
query99	1451	1481	1297	1297
Total cold run time: 283702 ms
Total hot run time: 193813 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.92 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 528dac8c6c5586d1b240d0e9c48a75fb4cb5698b, data reload: false

query1	0.04	0.03	0.03
query2	0.15	0.10	0.10
query3	0.34	0.20	0.19
query4	1.59	0.20	0.20
query5	0.64	0.61	0.61
query6	1.19	0.71	0.71
query7	0.02	0.02	0.01
query8	0.06	0.05	0.05
query9	0.63	0.52	0.51
query10	0.58	0.59	0.57
query11	0.26	0.13	0.12
query12	0.25	0.14	0.13
query13	0.63	0.61	0.61
query14	2.68	2.80	2.79
query15	1.00	0.89	0.86
query16	0.36	0.37	0.39
query17	1.00	1.02	1.06
query18	0.18	0.18	0.18
query19	1.93	2.02	1.80
query20	0.01	0.01	0.01
query21	15.36	0.98	0.68
query22	0.92	1.01	0.79
query23	14.69	1.53	0.77
query24	5.58	0.57	0.28
query25	0.17	0.10	0.08
query26	0.56	0.22	0.18
query27	0.08	0.08	0.08
query28	10.98	1.21	0.58
query29	12.56	4.23	3.50
query30	0.28	0.08	0.06
query31	2.80	0.62	0.44
query32	3.24	0.61	0.50
query33	3.08	3.07	3.09
query34	16.58	5.09	4.41
query35	4.45	4.46	4.47
query36	0.63	0.51	0.49
query37	0.20	0.18	0.17
query38	0.17	0.17	0.16
query39	0.05	0.04	0.04
query40	0.21	0.18	0.16
query41	0.10	0.05	0.06
query42	0.06	0.06	0.05
query43	0.05	0.05	0.05
Total cold run time: 106.34 s
Total hot run time: 31.92 s

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 30.00% (9/30) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.34% (14070/26880)
Line Coverage 41.13% (121554/295546)
Region Coverage 39.85% (61847/155186)
Branch Coverage 34.50% (30958/89722)

@suxiaogang223
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TeamCity cloud ut coverage result:
Function Coverage: 83.07% (1089/1311)
Line Coverage: 66.06% (18160/27489)
Region Coverage: 65.50% (8946/13657)
Branch Coverage: 55.33% (4818/8708)
Coverage Report: http://coverage.selectdb-in.cc/coverage/54a9652bfc86dd28c27180763229d9fce79daa99_54a9652bfc86dd28c27180763229d9fce79daa99_cloud/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 34098 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 54a9652bfc86dd28c27180763229d9fce79daa99, data reload: false

------ Round 1 ----------------------------------
q1	26086	5144	5001	5001
q2	2072	282	182	182
q3	10397	1289	692	692
q4	10219	1019	525	525
q5	7520	2444	2354	2354
q6	189	162	131	131
q7	945	760	609	609
q8	9339	1312	1141	1141
q9	6895	5158	5175	5158
q10	6868	2305	1888	1888
q11	482	300	275	275
q12	365	358	221	221
q13	17792	3728	3062	3062
q14	241	237	210	210
q15	534	476	500	476
q16	624	635	595	595
q17	601	868	369	369
q18	7435	7143	7036	7036
q19	1880	970	560	560
q20	334	329	225	225
q21	4109	3355	2428	2428
q22	1088	1019	960	960
Total cold run time: 116015 ms
Total hot run time: 34098 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5206	5073	5113	5073
q2	246	340	235	235
q3	2152	2677	2290	2290
q4	1498	1826	1508	1508
q5	4487	4438	4382	4382
q6	235	171	126	126
q7	1977	1912	1765	1765
q8	2633	2566	2626	2566
q9	7352	7256	7137	7137
q10	3007	3210	2732	2732
q11	570	507	494	494
q12	691	762	593	593
q13	3487	3945	3318	3318
q14	308	309	279	279
q15	516	486	472	472
q16	664	686	661	661
q17	1187	1555	1380	1380
q18	7817	7718	7406	7406
q19	810	806	832	806
q20	1960	2006	1804	1804
q21	5381	4871	4844	4844
q22	1143	1108	1018	1018
Total cold run time: 53327 ms
Total hot run time: 50889 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193370 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 54a9652bfc86dd28c27180763229d9fce79daa99, data reload: false

query1	1370	1050	1051	1050
query2	6070	1939	1970	1939
query3	11154	4814	4497	4497
query4	54577	25400	22989	22989
query5	5165	537	446	446
query6	360	210	207	207
query7	4952	503	273	273
query8	311	247	235	235
query9	5948	2591	2604	2591
query10	432	317	260	260
query11	15088	14979	14838	14838
query12	174	108	107	107
query13	1077	513	416	416
query14	10229	6469	6416	6416
query15	209	200	183	183
query16	7090	660	516	516
query17	1084	742	603	603
query18	1544	438	336	336
query19	205	199	171	171
query20	126	127	119	119
query21	206	123	107	107
query22	4564	4616	4505	4505
query23	33772	33346	33334	33334
query24	6598	2411	2452	2411
query25	445	477	399	399
query26	757	278	151	151
query27	2344	508	330	330
query28	3106	2485	2459	2459
query29	591	569	440	440
query30	270	220	198	198
query31	855	866	778	778
query32	75	69	62	62
query33	458	379	320	320
query34	759	870	537	537
query35	784	892	722	722
query36	940	982	893	893
query37	128	98	80	80
query38	4248	4290	4017	4017
query39	1495	1444	1452	1444
query40	215	118	109	109
query41	56	51	54	51
query42	122	114	113	113
query43	492	530	483	483
query44	1338	828	816	816
query45	181	170	165	165
query46	844	1040	646	646
query47	1872	1874	1821	1821
query48	378	418	310	310
query49	697	511	414	414
query50	654	708	413	413
query51	4306	4237	4200	4200
query52	118	108	104	104
query53	237	281	190	190
query54	577	583	503	503
query55	79	81	79	79
query56	317	318	310	310
query57	1171	1181	1136	1136
query58	276	268	271	268
query59	2784	2918	2727	2727
query60	333	322	300	300
query61	139	130	138	130
query62	728	735	695	695
query63	233	187	186	186
query64	1790	1058	709	709
query65	4436	4335	4385	4335
query66	747	451	357	357
query67	15989	15585	15576	15576
query68	7334	901	516	516
query69	537	302	262	262
query70	1193	1131	1072	1072
query71	502	332	299	299
query72	5951	4798	4917	4798
query73	1374	657	342	342
query74	9306	9014	8968	8968
query75	3883	3211	2667	2667
query76	4266	1202	738	738
query77	643	367	279	279
query78	10115	10297	9265	9265
query79	2317	815	564	564
query80	677	560	423	423
query81	482	255	219	219
query82	265	126	94	94
query83	261	254	234	234
query84	294	97	87	87
query85	782	355	313	313
query86	370	294	284	284
query87	4435	4539	4424	4424
query88	3459	2248	2262	2248
query89	395	312	286	286
query90	1773	212	212	212
query91	145	143	113	113
query92	80	60	58	58
query93	2087	948	586	586
query94	627	416	308	308
query95	368	292	285	285
query96	489	564	281	281
query97	3216	3225	3134	3134
query98	244	211	206	206
query99	1360	1406	1280	1280
Total cold run time: 299899 ms
Total hot run time: 193370 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.77 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 54a9652bfc86dd28c27180763229d9fce79daa99, data reload: false

query1	0.04	0.03	0.03
query2	0.14	0.11	0.11
query3	0.35	0.20	0.20
query4	1.59	0.20	0.20
query5	0.63	0.60	0.60
query6	1.18	0.73	0.72
query7	0.02	0.02	0.01
query8	0.05	0.04	0.05
query9	0.61	0.51	0.52
query10	0.58	0.59	0.58
query11	0.25	0.13	0.12
query12	0.24	0.13	0.13
query13	0.63	0.62	0.61
query14	2.66	2.68	2.71
query15	0.98	0.87	0.88
query16	0.37	0.36	0.37
query17	1.05	1.04	1.03
query18	0.18	0.18	0.17
query19	1.92	2.02	1.79
query20	0.02	0.01	0.01
query21	15.35	0.95	0.66
query22	0.92	1.00	0.85
query23	14.68	1.51	0.75
query24	5.30	0.60	0.30
query25	0.17	0.09	0.09
query26	0.54	0.22	0.17
query27	0.09	0.08	0.09
query28	11.00	1.12	0.57
query29	12.55	4.11	3.47
query30	0.28	0.08	0.06
query31	2.82	0.65	0.42
query32	3.25	0.59	0.50
query33	3.04	3.04	3.04
query34	16.59	5.11	4.41
query35	4.56	4.48	4.50
query36	0.63	0.51	0.50
query37	0.20	0.17	0.17
query38	0.16	0.16	0.15
query39	0.05	0.04	0.04
query40	0.21	0.17	0.16
query41	0.10	0.05	0.05
query42	0.06	0.04	0.05
query43	0.05	0.04	0.05
Total cold run time: 106.09 s
Total hot run time: 31.77 s

@suxiaogang223
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TeamCity cloud ut coverage result:
Function Coverage: 83.07% (1089/1311)
Line Coverage: 66.11% (18173/27489)
Region Coverage: 65.56% (8953/13657)
Branch Coverage: 55.40% (4824/8708)
Coverage Report: http://coverage.selectdb-in.cc/coverage/e64d277a7ce5f2b96966431bef2df90408ed6a31_e64d277a7ce5f2b96966431bef2df90408ed6a31_cloud/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 34597 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e64d277a7ce5f2b96966431bef2df90408ed6a31, data reload: false

------ Round 1 ----------------------------------
q1	27648	5602	5164	5164
q2	2087	292	185	185
q3	10377	1278	751	751
q4	10237	1055	536	536
q5	7574	2410	2362	2362
q6	189	162	134	134
q7	938	752	608	608
q8	9320	1323	1165	1165
q9	6823	5112	5140	5112
q10	6833	2324	1886	1886
q11	469	283	281	281
q12	349	361	228	228
q13	17755	3729	3084	3084
q14	226	224	215	215
q15	534	499	477	477
q16	635	620	574	574
q17	593	873	374	374
q18	7673	7298	7190	7190
q19	1075	962	579	579
q20	331	326	232	232
q21	4384	3403	2497	2497
q22	1077	1055	963	963
Total cold run time: 117127 ms
Total hot run time: 34597 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5156	5138	5151	5138
q2	235	322	228	228
q3	2186	2825	2296	2296
q4	1492	1969	1487	1487
q5	4606	4416	4387	4387
q6	219	170	130	130
q7	2021	1955	1780	1780
q8	2511	2674	2562	2562
q9	7289	7168	7115	7115
q10	2961	3165	2781	2781
q11	575	518	517	517
q12	693	773	634	634
q13	3595	3994	3274	3274
q14	278	288	273	273
q15	523	468	477	468
q16	650	701	671	671
q17	1189	1557	1426	1426
q18	7735	7498	7340	7340
q19	843	928	1101	928
q20	1962	2003	1884	1884
q21	5442	4944	4866	4866
q22	1131	1064	1028	1028
Total cold run time: 53292 ms
Total hot run time: 51213 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192648 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e64d277a7ce5f2b96966431bef2df90408ed6a31, data reload: false

query1	1375	1124	1053	1053
query2	5999	1914	1884	1884
query3	11151	4780	4547	4547
query4	57403	24552	23028	23028
query5	4756	507	455	455
query6	354	230	183	183
query7	4946	519	280	280
query8	317	246	223	223
query9	6381	2578	2572	2572
query10	414	347	253	253
query11	14972	15265	14789	14789
query12	167	117	106	106
query13	1108	520	392	392
query14	10296	6195	6295	6195
query15	200	192	177	177
query16	7162	665	504	504
query17	1088	739	578	578
query18	1746	423	327	327
query19	204	205	166	166
query20	139	123	124	123
query21	229	129	114	114
query22	4539	4600	4415	4415
query23	34226	33686	33587	33587
query24	6551	2451	2467	2451
query25	460	461	389	389
query26	705	268	152	152
query27	2541	506	333	333
query28	3210	2448	2471	2448
query29	572	564	431	431
query30	282	220	192	192
query31	857	881	811	811
query32	71	68	60	60
query33	456	365	318	318
query34	766	874	537	537
query35	846	868	783	783
query36	937	1027	900	900
query37	121	105	75	75
query38	4165	4194	4201	4194
query39	1492	1508	1621	1508
query40	218	128	116	116
query41	66	57	56	56
query42	125	120	110	110
query43	508	491	490	490
query44	1343	828	821	821
query45	179	178	166	166
query46	821	992	633	633
query47	1783	1795	1725	1725
query48	381	411	301	301
query49	708	534	444	444
query50	644	678	414	414
query51	4144	4217	4141	4141
query52	110	106	102	102
query53	235	252	186	186
query54	563	571	535	535
query55	82	79	78	78
query56	300	311	308	308
query57	1116	1127	1081	1081
query58	260	258	258	258
query59	2567	2680	2536	2536
query60	329	319	291	291
query61	127	130	123	123
query62	697	739	662	662
query63	217	178	181	178
query64	1692	1049	670	670
query65	4360	4249	4251	4249
query66	739	396	309	309
query67	15797	15630	15353	15353
query68	6471	908	518	518
query69	553	302	271	271
query70	1160	1060	1150	1060
query71	526	315	306	306
query72	5946	4766	4953	4766
query73	1422	675	358	358
query74	8983	8822	8789	8789
query75	3975	3177	2709	2709
query76	4428	1194	774	774
query77	621	358	290	290
query78	10053	10101	9299	9299
query79	2000	815	567	567
query80	736	530	448	448
query81	484	259	221	221
query82	479	130	104	104
query83	416	246	233	233
query84	295	109	81	81
query85	773	352	323	323
query86	381	324	280	280
query87	4494	4448	4389	4389
query88	3577	2234	2253	2234
query89	405	322	280	280
query90	1882	219	221	219
query91	141	144	111	111
query92	81	62	58	58
query93	1763	966	590	590
query94	669	414	312	312
query95	367	295	289	289
query96	495	562	279	279
query97	3198	3249	3142	3142
query98	237	210	201	201
query99	1442	1391	1278	1278
Total cold run time: 301768 ms
Total hot run time: 192648 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.95 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e64d277a7ce5f2b96966431bef2df90408ed6a31, data reload: false

query1	0.04	0.03	0.03
query2	0.15	0.11	0.12
query3	0.33	0.21	0.20
query4	1.59	0.19	0.20
query5	0.63	0.64	0.61
query6	1.20	0.72	0.72
query7	0.02	0.02	0.02
query8	0.06	0.05	0.04
query9	0.62	0.53	0.54
query10	0.58	0.57	0.57
query11	0.25	0.13	0.12
query12	0.25	0.14	0.14
query13	0.64	0.62	0.62
query14	2.70	2.70	2.68
query15	1.02	0.87	0.86
query16	0.38	0.37	0.38
query17	1.02	1.03	1.02
query18	0.23	0.22	0.22
query19	1.97	1.99	1.78
query20	0.01	0.01	0.02
query21	15.35	1.00	0.69
query22	0.93	0.96	0.80
query23	14.75	1.55	0.76
query24	5.39	0.58	0.29
query25	0.16	0.09	0.09
query26	0.54	0.22	0.18
query27	0.08	0.09	0.09
query28	11.05	1.15	0.59
query29	12.54	4.10	3.45
query30	0.27	0.08	0.06
query31	2.83	0.64	0.42
query32	3.23	0.61	0.51
query33	3.04	3.04	3.05
query34	16.87	5.14	4.47
query35	4.55	4.58	4.54
query36	0.63	0.52	0.49
query37	0.19	0.16	0.17
query38	0.17	0.16	0.15
query39	0.05	0.05	0.04
query40	0.18	0.17	0.15
query41	0.10	0.05	0.06
query42	0.06	0.05	0.05
query43	0.05	0.05	0.04
Total cold run time: 106.7 s
Total hot run time: 31.95 s

@suxiaogang223
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TeamCity cloud ut coverage result:
Function Coverage: 83.07% (1089/1311)
Line Coverage: 66.10% (18170/27489)
Region Coverage: 65.54% (8951/13657)
Branch Coverage: 55.37% (4822/8708)
Coverage Report: http://coverage.selectdb-in.cc/coverage/98115993f1fe4bb35576b1283c4bc05e541dbfb7_98115993f1fe4bb35576b1283c4bc05e541dbfb7_cloud/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 35014 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 98115993f1fe4bb35576b1283c4bc05e541dbfb7, data reload: false

------ Round 1 ----------------------------------
q1	25912	5163	5009	5009
q2	2064	291	181	181
q3	10739	1237	697	697
q4	10304	1015	536	536
q5	9284	2402	2317	2317
q6	198	159	131	131
q7	905	758	629	629
q8	9316	1360	1150	1150
q9	6827	5083	5077	5077
q10	6821	2285	1874	1874
q11	498	289	259	259
q12	353	359	220	220
q13	17778	3674	3184	3184
q14	223	235	210	210
q15	524	481	472	472
q16	623	628	610	610
q17	583	853	362	362
q18	7553	7088	7189	7088
q19	1782	969	574	574
q20	319	329	224	224
q21	3943	3400	3230	3230
q22	1054	1016	980	980
Total cold run time: 117603 ms
Total hot run time: 35014 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5235	5073	5079	5073
q2	248	324	240	240
q3	2166	2621	2255	2255
q4	1530	1994	1504	1504
q5	4583	4445	4324	4324
q6	207	163	122	122
q7	1942	1901	1777	1777
q8	2577	2535	2531	2531
q9	7219	7229	7103	7103
q10	2967	3170	2776	2776
q11	583	529	487	487
q12	685	747	631	631
q13	3479	3893	3255	3255
q14	305	303	287	287
q15	518	470	472	470
q16	639	671	633	633
q17	1152	1558	1368	1368
q18	7596	7585	7429	7429
q19	798	801	844	801
q20	1942	1979	1865	1865
q21	5284	4659	4591	4591
q22	1064	1064	972	972
Total cold run time: 52719 ms
Total hot run time: 50494 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 183760 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 98115993f1fe4bb35576b1283c4bc05e541dbfb7, data reload: false

query1	1005	492	460	460
query2	6526	1885	1888	1885
query3	6747	222	220	220
query4	26393	23245	23078	23078
query5	4319	640	491	491
query6	287	205	193	193
query7	4626	480	281	281
query8	301	250	233	233
query9	8607	2581	2579	2579
query10	462	311	272	272
query11	15547	15174	14848	14848
query12	158	112	112	112
query13	1659	534	387	387
query14	8817	6070	6030	6030
query15	200	177	170	170
query16	7235	623	496	496
query17	1194	735	545	545
query18	1978	394	286	286
query19	188	178	154	154
query20	123	118	117	117
query21	213	129	114	114
query22	4060	4141	3964	3964
query23	33930	33086	33017	33017
query24	8419	2327	2356	2327
query25	521	442	389	389
query26	1234	262	151	151
query27	2755	499	322	322
query28	4296	2432	2425	2425
query29	757	547	423	423
query30	283	222	196	196
query31	953	874	759	759
query32	74	65	63	63
query33	562	360	303	303
query34	774	844	518	518
query35	785	818	726	726
query36	958	976	888	888
query37	117	94	72	72
query38	4216	4104	4199	4104
query39	1435	1402	1416	1402
query40	211	118	105	105
query41	56	53	53	53
query42	122	104	103	103
query43	483	497	481	481
query44	1323	813	810	810
query45	178	169	167	167
query46	822	1010	612	612
query47	1743	1799	1713	1713
query48	375	416	305	305
query49	782	512	441	441
query50	642	680	401	401
query51	4271	4214	4181	4181
query52	102	101	101	101
query53	232	256	177	177
query54	567	579	491	491
query55	80	77	84	77
query56	307	311	320	311
query57	1159	1131	1077	1077
query58	271	257	265	257
query59	2563	2703	2512	2512
query60	325	337	307	307
query61	133	131	128	128
query62	794	739	662	662
query63	230	185	186	185
query64	4382	1008	681	681
query65	4368	4257	4267	4257
query66	1153	409	313	313
query67	15724	15653	15337	15337
query68	5649	907	521	521
query69	492	312	274	274
query70	1169	1117	1110	1110
query71	409	323	313	313
query72	5698	4703	2312	2312
query73	656	639	345	345
query74	9130	9123	9028	9028
query75	3195	3225	2726	2726
query76	3193	1164	768	768
query77	563	367	295	295
query78	10067	10278	9308	9308
query79	1928	809	569	569
query80	660	514	455	455
query81	499	254	218	218
query82	211	132	97	97
query83	258	261	241	241
query84	244	107	84	84
query85	746	351	308	308
query86	376	304	265	265
query87	4482	4617	4324	4324
query88	2939	2246	2236	2236
query89	377	309	281	281
query90	2000	213	219	213
query91	138	148	113	113
query92	77	60	59	59
query93	2444	946	585	585
query94	676	415	315	315
query95	376	297	325	297
query96	482	562	274	274
query97	3109	3229	3107	3107
query98	244	198	214	198
query99	1327	1379	1276	1276
Total cold run time: 269926 ms
Total hot run time: 183760 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.06 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 98115993f1fe4bb35576b1283c4bc05e541dbfb7, data reload: false

query1	0.04	0.04	0.03
query2	0.11	0.11	0.10
query3	0.26	0.20	0.19
query4	1.59	0.19	0.20
query5	0.60	0.59	0.57
query6	1.16	0.73	0.73
query7	0.03	0.02	0.02
query8	0.04	0.04	0.03
query9	0.57	0.51	0.52
query10	0.58	0.57	0.59
query11	0.16	0.11	0.12
query12	0.15	0.12	0.11
query13	0.62	0.60	0.60
query14	2.68	2.68	2.73
query15	0.92	0.85	0.84
query16	0.38	0.38	0.37
query17	1.05	1.02	1.02
query18	0.21	0.19	0.19
query19	1.88	2.00	1.82
query20	0.01	0.02	0.01
query21	15.35	0.90	0.55
query22	0.77	1.13	0.77
query23	14.86	1.40	0.63
query24	7.30	0.97	0.62
query25	0.54	0.24	0.13
query26	0.57	0.16	0.15
query27	0.06	0.05	0.04
query28	9.03	0.91	0.43
query29	12.58	4.05	3.34
query30	0.25	0.09	0.06
query31	2.82	0.59	0.40
query32	3.23	0.54	0.46
query33	3.04	3.01	3.05
query34	15.81	5.13	4.49
query35	4.52	4.50	4.48
query36	0.66	0.50	0.48
query37	0.09	0.07	0.07
query38	0.05	0.03	0.04
query39	0.03	0.03	0.03
query40	0.17	0.13	0.13
query41	0.08	0.02	0.03
query42	0.04	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 104.92 s
Total hot run time: 31.06 s

@suxiaogang223
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TeamCity cloud ut coverage result:
Function Coverage: 83.07% (1089/1311)
Line Coverage: 66.04% (18155/27489)
Region Coverage: 65.48% (8943/13657)
Branch Coverage: 55.28% (4814/8708)
Coverage Report: http://coverage.selectdb-in.cc/coverage/4ec953d474f5ce846fbea5bc1805de872063e07e_4ec953d474f5ce846fbea5bc1805de872063e07e_cloud/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 34335 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4ec953d474f5ce846fbea5bc1805de872063e07e, data reload: false

------ Round 1 ----------------------------------
q1	26036	5038	5030	5030
q2	2068	283	185	185
q3	10545	1265	690	690
q4	10239	1027	529	529
q5	7851	2406	2380	2380
q6	190	163	132	132
q7	920	760	623	623
q8	9323	1352	1149	1149
q9	6762	5166	5130	5130
q10	6805	2294	1907	1907
q11	493	284	267	267
q12	343	353	226	226
q13	17792	3668	3062	3062
q14	236	233	211	211
q15	563	506	518	506
q16	630	603	588	588
q17	595	865	357	357
q18	7586	7321	7176	7176
q19	1538	962	552	552
q20	326	336	215	215
q21	3961	3422	2454	2454
q22	1090	1017	966	966
Total cold run time: 115892 ms
Total hot run time: 34335 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5143	5142	5126	5126
q2	238	324	224	224
q3	2176	2632	2279	2279
q4	1450	1863	1515	1515
q5	4579	4511	4357	4357
q6	215	166	124	124
q7	1961	1901	1739	1739
q8	2574	2549	2592	2549
q9	7210	7062	7288	7062
q10	2940	3168	2775	2775
q11	576	514	512	512
q12	676	784	629	629
q13	3546	3870	3221	3221
q14	273	300	288	288
q15	543	494	484	484
q16	651	691	655	655
q17	1188	1547	1354	1354
q18	7706	7514	7364	7364
q19	801	819	935	819
q20	1987	2016	1943	1943
q21	5325	4714	4720	4714
q22	1092	1033	972	972
Total cold run time: 52850 ms
Total hot run time: 50705 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186905 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4ec953d474f5ce846fbea5bc1805de872063e07e, data reload: false

query1	1011	505	492	492
query2	6534	1913	1903	1903
query3	6743	221	218	218
query4	26446	23602	23042	23042
query5	4350	624	463	463
query6	296	206	192	192
query7	4617	493	276	276
query8	295	257	247	247
query9	8631	2613	2604	2604
query10	485	325	264	264
query11	15498	15117	15225	15117
query12	168	108	109	108
query13	1667	523	392	392
query14	8741	6245	6112	6112
query15	201	201	171	171
query16	7190	664	496	496
query17	1213	748	593	593
query18	1992	409	304	304
query19	197	189	161	161
query20	122	121	122	121
query21	208	123	111	111
query22	4185	4167	4274	4167
query23	34082	33097	33121	33097
query24	8435	2395	2384	2384
query25	548	456	394	394
query26	1240	262	188	188
query27	2723	496	333	333
query28	4301	2464	2404	2404
query29	765	565	419	419
query30	286	224	187	187
query31	911	854	796	796
query32	79	66	68	66
query33	579	359	308	308
query34	778	844	512	512
query35	787	810	750	750
query36	948	986	907	907
query37	115	95	77	77
query38	4142	4264	4149	4149
query39	1441	1402	1416	1402
query40	214	119	104	104
query41	56	57	52	52
query42	121	107	104	104
query43	483	488	488	488
query44	1293	795	802	795
query45	178	176	165	165
query46	827	1003	616	616
query47	1766	1815	1723	1723
query48	374	424	307	307
query49	764	528	410	410
query50	627	673	407	407
query51	4141	4216	4122	4122
query52	108	112	102	102
query53	223	253	186	186
query54	572	585	541	541
query55	88	83	81	81
query56	298	291	305	291
query57	1118	1117	1065	1065
query58	268	259	263	259
query59	2563	2761	2505	2505
query60	327	312	302	302
query61	133	123	128	123
query62	786	711	675	675
query63	222	184	185	184
query64	4388	1019	695	695
query65	4281	4249	4230	4230
query66	1144	418	312	312
query67	15769	15612	15322	15322
query68	8237	887	523	523
query69	486	293	271	271
query70	1196	1147	1117	1117
query71	486	317	292	292
query72	5627	4670	4601	4601
query73	702	562	347	347
query74	8958	9101	8987	8987
query75	3943	3202	2720	2720
query76	3753	1188	761	761
query77	785	387	283	283
query78	10108	10025	9214	9214
query79	3345	824	558	558
query80	644	512	442	442
query81	501	258	226	226
query82	462	123	99	99
query83	300	252	243	243
query84	302	117	87	87
query85	794	466	316	316
query86	335	310	298	298
query87	4450	4477	4405	4405
query88	2873	2238	2258	2238
query89	438	316	285	285
query90	1938	220	220	220
query91	145	145	111	111
query92	85	61	61	61
query93	2183	965	576	576
query94	669	409	386	386
query95	384	292	293	292
query96	493	570	275	275
query97	3209	3234	3081	3081
query98	230	207	200	200
query99	1435	1383	1297	1297
Total cold run time: 275578 ms
Total hot run time: 186905 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.08 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4ec953d474f5ce846fbea5bc1805de872063e07e, data reload: false

query1	0.04	0.03	0.04
query2	0.11	0.11	0.10
query3	0.25	0.19	0.20
query4	1.59	0.18	0.20
query5	0.58	0.57	0.58
query6	1.18	0.72	0.72
query7	0.03	0.02	0.02
query8	0.04	0.03	0.03
query9	0.60	0.51	0.51
query10	0.59	0.57	0.57
query11	0.16	0.11	0.11
query12	0.15	0.12	0.11
query13	0.62	0.61	0.60
query14	2.71	2.82	2.73
query15	0.92	0.84	0.83
query16	0.39	0.39	0.37
query17	1.06	1.00	1.06
query18	0.21	0.20	0.19
query19	1.90	2.03	1.89
query20	0.01	0.01	0.01
query21	15.38	0.95	0.55
query22	0.78	1.31	0.68
query23	14.79	1.38	0.63
query24	6.82	1.91	0.72
query25	0.48	0.18	0.08
query26	0.63	0.17	0.15
query27	0.05	0.06	0.04
query28	9.67	0.93	0.44
query29	12.56	4.01	3.26
query30	0.24	0.09	0.06
query31	2.84	0.60	0.38
query32	3.22	0.54	0.46
query33	3.02	3.00	3.07
query34	15.74	5.17	4.53
query35	4.56	4.54	4.53
query36	0.67	0.51	0.49
query37	0.08	0.06	0.06
query38	0.06	0.04	0.04
query39	0.03	0.02	0.03
query40	0.17	0.14	0.14
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 105.07 s
Total hot run time: 31.08 s

@doris-robot
Copy link

TPC-DS: Total hot run time: 193042 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9d838b957ad0c3353522089af67f17869f9def46, data reload: false

query1	1453	1115	1077	1077
query2	6197	1871	1893	1871
query3	11060	4439	4572	4439
query4	25461	23524	22982	22982
query5	3412	651	471	471
query6	304	209	205	205
query7	3986	498	278	278
query8	298	232	228	228
query9	8458	2565	2577	2565
query10	465	323	267	267
query11	15150	15426	14958	14958
query12	172	115	109	109
query13	1562	537	401	401
query14	9047	6490	6465	6465
query15	213	186	167	167
query16	7239	604	477	477
query17	1200	748	601	601
query18	1983	418	340	340
query19	214	217	168	168
query20	127	127	124	124
query21	206	129	121	121
query22	4470	4530	4516	4516
query23	34418	33619	33661	33619
query24	8716	2483	2502	2483
query25	529	464	388	388
query26	1282	274	152	152
query27	2893	501	340	340
query28	4957	2162	2154	2154
query29	822	593	447	447
query30	285	231	192	192
query31	910	861	770	770
query32	76	67	66	66
query33	546	366	323	323
query34	845	898	550	550
query35	829	881	811	811
query36	955	988	889	889
query37	119	101	79	79
query38	4138	4280	4241	4241
query39	1493	1433	1442	1433
query40	224	123	117	117
query41	58	53	54	53
query42	122	105	105	105
query43	518	518	489	489
query44	1417	816	809	809
query45	199	179	172	172
query46	888	1040	662	662
query47	1821	1865	1764	1764
query48	391	419	307	307
query49	753	542	422	422
query50	695	713	431	431
query51	4217	4298	4207	4207
query52	107	107	105	105
query53	253	273	194	194
query54	599	595	524	524
query55	86	83	84	83
query56	318	307	303	303
query57	1169	1197	1115	1115
query58	266	259	259	259
query59	2769	2725	2712	2712
query60	352	334	303	303
query61	135	134	140	134
query62	805	748	675	675
query63	237	199	188	188
query64	4242	1040	707	707
query65	4433	4379	4419	4379
query66	1256	408	320	320
query67	16003	15553	15155	15155
query68	8773	896	511	511
query69	477	296	344	296
query70	1216	1141	1091	1091
query71	477	313	291	291
query72	5609	4709	4793	4709
query73	724	610	347	347
query74	8963	8933	8750	8750
query75	3895	3185	2660	2660
query76	3740	1192	772	772
query77	759	374	280	280
query78	10013	9844	9347	9347
query79	3073	815	563	563
query80	748	553	441	441
query81	490	260	218	218
query82	503	127	93	93
query83	288	252	234	234
query84	299	102	91	91
query85	791	351	318	318
query86	374	292	271	271
query87	4450	4409	4414	4409
query88	3554	2233	2202	2202
query89	433	318	293	293
query90	1847	218	210	210
query91	142	139	108	108
query92	76	59	57	57
query93	2927	926	583	583
query94	652	414	307	307
query95	364	296	309	296
query96	486	573	276	276
query97	3172	3275	3082	3082
query98	241	202	198	198
query99	1463	1528	1277	1277
Total cold run time: 281842 ms
Total hot run time: 193042 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.07 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9d838b957ad0c3353522089af67f17869f9def46, data reload: false

query1	0.04	0.03	0.03
query2	0.15	0.10	0.12
query3	0.35	0.20	0.20
query4	1.60	0.20	0.20
query5	0.61	0.59	0.60
query6	1.18	0.71	0.72
query7	0.02	0.02	0.01
query8	0.05	0.04	0.05
query9	0.62	0.51	0.53
query10	0.56	0.59	0.57
query11	0.26	0.12	0.12
query12	0.24	0.13	0.13
query13	0.63	0.63	0.62
query14	1.18	1.24	1.22
query15	0.94	0.86	0.84
query16	0.37	0.36	0.36
query17	1.02	1.04	1.04
query18	0.17	0.18	0.18
query19	1.94	1.84	1.75
query20	0.01	0.01	0.01
query21	15.44	0.97	0.66
query22	0.93	1.02	0.77
query23	14.71	1.50	0.73
query24	4.94	0.60	0.31
query25	0.16	0.10	0.08
query26	0.55	0.22	0.18
query27	0.09	0.09	0.09
query28	11.10	1.18	0.56
query29	12.55	4.08	3.46
query30	0.30	0.09	0.06
query31	2.82	0.63	0.42
query32	3.21	0.58	0.50
query33	3.07	3.11	3.04
query34	16.85	5.08	4.40
query35	4.47	4.44	4.48
query36	0.63	0.51	0.50
query37	0.20	0.17	0.17
query38	0.17	0.16	0.15
query39	0.05	0.04	0.04
query40	0.19	0.15	0.16
query41	0.11	0.05	0.05
query42	0.06	0.04	0.05
query43	0.05	0.05	0.04
Total cold run time: 104.59 s
Total hot run time: 30.07 s

@suxiaogang223
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TeamCity cloud ut coverage result:
Function Coverage: 82.93% (1093/1318)
Line Coverage: 65.69% (18271/27814)
Region Coverage: 65.08% (9047/13902)
Branch Coverage: 55.09% (4874/8848)
Coverage Report: http://coverage.selectdb-in.cc/coverage/2b5b5480601807c8c4594bc8873ba9ef93d7d510_2b5b5480601807c8c4594bc8873ba9ef93d7d510_cloud/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 33952 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2b5b5480601807c8c4594bc8873ba9ef93d7d510, data reload: false

------ Round 1 ----------------------------------
q1	25953	5070	4981	4981
q2	2070	273	196	196
q3	10397	1273	710	710
q4	10237	1032	569	569
q5	8034	2399	2369	2369
q6	180	162	131	131
q7	964	747	613	613
q8	9336	1296	1141	1141
q9	6807	5088	5172	5088
q10	6858	2294	1869	1869
q11	476	280	262	262
q12	349	355	220	220
q13	17790	3672	3086	3086
q14	222	232	211	211
q15	527	484	487	484
q16	440	454	400	400
q17	601	877	364	364
q18	7634	7194	7090	7090
q19	1542	963	550	550
q20	331	331	214	214
q21	4216	3287	2444	2444
q22	1049	1013	960	960
Total cold run time: 116013 ms
Total hot run time: 33952 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5148	5085	5099	5085
q2	231	326	227	227
q3	2192	2632	2281	2281
q4	1445	1863	1447	1447
q5	4470	4438	4415	4415
q6	209	168	128	128
q7	1981	1925	1774	1774
q8	2584	2538	2541	2538
q9	7322	7167	7119	7119
q10	2970	3157	2800	2800
q11	579	499	492	492
q12	689	770	649	649
q13	3492	3926	3275	3275
q14	303	292	273	273
q15	531	480	477	477
q16	444	517	455	455
q17	1162	1609	1395	1395
q18	7677	7726	7512	7512
q19	816	899	867	867
q20	1959	1947	1812	1812
q21	5235	4943	4917	4917
q22	1097	1057	1041	1041
Total cold run time: 52536 ms
Total hot run time: 50979 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192670 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2b5b5480601807c8c4594bc8873ba9ef93d7d510, data reload: false

query1	1406	1083	1075	1075
query2	6043	1856	1868	1856
query3	11160	4588	4703	4588
query4	53428	25034	22973	22973
query5	4956	552	469	469
query6	345	210	199	199
query7	4957	507	283	283
query8	308	251	238	238
query9	5433	2579	2565	2565
query10	445	325	260	260
query11	14990	15043	14882	14882
query12	152	107	102	102
query13	1024	511	406	406
query14	10159	6420	6307	6307
query15	212	198	173	173
query16	7220	683	513	513
query17	1067	721	632	632
query18	1665	415	300	300
query19	191	191	155	155
query20	126	127	124	124
query21	207	122	105	105
query22	4357	4446	4209	4209
query23	34427	33493	33632	33493
query24	6638	2437	2489	2437
query25	503	500	391	391
query26	690	279	155	155
query27	2320	504	346	346
query28	2976	2154	2124	2124
query29	579	549	476	476
query30	272	216	190	190
query31	864	873	773	773
query32	72	64	70	64
query33	469	356	303	303
query34	768	859	504	504
query35	812	851	778	778
query36	952	989	913	913
query37	121	106	77	77
query38	4202	4308	4217	4217
query39	1520	1453	1478	1453
query40	209	121	107	107
query41	54	51	48	48
query42	133	116	109	109
query43	527	511	488	488
query44	1328	837	803	803
query45	189	175	168	168
query46	851	1069	661	661
query47	1888	1895	1817	1817
query48	376	418	309	309
query49	662	501	406	406
query50	667	698	412	412
query51	4190	4197	4219	4197
query52	106	111	102	102
query53	231	255	185	185
query54	594	595	532	532
query55	87	85	81	81
query56	305	301	283	283
query57	1155	1203	1136	1136
query58	261	269	272	269
query59	2750	2839	2711	2711
query60	326	311	316	311
query61	129	126	141	126
query62	746	728	682	682
query63	219	188	193	188
query64	1726	1032	676	676
query65	4413	4299	4179	4179
query66	705	399	303	303
query67	15630	15557	15396	15396
query68	4590	851	522	522
query69	521	292	262	262
query70	1157	1120	1090	1090
query71	504	305	289	289
query72	5967	4837	4917	4837
query73	856	681	335	335
query74	9237	9143	8988	8988
query75	3176	3204	2727	2727
query76	3508	1188	730	730
query77	538	389	284	284
query78	10130	10087	9262	9262
query79	2607	812	571	571
query80	661	528	456	456
query81	468	258	222	222
query82	278	126	94	94
query83	242	247	234	234
query84	300	103	83	83
query85	768	345	307	307
query86	356	299	278	278
query87	4331	4443	4447	4443
query88	3518	2161	2189	2161
query89	387	318	279	279
query90	1713	211	204	204
query91	149	151	122	122
query92	75	59	55	55
query93	2153	923	573	573
query94	677	414	293	293
query95	370	292	290	290
query96	474	574	267	267
query97	3147	3235	3100	3100
query98	245	211	204	204
query99	1332	1466	1315	1315
Total cold run time: 292928 ms
Total hot run time: 192670 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.33 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2b5b5480601807c8c4594bc8873ba9ef93d7d510, data reload: false

query1	0.04	0.04	0.03
query2	0.15	0.10	0.10
query3	0.35	0.19	0.20
query4	1.59	0.19	0.20
query5	0.60	0.62	0.60
query6	1.18	0.73	0.73
query7	0.02	0.02	0.01
query8	0.06	0.04	0.04
query9	0.62	0.51	0.51
query10	0.57	0.58	0.58
query11	0.26	0.13	0.12
query12	0.27	0.13	0.14
query13	0.63	0.63	0.61
query14	1.17	1.19	1.20
query15	0.96	0.86	0.85
query16	0.37	0.37	0.38
query17	1.07	1.08	1.05
query18	0.18	0.18	0.18
query19	1.98	1.80	1.85
query20	0.01	0.01	0.02
query21	15.40	0.98	0.68
query22	0.92	0.94	0.78
query23	14.80	1.57	0.78
query24	5.48	0.59	0.28
query25	0.17	0.09	0.09
query26	0.55	0.22	0.18
query27	0.09	0.08	0.08
query28	11.03	1.26	0.57
query29	12.53	4.15	3.44
query30	0.28	0.09	0.06
query31	2.82	0.66	0.42
query32	3.23	0.59	0.49
query33	3.04	3.16	3.12
query34	16.77	5.23	4.42
query35	4.53	4.50	4.50
query36	0.64	0.50	0.49
query37	0.19	0.17	0.17
query38	0.17	0.16	0.15
query39	0.05	0.04	0.04
query40	0.18	0.15	0.15
query41	0.11	0.06	0.05
query42	0.06	0.05	0.05
query43	0.06	0.05	0.05
Total cold run time: 105.18 s
Total hot run time: 30.33 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 39.13% (9/23) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 53.54% (14536/27148)
Line Coverage 42.37% (125990/297350)
Region Coverage 41.18% (64391/156350)
Branch Coverage 35.76% (32370/90508)

@hello-stephen
Copy link
Contributor

BE Regression P0 && UT Coverage Report

Increment line coverage 39.13% (9/23) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage
Line Coverage
Region Coverage
Branch Coverage

@kaka11chen kaka11chen changed the title [fix](orc) fix orc push down and materialization for hive acid table [fix](orc) fix orc push down for hive acid table Apr 23, 2025
Copy link
Contributor

@kaka11chen kaka11chen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Apr 23, 2025
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@morningman morningman merged commit 2484c35 into apache:master Apr 23, 2025
28 of 29 checks passed
koarz pushed a commit to koarz/doris that referenced this pull request Jun 4, 2025
### What problem does this PR solve?
### Release note
relate pr: apache#43255

Improved ACID table column handling
- Added support for ACID column prefix in ORC column initialization
- Fixed column name handling for ACID tables
- Improved type mapping for ACID table columns
suxiaogang223 added a commit to suxiaogang223/doris that referenced this pull request Jun 24, 2025
relate pr: apache#43255

Improved ACID table column handling
- Added support for ACID column prefix in ORC column initialization
- Fixed column name handling for ACID tables
- Improved type mapping for ACID table columns
suxiaogang223 added a commit to suxiaogang223/doris that referenced this pull request Jun 25, 2025
relate pr: apache#43255

Improved ACID table column handling
- Added support for ACID column prefix in ORC column initialization
- Fixed column name handling for ACID tables
- Improved type mapping for ACID table columns
morningman pushed a commit to suxiaogang223/doris that referenced this pull request Jun 25, 2025
relate pr: apache#43255

Improved ACID table column handling
- Added support for ACID column prefix in ORC column initialization
- Fixed column name handling for ACID tables
- Improved type mapping for ACID table columns
suxiaogang223 added a commit to suxiaogang223/doris that referenced this pull request Jun 26, 2025
relate pr: apache#43255

Improved ACID table column handling
- Added support for ACID column prefix in ORC column initialization
- Fixed column name handling for ACID tables
- Improved type mapping for ACID table columns
morrySnow pushed a commit that referenced this pull request Jun 27, 2025
@suxiaogang223 suxiaogang223 deleted the fix_push_down branch January 17, 2026 15:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.x-experimental dev/3.1.0-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants