Skip to content

Conversation

@CalvinKirs
Copy link
Member

cherry pick #56861

@CalvinKirs CalvinKirs requested a review from morrySnow as a code owner October 22, 2025 03:39
@Thearas
Copy link
Contributor

Thearas commented Oct 22, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@CalvinKirs
Copy link
Member Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33554 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b7351102a8c1714ca465f268a1fcc6f7be980805, data reload: false

------ Round 1 ----------------------------------
q1	17609	5590	5484	5484
q2	2044	433	291	291
q3	12254	1270	774	774
q4	10536	891	491	491
q5	9485	2448	2249	2249
q6	199	172	140	140
q7	925	736	635	635
q8	9366	1480	1238	1238
q9	5361	5068	4996	4996
q10	6823	2283	1879	1879
q11	502	306	281	281
q12	356	393	230	230
q13	17770	3631	3058	3058
q14	243	229	231	229
q15	540	479	467	467
q16	456	454	390	390
q17	677	883	410	410
q18	7195	6335	6484	6335
q19	1237	986	579	579
q20	369	363	228	228
q21	3319	2380	2137	2137
q22	1098	1055	1033	1033
Total cold run time: 108364 ms
Total hot run time: 33554 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5603	5577	5596	5577
q2	244	334	237	237
q3	2305	2686	2383	2383
q4	1401	1816	1387	1387
q5	4585	5082	5090	5082
q6	177	166	142	142
q7	2078	1961	1847	1847
q8	2752	2886	2766	2766
q9	7336	7367	7381	7367
q10	2966	3295	2821	2821
q11	599	532	516	516
q12	730	792	620	620
q13	3471	3835	3238	3238
q14	302	310	279	279
q15	524	473	485	473
q16	440	510	451	451
q17	1263	1760	1292	1292
q18	7818	7497	7521	7497
q19	864	1087	1182	1087
q20	2069	2125	1980	1980
q21	5655	4997	4860	4860
q22	1134	1178	1082	1082
Total cold run time: 54316 ms
Total hot run time: 52984 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 199027 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b7351102a8c1714ca465f268a1fcc6f7be980805, data reload: false

query1	975	402	401	401
query2	6339	2118	2134	2118
query3	8702	223	220	220
query4	34211	24015	23623	23623
query5	3582	632	511	511
query6	302	204	186	186
query7	4216	535	346	346
query8	307	258	260	258
query9	9488	2933	2965	2933
query10	493	349	292	292
query11	18529	15540	15905	15540
query12	162	116	116	116
query13	1567	602	469	469
query14	9163	8025	7422	7422
query15	236	203	184	184
query16	8036	672	538	538
query17	1567	821	640	640
query18	2135	441	366	366
query19	236	195	182	182
query20	138	128	131	128
query21	221	135	117	117
query22	4681	4808	4714	4714
query23	35265	34940	34705	34705
query24	7512	2891	2865	2865
query25	576	495	470	470
query26	1099	300	189	189
query27	2045	531	405	405
query28	5705	2521	2482	2482
query29	831	632	478	478
query30	250	199	174	174
query31	1026	958	856	856
query32	103	89	62	62
query33	512	387	322	322
query34	815	910	570	570
query35	801	863	775	775
query36	1100	1105	1022	1022
query37	120	97	74	74
query38	4088	4067	4109	4067
query39	1549	1541	1494	1494
query40	216	118	117	117
query41	56	53	53	53
query42	125	113	116	113
query43	560	560	530	530
query44	1456	925	927	925
query45	196	200	186	186
query46	967	1100	722	722
query47	2013	2045	1998	1998
query48	457	469	390	390
query49	796	520	436	436
query50	730	737	468	468
query51	7644	7494	7470	7470
query52	117	111	101	101
query53	258	285	219	219
query54	610	612	505	505
query55	86	86	87	86
query56	287	301	260	260
query57	1289	1297	1235	1235
query58	250	231	243	231
query59	3229	3386	3260	3260
query60	314	306	292	292
query61	127	119	123	119
query62	830	775	696	696
query63	256	233	211	211
query64	4536	1046	700	700
query65	3455	3363	3360	3360
query66	999	414	320	320
query67	16780	16173	15944	15944
query68	7663	877	607	607
query69	503	340	295	295
query70	1323	1265	1191	1191
query71	376	314	290	290
query72	5892	3832	3829	3829
query73	705	791	387	387
query74	10287	9249	9313	9249
query75	3266	3192	2762	2762
query76	3191	1208	824	824
query77	625	405	305	305
query78	10542	10614	9780	9780
query79	3439	985	645	645
query80	664	571	467	467
query81	503	261	230	230
query82	576	123	94	94
query83	178	170	157	157
query84	250	110	89	89
query85	791	370	315	315
query86	397	338	327	327
query87	4413	4407	4350	4350
query88	5318	2686	2664	2664
query89	428	346	304	304
query90	1835	193	192	192
query91	146	157	118	118
query92	71	56	54	54
query93	2050	946	593	593
query94	684	388	335	335
query95	370	305	296	296
query96	546	640	311	311
query97	3179	3258	3168	3168
query98	245	220	214	214
query99	1518	1429	1324	1324
Total cold run time: 299296 ms
Total hot run time: 199027 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.51 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b7351102a8c1714ca465f268a1fcc6f7be980805, data reload: false

query1	0.04	0.04	0.04
query2	0.07	0.03	0.03
query3	0.24	0.07	0.06
query4	1.60	0.10	0.10
query5	0.51	0.50	0.50
query6	1.13	0.74	0.72
query7	0.02	0.02	0.02
query8	0.05	0.04	0.03
query9	0.56	0.52	0.50
query10	0.56	0.58	0.56
query11	0.16	0.10	0.10
query12	0.15	0.11	0.12
query13	0.64	0.61	0.61
query14	0.81	0.80	0.80
query15	0.86	0.84	0.84
query16	0.39	0.42	0.41
query17	1.05	1.07	1.11
query18	0.26	0.22	0.23
query19	1.94	1.90	2.00
query20	0.02	0.01	0.02
query21	15.36	0.98	0.60
query22	0.73	0.90	0.68
query23	14.96	1.51	0.59
query24	3.17	0.85	1.53
query25	0.13	0.10	0.14
query26	0.34	0.15	0.15
query27	0.05	0.05	0.04
query28	13.75	1.04	0.46
query29	12.61	4.11	3.47
query30	0.28	0.10	0.07
query31	2.81	0.63	0.41
query32	3.24	0.55	0.48
query33	3.02	3.05	3.12
query34	16.66	5.27	4.54
query35	4.61	4.56	4.57
query36	0.66	0.50	0.48
query37	0.10	0.06	0.07
query38	0.05	0.05	0.04
query39	0.04	0.03	0.03
query40	0.17	0.14	0.14
query41	0.09	0.03	0.02
query42	0.04	0.03	0.03
query43	0.04	0.03	0.04
Total cold run time: 103.97 s
Total hot run time: 29.51 s

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage 37.63% (73/194) 🎉
Increment coverage report
Complete coverage report

@CalvinKirs
Copy link
Member Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33456 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5327830fa0e12a4aa7468d11a0a6930116baa7e2, data reload: false

------ Round 1 ----------------------------------
q1	17612	5537	5483	5483
q2	2035	409	287	287
q3	12140	1266	782	782
q4	10241	874	477	477
q5	8336	2373	2355	2355
q6	187	166	133	133
q7	915	755	626	626
q8	9329	1459	1230	1230
q9	5296	4980	4937	4937
q10	6781	2303	1826	1826
q11	473	303	274	274
q12	359	355	224	224
q13	17781	3667	3083	3083
q14	232	242	213	213
q15	525	461	477	461
q16	437	446	390	390
q17	651	883	397	397
q18	7147	6392	6338	6338
q19	1223	980	582	582
q20	358	366	224	224
q21	3353	2251	2113	2113
q22	1088	1067	1021	1021
Total cold run time: 106499 ms
Total hot run time: 33456 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5548	5524	5543	5524
q2	249	326	234	234
q3	2278	2688	2354	2354
q4	1392	1853	1429	1429
q5	4450	5118	5014	5014
q6	179	172	131	131
q7	2129	2014	1886	1886
q8	2672	2846	2753	2753
q9	7385	7309	7282	7282
q10	3080	3251	2811	2811
q11	587	533	507	507
q12	672	784	643	643
q13	3432	3781	3208	3208
q14	299	317	268	268
q15	530	480	466	466
q16	469	519	459	459
q17	1257	1783	1275	1275
q18	7670	7417	7368	7368
q19	892	1195	1107	1107
q20	2070	2068	1945	1945
q21	5598	5112	4589	4589
q22	1165	1112	1066	1066
Total cold run time: 54003 ms
Total hot run time: 52319 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195937 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5327830fa0e12a4aa7468d11a0a6930116baa7e2, data reload: false

query1	950	413	397	397
query2	6246	2068	2027	2027
query3	8704	216	213	213
query4	33378	24080	23703	23703
query5	3706	630	465	465
query6	302	202	186	186
query7	4204	513	355	355
query8	346	261	251	251
query9	9598	2838	2829	2829
query10	487	341	263	263
query11	17992	15832	15196	15196
query12	161	113	109	109
query13	1568	579	434	434
query14	9870	7375	6763	6763
query15	264	199	187	187
query16	8091	679	538	538
query17	1519	753	605	605
query18	2127	443	336	336
query19	226	198	178	178
query20	125	119	123	119
query21	212	137	112	112
query22	4612	4711	4566	4566
query23	35529	34295	34483	34295
query24	7394	2799	2761	2761
query25	570	499	447	447
query26	1219	297	183	183
query27	2200	506	397	397
query28	5406	2425	2403	2403
query29	810	621	472	472
query30	242	199	164	164
query31	1024	964	808	808
query32	94	66	63	63
query33	523	414	343	343
query34	778	900	556	556
query35	847	876	750	750
query36	1093	1119	1034	1034
query37	122	98	79	79
query38	4141	4013	4004	4004
query39	1534	1530	1495	1495
query40	217	128	118	118
query41	56	50	53	50
query42	139	113	104	104
query43	524	564	530	530
query44	1423	915	891	891
query45	190	181	177	177
query46	937	1110	707	707
query47	2031	2025	2001	2001
query48	440	464	377	377
query49	791	500	434	434
query50	727	728	457	457
query51	7580	7602	7469	7469
query52	111	108	99	99
query53	245	288	207	207
query54	611	617	511	511
query55	83	88	86	86
query56	301	299	265	265
query57	1269	1312	1260	1260
query58	254	235	243	235
query59	3218	3373	3162	3162
query60	304	292	277	277
query61	137	117	132	117
query62	816	757	723	723
query63	247	211	201	201
query64	4725	1031	675	675
query65	3387	3320	3338	3320
query66	967	408	316	316
query67	16516	15927	15817	15817
query68	7642	873	578	578
query69	524	322	289	289
query70	1257	1189	1178	1178
query71	364	293	281	281
query72	5740	3784	3832	3784
query73	685	773	381	381
query74	10617	9400	9031	9031
query75	3290	3192	2731	2731
query76	3062	1215	791	791
query77	528	388	289	289
query78	10595	10555	9855	9855
query79	3475	934	632	632
query80	667	548	461	461
query81	502	262	223	223
query82	576	129	92	92
query83	169	166	151	151
query84	254	111	87	87
query85	785	357	310	310
query86	402	326	313	313
query87	4348	4341	4357	4341
query88	5351	2660	2653	2653
query89	420	343	309	309
query90	1841	194	199	194
query91	142	143	114	114
query92	71	56	53	53
query93	2091	962	581	581
query94	690	409	315	315
query95	369	294	282	282
query96	537	627	307	307
query97	3214	3288	3146	3146
query98	228	217	208	208
query99	1514	1411	1305	1305
Total cold run time: 298410 ms
Total hot run time: 195937 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.68 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5327830fa0e12a4aa7468d11a0a6930116baa7e2, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.03
query3	0.24	0.07	0.07
query4	1.61	0.11	0.11
query5	0.52	0.52	0.51
query6	1.12	0.74	0.73
query7	0.02	0.02	0.02
query8	0.05	0.04	0.04
query9	0.60	0.50	0.49
query10	0.56	0.56	0.58
query11	0.14	0.11	0.11
query12	0.14	0.11	0.11
query13	0.64	0.61	0.60
query14	0.80	0.84	0.80
query15	0.87	0.85	0.83
query16	0.40	0.41	0.39
query17	1.04	1.09	1.06
query18	0.26	0.24	0.24
query19	1.94	1.78	1.77
query20	0.02	0.02	0.02
query21	15.35	0.99	0.60
query22	0.75	0.75	0.71
query23	15.02	1.52	0.65
query24	2.95	1.50	0.28
query25	0.17	0.10	0.08
query26	0.29	0.15	0.14
query27	0.06	0.04	0.05
query28	12.64	1.14	0.45
query29	12.56	3.97	3.35
query30	0.25	0.09	0.07
query31	2.86	0.63	0.40
query32	3.22	0.56	0.46
query33	3.03	3.03	3.09
query34	16.72	5.24	4.52
query35	4.58	4.63	4.59
query36	0.65	0.51	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.17	0.14	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.05	0.04	0.03
Total cold run time: 102.68 s
Total hot run time: 28.68 s

@morrySnow morrySnow changed the title branch-3.1: [feat](storage)Support Azure Blob Storage (#56861) branch-3.1: [feat](storage)Support Azure Blob Storage #56861 Oct 30, 2025
@morrySnow morrySnow merged commit 6e35555 into apache:branch-3.1 Oct 30, 2025
21 of 22 checks passed
@morrySnow morrySnow mentioned this pull request Nov 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants