Skip to content

Conversation

@kaka11chen
Copy link
Contributor

@kaka11chen kaka11chen commented Nov 12, 2025

What problem does this PR solve?

Problem Summary:

Release note

Optimize performance by reading parquet bloom filter.
parquet bloom filter: https://parquet.apache.org/docs/file-format/bloomfilter/

Query Performance Test Results

SQL Query Optimized Version (time(s)) Original Version (time(s))
SELECT * FROM cqtest.bloom_filter_perf_parquet_duckdb WHERE uuid_string = 'cfcd2084-cfcd-cfcd-cfcd-cfcd208495d4'; 0.02 0.23
SELECT * FROM cqtest.bloom_filter_perf_parquet_duckdb WHERE uuid_string IN ('cfcd2084-cfcd-cfcd-cfcd-cfcd208495d6', 'cfcd2084-cfcd-cfcd-cfcd-cfcd208495d7'); 0.04 0.24

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Nov 12, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@kaka11chen
Copy link
Contributor Author

run buildall

@hello-stephen
Copy link
Contributor

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 80.56% (1683/2089)
Line Coverage 66.68% (29671/44498)
Region Coverage 67.26% (14813/22024)
Branch Coverage 57.54% (7885/13704)

@doris-robot
Copy link

TPC-H: Total hot run time: 34564 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e21ad9d25503d8170cabdca366ecf1eaddf876b1, data reload: false

------ Round 1 ----------------------------------
q1	17417	5216	5105	5105
q2	1990	310	206	206
q3	10174	1327	717	717
q4	10239	965	387	387
q5	7569	2397	2384	2384
q6	180	168	135	135
q7	927	806	624	624
q8	9340	1425	1202	1202
q9	7094	5217	5225	5217
q10	6923	2232	1831	1831
q11	515	311	289	289
q12	376	375	239	239
q13	17791	3670	3015	3015
q14	226	262	215	215
q15	577	510	518	510
q16	1021	1012	935	935
q17	597	886	371	371
q18	7459	7223	7122	7122
q19	1099	976	559	559
q20	355	361	228	228
q21	3808	3193	2296	2296
q22	1076	1059	977	977
Total cold run time: 106753 ms
Total hot run time: 34564 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5266	5186	5185	5185
q2	265	337	233	233
q3	2186	2702	2310	2310
q4	1370	1785	1376	1376
q5	4221	4516	4444	4444
q6	209	182	140	140
q7	2078	1984	1799	1799
q8	2600	2612	2563	2563
q9	7418	7350	7399	7350
q10	3156	3236	2783	2783
q11	572	543	508	508
q12	842	758	599	599
q13	3482	3885	3374	3374
q14	317	291	269	269
q15	542	516	525	516
q16	1106	1110	1048	1048
q17	1204	1564	1435	1435
q18	7865	7735	7664	7664
q19	816	808	844	808
q20	2009	2042	1818	1818
q21	4837	4308	4305	4305
q22	1076	1042	1029	1029
Total cold run time: 53437 ms
Total hot run time: 51556 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187453 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e21ad9d25503d8170cabdca366ecf1eaddf876b1, data reload: false

query1	1032	404	395	395
query2	6574	1675	1684	1675
query3	6764	229	228	228
query4	26485	23912	23162	23162
query5	4576	625	483	483
query6	347	249	235	235
query7	4671	495	293	293
query8	296	253	240	240
query9	8706	2603	2606	2603
query10	463	328	287	287
query11	15438	15033	14895	14895
query12	174	126	111	111
query13	1673	558	437	437
query14	10225	9135	9140	9135
query15	204	187	175	175
query16	7337	655	558	558
query17	1232	745	601	601
query18	1969	411	312	312
query19	201	195	169	169
query20	128	133	123	123
query21	214	131	120	120
query22	3969	4067	3911	3911
query23	33969	33131	32998	32998
query24	8395	2396	2415	2396
query25	607	503	441	441
query26	1239	268	157	157
query27	2765	501	349	349
query28	4355	2197	2165	2165
query29	818	606	485	485
query30	300	214	197	197
query31	911	801	733	733
query32	82	76	70	70
query33	585	364	342	342
query34	792	835	540	540
query35	816	811	743	743
query36	925	1000	906	906
query37	120	109	86	86
query38	3520	3541	3445	3445
query39	1480	1424	1406	1406
query40	219	124	117	117
query41	63	60	62	60
query42	127	112	112	112
query43	482	490	473	473
query44	1211	749	737	737
query45	187	183	179	179
query46	886	987	644	644
query47	1734	1795	1722	1722
query48	393	427	328	328
query49	796	544	448	448
query50	646	701	411	411
query51	3823	3885	3875	3875
query52	108	111	104	104
query53	237	263	210	210
query54	322	310	303	303
query55	87	91	83	83
query56	355	330	327	327
query57	1199	1195	1119	1119
query58	298	280	303	280
query59	2520	2679	2571	2571
query60	365	381	340	340
query61	191	182	180	180
query62	790	714	667	667
query63	230	203	199	199
query64	4670	1253	949	949
query65	3995	3976	3955	3955
query66	1188	450	367	367
query67	15483	14980	14949	14949
query68	8358	921	605	605
query69	493	316	301	301
query70	1365	1328	1295	1295
query71	464	348	365	348
query72	6032	4891	4882	4882
query73	644	570	353	353
query74	8841	9062	8681	8681
query75	3707	3349	2765	2765
query76	3525	1161	735	735
query77	783	407	304	304
query78	9610	9720	8858	8858
query79	2243	791	594	594
query80	618	574	502	502
query81	522	259	222	222
query82	456	158	127	127
query83	268	266	252	252
query84	258	110	93	93
query85	941	482	436	436
query86	385	313	307	307
query87	3636	3699	3621	3621
query88	3778	2279	2235	2235
query89	401	325	292	292
query90	1919	219	218	218
query91	179	164	137	137
query92	75	67	66	66
query93	1904	975	662	662
query94	718	444	312	312
query95	415	327	311	311
query96	486	582	281	281
query97	2916	2928	2864	2864
query98	229	212	204	204
query99	1351	1404	1274	1274
Total cold run time: 274482 ms
Total hot run time: 187453 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.33 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e21ad9d25503d8170cabdca366ecf1eaddf876b1, data reload: false

query1	0.05	0.04	0.04
query2	0.13	0.07	0.06
query3	0.31	0.08	0.08
query4	1.61	0.09	0.08
query5	0.26	0.25	0.25
query6	1.16	0.64	0.64
query7	0.03	0.02	0.02
query8	0.08	0.06	0.06
query9	0.63	0.52	0.53
query10	0.58	0.57	0.60
query11	0.25	0.14	0.13
query12	0.26	0.15	0.15
query13	0.65	0.64	0.62
query14	1.02	1.03	1.02
query15	0.94	0.87	0.84
query16	0.40	0.40	0.40
query17	1.03	1.05	1.03
query18	0.24	0.22	0.22
query19	1.99	1.86	1.79
query20	0.02	0.02	0.02
query21	15.39	0.27	0.23
query22	4.98	0.10	0.10
query23	15.34	0.40	0.22
query24	2.96	0.47	0.31
query25	0.09	0.08	0.09
query26	0.18	0.17	0.18
query27	0.09	0.10	0.09
query28	3.70	1.24	1.06
query29	12.54	4.03	3.34
query30	0.33	0.14	0.11
query31	2.82	0.64	0.44
query32	3.25	0.60	0.52
query33	3.05	3.06	3.14
query34	16.73	5.22	4.50
query35	4.54	4.52	4.55
query36	0.66	0.52	0.52
query37	0.23	0.09	0.09
query38	0.20	0.06	0.06
query39	0.06	0.05	0.05
query40	0.21	0.17	0.16
query41	0.12	0.06	0.06
query42	0.07	0.05	0.05
query43	0.07	0.05	0.05
Total cold run time: 99.25 s
Total hot run time: 28.33 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 56.86% (174/306) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.81% (18287/34627)
Line Coverage 38.17% (166256/435516)
Region Coverage 33.15% (129178/389678)
Branch Coverage 33.89% (55449/163603)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 45.10% (138/306) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.54% (24343/34028)
Line Coverage 58.06% (253268/436193)
Region Coverage 53.50% (211429/395190)
Branch Coverage 54.76% (90178/164678)

@kaka11chen kaka11chen force-pushed the parquet_reader_bloom_filter branch from e21ad9d to bbf4733 Compare November 19, 2025 15:48
@kaka11chen
Copy link
Contributor Author

run buildall

@hello-stephen
Copy link
Contributor

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 80.77% (1705/2111)
Line Coverage 66.83% (29835/44644)
Region Coverage 67.35% (14882/22095)
Branch Coverage 57.57% (7917/13752)

@kaka11chen kaka11chen force-pushed the parquet_reader_bloom_filter branch 2 times, most recently from fb8a59b to 1f6f613 Compare November 19, 2025 16:39
@kaka11chen
Copy link
Contributor Author

run buildall

@hello-stephen
Copy link
Contributor

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 80.77% (1705/2111)
Line Coverage 66.88% (29857/44644)
Region Coverage 67.37% (14886/22095)
Branch Coverage 57.62% (7924/13752)

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage `` 🎉
Increment coverage report
Complete coverage report

@kaka11chen kaka11chen force-pushed the parquet_reader_bloom_filter branch from 1f6f613 to 71d0014 Compare November 19, 2025 23:34
@kaka11chen
Copy link
Contributor Author

run buildall

@hello-stephen
Copy link
Contributor

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 80.86% (1707/2111)
Line Coverage 66.82% (29876/44708)
Region Coverage 67.37% (14899/22114)
Branch Coverage 57.57% (7926/13768)

@kaka11chen kaka11chen force-pushed the parquet_reader_bloom_filter branch from 71d0014 to 7a01180 Compare November 20, 2025 01:28
@kaka11chen
Copy link
Contributor Author

run buildall

@hello-stephen
Copy link
Contributor

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 80.86% (1707/2111)
Line Coverage 66.85% (29887/44708)
Region Coverage 67.39% (14903/22114)
Branch Coverage 57.58% (7927/13768)

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage `` 🎉
Increment coverage report
Complete coverage report

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 43.82% (156/356) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.73% (18283/34675)
Line Coverage 38.12% (166236/436107)
Region Coverage 33.06% (129266/391052)
Branch Coverage 33.83% (55456/163941)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 33.71% (120/356) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.43% (24340/34076)
Line Coverage 57.92% (252962/436777)
Region Coverage 53.21% (211039/396629)
Branch Coverage 54.59% (90084/165020)

@kaka11chen kaka11chen force-pushed the parquet_reader_bloom_filter branch from 7a01180 to 6d463b1 Compare November 20, 2025 05:17
@kaka11chen
Copy link
Contributor Author

run buildall

@hello-stephen
Copy link
Contributor

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 80.86% (1707/2111)
Line Coverage 66.88% (29901/44708)
Region Coverage 67.42% (14910/22114)
Branch Coverage 57.64% (7936/13768)

@doris-robot
Copy link

TPC-H: Total hot run time: 35177 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6d463b19664b00f338fc4920db5996838305fda4, data reload: false

------ Round 1 ----------------------------------
q1	17596	5126	4989	4989
q2	2006	325	212	212
q3	10130	1297	739	739
q4	10254	943	380	380
q5	7459	2374	2407	2374
q6	184	168	138	138
q7	901	812	633	633
q8	9363	1355	1122	1122
q9	7351	5347	5384	5347
q10	6909	2222	1789	1789
q11	506	299	289	289
q12	370	369	236	236
q13	17798	3634	3025	3025
q14	231	239	219	219
q15	584	500	506	500
q16	1011	1007	955	955
q17	592	875	369	369
q18	7633	7541	7576	7541
q19	1280	980	568	568
q20	386	339	233	233
q21	4359	3457	2462	2462
q22	1185	1110	1057	1057
Total cold run time: 108088 ms
Total hot run time: 35177 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5277	5202	5194	5194
q2	339	420	328	328
q3	2431	2880	2486	2486
q4	1676	1829	1425	1425
q5	4404	4544	4524	4524
q6	208	166	127	127
q7	2033	1944	1783	1783
q8	2605	2656	2460	2460
q9	7654	7845	7555	7555
q10	2943	3094	2657	2657
q11	577	508	493	493
q12	604	708	563	563
q13	3303	3643	3061	3061
q14	276	287	259	259
q15	534	502	489	489
q16	1019	1049	1006	1006
q17	1108	1470	1359	1359
q18	7295	7169	6969	6969
q19	789	724	794	724
q20	1964	1987	1828	1828
q21	4625	4311	4338	4311
q22	1074	1015	980	980
Total cold run time: 52738 ms
Total hot run time: 50581 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187552 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6d463b19664b00f338fc4920db5996838305fda4, data reload: false

query1	1046	403	396	396
query2	6564	1675	1693	1675
query3	6756	222	232	222
query4	25784	23311	22854	22854
query5	4439	622	500	500
query6	309	233	227	227
query7	4634	493	292	292
query8	298	263	248	248
query9	8704	2571	2595	2571
query10	508	335	286	286
query11	15367	15185	14831	14831
query12	187	113	112	112
query13	1689	558	447	447
query14	10223	9100	9291	9100
query15	197	185	172	172
query16	7164	657	494	494
query17	1173	747	615	615
query18	1990	408	344	344
query19	206	208	186	186
query20	139	128	122	122
query21	221	137	115	115
query22	3931	4113	4035	4035
query23	33974	33014	32947	32947
query24	8453	2392	2395	2392
query25	615	500	445	445
query26	1261	278	160	160
query27	2751	494	349	349
query28	4387	2192	2169	2169
query29	814	614	479	479
query30	295	228	197	197
query31	886	847	743	743
query32	84	71	71	71
query33	570	368	362	362
query34	795	852	529	529
query35	805	823	747	747
query36	952	995	897	897
query37	117	105	87	87
query38	3429	3562	3434	3434
query39	1504	1459	1418	1418
query40	225	128	119	119
query41	67	65	63	63
query42	135	112	113	112
query43	495	499	468	468
query44	1230	769	768	768
query45	184	185	171	171
query46	872	989	642	642
query47	1790	1776	1717	1717
query48	383	420	327	327
query49	774	511	397	397
query50	648	694	421	421
query51	3867	3979	3962	3962
query52	107	122	110	110
query53	244	260	204	204
query54	309	298	283	283
query55	85	91	83	83
query56	328	321	322	321
query57	1171	1201	1103	1103
query58	287	270	271	270
query59	2502	2660	2526	2526
query60	347	350	344	344
query61	166	164	171	164
query62	784	722	669	669
query63	237	194	195	194
query64	4693	1289	989	989
query65	4029	3939	3949	3939
query66	1203	454	340	340
query67	15324	14976	14826	14826
query68	6989	980	644	644
query69	528	330	293	293
query70	1329	1235	1296	1235
query71	463	335	311	311
query72	6412	5108	5162	5108
query73	691	613	356	356
query74	9101	9153	8947	8947
query75	3312	3247	2849	2849
query76	3237	1138	721	721
query77	510	400	339	339
query78	9592	9713	8864	8864
query79	2246	835	610	610
query80	656	559	490	490
query81	518	262	229	229
query82	489	161	134	134
query83	269	263	264	263
query84	275	105	89	89
query85	945	494	431	431
query86	385	300	298	298
query87	3705	3832	3574	3574
query88	3758	2254	2259	2254
query89	382	334	298	298
query90	1927	221	219	219
query91	160	164	138	138
query92	77	72	67	67
query93	1892	1007	675	675
query94	753	461	350	350
query95	407	322	316	316
query96	478	577	287	287
query97	2891	2934	2861	2861
query98	245	216	206	206
query99	1321	1384	1294	1294
Total cold run time: 271650 ms
Total hot run time: 187552 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.42 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 681879af3a7a9f7a7988a7c408e430f42f107ed9, data reload: false

query1	0.05	0.04	0.04
query2	0.13	0.08	0.07
query3	0.30	0.07	0.08
query4	1.60	0.08	0.08
query5	0.26	0.26	0.26
query6	1.16	0.66	0.65
query7	0.03	0.02	0.06
query8	0.07	0.06	0.06
query9	0.64	0.55	0.53
query10	0.58	0.59	0.58
query11	0.25	0.14	0.13
query12	0.26	0.13	0.15
query13	0.64	0.64	0.61
query14	1.04	1.02	1.03
query15	0.94	0.86	0.86
query16	0.38	0.38	0.39
query17	1.03	1.02	1.04
query18	0.23	0.21	0.22
query19	1.94	1.85	1.86
query20	0.01	0.01	0.02
query21	15.40	0.28	0.24
query22	4.98	0.11	0.11
query23	15.40	0.38	0.24
query24	2.77	0.51	0.33
query25	0.10	0.09	0.09
query26	0.19	0.18	0.17
query27	0.10	0.09	0.09
query28	3.60	1.26	1.08
query29	12.54	3.96	3.31
query30	0.33	0.12	0.11
query31	2.85	0.63	0.44
query32	3.23	0.60	0.51
query33	3.02	3.11	3.06
query34	16.56	5.10	4.51
query35	4.55	4.61	4.53
query36	0.65	0.53	0.51
query37	0.23	0.09	0.09
query38	0.21	0.06	0.06
query39	0.05	0.05	0.05
query40	0.20	0.18	0.17
query41	0.11	0.05	0.06
query42	0.07	0.05	0.04
query43	0.06	0.05	0.05
Total cold run time: 98.74 s
Total hot run time: 28.42 s

@kaka11chen kaka11chen force-pushed the parquet_reader_bloom_filter branch from 681879a to d930888 Compare November 26, 2025 06:23
@kaka11chen
Copy link
Contributor Author

run buildall

@hello-stephen
Copy link
Contributor

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 80.86% (1707/2111)
Line Coverage 66.87% (29895/44708)
Region Coverage 67.37% (14898/22114)
Branch Coverage 57.57% (7926/13768)

@doris-robot
Copy link

TPC-H: Total hot run time: 34361 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d93088872ae2da2d5bd5a50c6eda1dc97053183f, data reload: false

------ Round 1 ----------------------------------
q1	17498	5138	4949	4949
q2	2010	312	223	223
q3	10141	1294	717	717
q4	10232	946	368	368
q5	7610	2433	2334	2334
q6	189	178	144	144
q7	979	771	632	632
q8	9344	1423	1054	1054
q9	7221	5321	5272	5272
q10	6881	2262	1822	1822
q11	513	301	290	290
q12	339	372	231	231
q13	17780	3672	3031	3031
q14	236	251	223	223
q15	595	519	514	514
q16	1056	1020	973	973
q17	604	884	364	364
q18	7474	7172	7186	7172
q19	1116	960	541	541
q20	346	335	226	226
q21	3872	3200	2318	2318
q22	1035	1054	963	963
Total cold run time: 107071 ms
Total hot run time: 34361 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4993	4988	5010	4988
q2	330	398	323	323
q3	2213	2737	2324	2324
q4	1375	1771	1339	1339
q5	4298	4478	4564	4478
q6	206	175	138	138
q7	2085	1980	1814	1814
q8	2706	2700	2603	2603
q9	7587	7558	7621	7558
q10	3020	3278	2839	2839
q11	616	518	511	511
q12	745	759	616	616
q13	3554	3945	3307	3307
q14	301	307	292	292
q15	555	527	517	517
q16	1089	1149	1063	1063
q17	1168	1524	1435	1435
q18	7992	7573	7580	7573
q19	797	864	968	864
q20	2041	2293	1889	1889
q21	4909	4382	4379	4379
q22	1110	1069	1002	1002
Total cold run time: 53690 ms
Total hot run time: 51852 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 184847 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d93088872ae2da2d5bd5a50c6eda1dc97053183f, data reload: false

query1	1097	429	388	388
query2	6572	1580	1635	1580
query3	6776	227	221	221
query4	25928	22666	22767	22666
query5	4379	602	480	480
query6	336	233	217	217
query7	4656	508	306	306
query8	291	259	243	243
query9	8697	2579	2547	2547
query10	536	368	314	314
query11	15424	14849	14603	14603
query12	173	122	115	115
query13	1698	590	458	458
query14	10459	8896	8919	8896
query15	216	206	184	184
query16	7372	688	537	537
query17	1264	774	645	645
query18	2004	446	343	343
query19	215	210	196	196
query20	135	129	125	125
query21	218	145	124	124
query22	4043	4096	3954	3954
query23	33341	32145	32141	32141
query24	8486	2433	2409	2409
query25	652	558	502	502
query26	1250	290	167	167
query27	2739	503	360	360
query28	4371	2153	2150	2150
query29	865	648	519	519
query30	312	236	208	208
query31	831	735	637	637
query32	82	78	76	76
query33	621	393	353	353
query34	827	889	570	570
query35	789	835	747	747
query36	920	959	844	844
query37	115	109	84	84
query38	3384	3357	3294	3294
query39	1487	1403	1431	1403
query40	224	130	119	119
query41	67	61	67	61
query42	130	110	116	110
query43	454	477	439	439
query44	1223	749	750	749
query45	197	192	187	187
query46	893	1016	644	644
query47	1713	1744	1666	1666
query48	397	431	334	334
query49	785	503	407	407
query50	669	677	416	416
query51	3942	3894	3876	3876
query52	110	111	102	102
query53	246	266	197	197
query54	317	290	274	274
query55	90	97	88	88
query56	331	325	334	325
query57	1151	1203	1109	1109
query58	286	273	267	267
query59	2439	2534	2424	2424
query60	352	359	334	334
query61	199	170	164	164
query62	769	716	680	680
query63	228	188	193	188
query64	4577	1211	889	889
query65	4082	3991	3986	3986
query66	1188	445	335	335
query67	15360	15302	14966	14966
query68	8467	906	629	629
query69	519	343	317	317
query70	1311	1261	1202	1202
query71	472	342	301	301
query72	5876	4909	4900	4900
query73	662	565	344	344
query74	8718	8963	8584	8584
query75	3915	3324	2850	2850
query76	3764	1134	731	731
query77	824	418	323	323
query78	9561	9724	8830	8830
query79	2207	839	580	580
query80	649	585	498	498
query81	514	277	242	242
query82	446	161	130	130
query83	275	270	263	263
query84	256	117	100	100
query85	921	493	458	458
query86	392	314	291	291
query87	3492	3518	3391	3391
query88	3613	2234	2256	2234
query89	387	342	291	291
query90	1854	221	215	215
query91	176	170	139	139
query92	91	69	64	64
query93	1775	983	666	666
query94	739	439	339	339
query95	504	408	397	397
query96	492	582	280	280
query97	2913	2977	2855	2855
query98	243	213	211	211
query99	1386	1417	1250	1250
Total cold run time: 273394 ms
Total hot run time: 184847 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.42 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d93088872ae2da2d5bd5a50c6eda1dc97053183f, data reload: false

query1	0.06	0.05	0.05
query2	0.12	0.06	0.06
query3	0.31	0.08	0.07
query4	1.61	0.09	0.09
query5	0.26	0.25	0.25
query6	1.18	0.66	0.64
query7	0.03	0.02	0.02
query8	0.07	0.06	0.06
query9	0.64	0.53	0.54
query10	0.59	0.59	0.59
query11	0.26	0.14	0.14
query12	0.26	0.14	0.15
query13	0.65	0.63	0.62
query14	1.02	1.01	1.03
query15	0.95	0.87	0.85
query16	0.39	0.39	0.39
query17	1.04	1.03	1.04
query18	0.24	0.22	0.22
query19	1.96	1.81	1.80
query20	0.02	0.02	0.01
query21	15.41	0.29	0.23
query22	4.99	0.10	0.10
query23	15.36	0.39	0.22
query24	2.94	0.49	0.31
query25	0.10	0.08	0.09
query26	0.18	0.17	0.18
query27	0.09	0.09	0.08
query28	3.64	1.28	1.08
query29	12.60	3.94	3.29
query30	0.34	0.12	0.10
query31	2.82	0.63	0.44
query32	3.24	0.62	0.51
query33	3.02	3.10	3.15
query34	16.64	5.28	4.61
query35	4.54	4.50	4.52
query36	0.67	0.52	0.51
query37	0.23	0.09	0.09
query38	0.20	0.06	0.06
query39	0.06	0.05	0.05
query40	0.22	0.18	0.17
query41	0.10	0.06	0.06
query42	0.07	0.04	0.05
query43	0.07	0.06	0.05
Total cold run time: 99.19 s
Total hot run time: 28.42 s

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 49.35% (189/383) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.92% (18442/34850)
Line Coverage 38.41% (168695/439140)
Region Coverage 33.20% (130961/394431)
Branch Coverage 34.13% (56332/165066)

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 38.90% (149/383) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.58% (24489/34212)
Line Coverage 58.11% (255262/439292)
Region Coverage 53.21% (212710/399729)
Branch Coverage 54.72% (90875/166059)

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Nov 26, 2025
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@morningman morningman merged commit a7b12a2 into apache:master Nov 27, 2025
25 of 28 checks passed
nagisa-kunhah pushed a commit to nagisa-kunhah/doris that referenced this pull request Dec 14, 2025
…r. (apache#57959)

### What problem does this PR solve?

Problem Summary:

### Release note

Optimize performance by reading parquet bloom filter. 
parquet bloom filter:
https://parquet.apache.org/docs/file-format/bloomfilter/


### Query Performance Test Results

SQL Query | Optimized Version (time(s)) | Original Version (time(s))
-- | -- | --
SELECT * FROM cqtest.bloom_filter_perf_parquet_duckdb WHERE uuid_string
= 'cfcd2084-cfcd-cfcd-cfcd-cfcd208495d4'; | 0.02 | 0.23
SELECT * FROM cqtest.bloom_filter_perf_parquet_duckdb WHERE uuid_string
IN ('cfcd2084-cfcd-cfcd-cfcd-cfcd208495d6',
'cfcd2084-cfcd-cfcd-cfcd-cfcd208495d7'); | 0.04 | 0.24
kaka11chen added a commit to kaka11chen/doris that referenced this pull request Jan 9, 2026
…r. (apache#57959)

### What problem does this PR solve?

Problem Summary:

### Release note

Optimize performance by reading parquet bloom filter. 
parquet bloom filter:
https://parquet.apache.org/docs/file-format/bloomfilter/


### Query Performance Test Results

SQL Query | Optimized Version (time(s)) | Original Version (time(s))
-- | -- | --
SELECT * FROM cqtest.bloom_filter_perf_parquet_duckdb WHERE uuid_string
= 'cfcd2084-cfcd-cfcd-cfcd-cfcd208495d4'; | 0.02 | 0.23
SELECT * FROM cqtest.bloom_filter_perf_parquet_duckdb WHERE uuid_string
IN ('cfcd2084-cfcd-cfcd-cfcd-cfcd208495d6',
'cfcd2084-cfcd-cfcd-cfcd-cfcd208495d7'); | 0.04 | 0.24
kaka11chen added a commit to kaka11chen/doris that referenced this pull request Jan 12, 2026
…r. (apache#57959)

### What problem does this PR solve?

Problem Summary:

### Release note

Optimize performance by reading parquet bloom filter. 
parquet bloom filter:
https://parquet.apache.org/docs/file-format/bloomfilter/


### Query Performance Test Results

SQL Query | Optimized Version (time(s)) | Original Version (time(s))
-- | -- | --
SELECT * FROM cqtest.bloom_filter_perf_parquet_duckdb WHERE uuid_string
= 'cfcd2084-cfcd-cfcd-cfcd-cfcd208495d4'; | 0.02 | 0.23
SELECT * FROM cqtest.bloom_filter_perf_parquet_duckdb WHERE uuid_string
IN ('cfcd2084-cfcd-cfcd-cfcd-cfcd208495d6',
'cfcd2084-cfcd-cfcd-cfcd-cfcd208495d7'); | 0.04 | 0.24
morningman pushed a commit that referenced this pull request Jan 12, 2026
yiguolei pushed a commit that referenced this pull request Jan 13, 2026
…58528 (#58630)

need this pr: #57959
before merge to other branch

Cherry-picked from #58528

Co-authored-by: zhangstar333 <zhangsida@selectdb.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/4.0.3-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants