Skip to content

Conversation

@zzzxl1993
Copy link
Contributor

@zzzxl1993 zzzxl1993 commented Jun 4, 2025

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Jun 4, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@zzzxl1993
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33921 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8e4782c64b152fd6278aefe5ffb6138bf9132c8b, data reload: false

------ Round 1 ----------------------------------
q1	26250	5125	4997	4997
q2	1953	293	188	188
q3	10434	1245	724	724
q4	10225	997	519	519
q5	7712	2368	2330	2330
q6	181	169	146	146
q7	908	735	619	619
q8	9299	1262	1138	1138
q9	6779	5106	5085	5085
q10	6870	2324	1900	1900
q11	496	280	274	274
q12	349	360	219	219
q13	17778	3660	3103	3103
q14	229	236	227	227
q15	564	492	485	485
q16	426	433	376	376
q17	590	861	353	353
q18	7531	7180	7153	7153
q19	2073	995	553	553
q20	340	348	216	216
q21	3802	3231	2373	2373
q22	1062	1004	943	943
Total cold run time: 115851 ms
Total hot run time: 33921 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5211	5056	5233	5056
q2	234	318	226	226
q3	2176	2650	2274	2274
q4	1362	1792	1430	1430
q5	4399	4414	4438	4414
q6	226	172	134	134
q7	1995	1939	1796	1796
q8	2603	2584	2484	2484
q9	7308	7209	6949	6949
q10	3060	3205	2793	2793
q11	574	517	482	482
q12	713	771	615	615
q13	3570	3949	3372	3372
q14	301	299	278	278
q15	525	475	479	475
q16	478	470	449	449
q17	1149	1537	1402	1402
q18	7819	7710	7523	7523
q19	845	804	913	804
q20	1989	2009	1825	1825
q21	4806	4682	4523	4523
q22	1078	1055	1009	1009
Total cold run time: 52421 ms
Total hot run time: 50313 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192498 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8e4782c64b152fd6278aefe5ffb6138bf9132c8b, data reload: false

query1	1392	1108	1082	1082
query2	6174	1839	1793	1793
query3	11054	4594	4547	4547
query4	54499	26087	22991	22991
query5	4905	525	473	473
query6	347	204	189	189
query7	4873	495	285	285
query8	276	225	205	205
query9	5540	2733	2720	2720
query10	457	330	275	275
query11	15001	15016	14830	14830
query12	165	107	105	105
query13	1038	518	414	414
query14	10179	6361	6361	6361
query15	217	198	182	182
query16	7166	640	507	507
query17	1093	747	609	609
query18	1634	432	307	307
query19	208	202	183	183
query20	137	125	116	116
query21	215	131	113	113
query22	4465	4419	4324	4324
query23	34372	33779	33573	33573
query24	6984	2491	2401	2401
query25	465	478	414	414
query26	702	279	151	151
query27	2349	514	347	347
query28	2984	2201	2192	2192
query29	584	581	488	488
query30	276	229	187	187
query31	863	883	787	787
query32	74	70	66	66
query33	449	368	316	316
query34	779	879	538	538
query35	795	835	742	742
query36	936	983	898	898
query37	117	102	107	102
query38	4277	4300	4231	4231
query39	1505	1473	1461	1461
query40	210	121	107	107
query41	61	57	62	57
query42	127	109	110	109
query43	504	518	480	480
query44	1380	868	859	859
query45	178	177	179	177
query46	852	1018	640	640
query47	1824	1863	1786	1786
query48	404	440	321	321
query49	637	509	397	397
query50	664	722	423	423
query51	4307	4330	4253	4253
query52	113	109	104	104
query53	235	260	188	188
query54	582	579	506	506
query55	89	80	82	80
query56	337	299	291	291
query57	1183	1178	1098	1098
query58	274	281	262	262
query59	2739	2794	2635	2635
query60	341	329	339	329
query61	129	126	128	126
query62	754	779	653	653
query63	221	183	182	182
query64	1752	1030	672	672
query65	4209	4129	4186	4129
query66	719	405	304	304
query67	15706	15714	15336	15336
query68	7578	889	523	523
query69	553	305	264	264
query70	1223	1066	1116	1066
query71	516	326	309	309
query72	5915	4683	4661	4661
query73	1483	574	356	356
query74	9258	9127	8997	8997
query75	3913	3225	2843	2843
query76	4162	1190	747	747
query77	649	372	289	289
query78	10117	10169	9251	9251
query79	2747	847	603	603
query80	643	522	457	457
query81	504	257	220	220
query82	505	130	95	95
query83	349	258	252	252
query84	295	110	89	89
query85	846	359	326	326
query86	386	297	300	297
query87	4357	4390	4314	4314
query88	3761	2302	2275	2275
query89	409	322	284	284
query90	1850	218	213	213
query91	144	147	109	109
query92	81	65	59	59
query93	2028	967	575	575
query94	657	446	325	325
query95	371	296	297	296
query96	500	574	283	283
query97	2745	2795	2616	2616
query98	230	207	205	205
query99	1479	1397	1290	1290
Total cold run time: 300331 ms
Total hot run time: 192498 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.33 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8e4782c64b152fd6278aefe5ffb6138bf9132c8b, data reload: false

query1	0.03	0.04	0.03
query2	0.12	0.11	0.11
query3	0.26	0.19	0.19
query4	1.59	0.20	0.10
query5	0.44	0.43	0.45
query6	1.16	0.67	0.66
query7	0.02	0.02	0.02
query8	0.05	0.03	0.03
query9	0.59	0.53	0.51
query10	0.57	0.57	0.56
query11	0.16	0.11	0.10
query12	0.14	0.12	0.11
query13	0.62	0.59	0.59
query14	0.78	0.80	0.81
query15	0.88	0.85	0.89
query16	0.38	0.37	0.38
query17	1.05	1.03	1.02
query18	0.22	0.21	0.21
query19	2.02	1.86	1.80
query20	0.01	0.01	0.01
query21	15.40	0.87	0.54
query22	0.76	1.29	0.83
query23	15.31	1.38	0.62
query24	7.54	1.03	1.00
query25	0.50	0.17	0.18
query26	0.62	0.17	0.14
query27	0.05	0.04	0.05
query28	9.44	0.92	0.45
query29	12.54	4.03	3.38
query30	0.25	0.09	0.06
query31	2.82	0.60	0.39
query32	3.23	0.55	0.47
query33	3.03	3.01	3.08
query34	15.81	5.09	4.47
query35	4.48	4.50	4.49
query36	0.68	0.50	0.47
query37	0.09	0.07	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.17	0.14	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.03
query43	0.04	0.03	0.02
Total cold run time: 104.04 s
Total hot run time: 29.33 s

@zzzxl1993 zzzxl1993 changed the title [fix](inverted index) add bkd index profile [fix](inverted index) enhance inverted index profile Jun 26, 2025
@zzzxl1993
Copy link
Contributor Author

run buildall

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 84.62% (44/52) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 57.04% (15367/26940)
Line Coverage 46.13% (139437/302275)
Region Coverage 45.47% (70675/155421)
Branch Coverage 40.23% (37322/92782)

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jun 26, 2025
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

Copy link
Contributor

@csun5285 csun5285 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@doris-robot
Copy link

TPC-H: Total hot run time: 34125 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7b93292a24750de7e6d080af063a601642ad1526, data reload: false

------ Round 1 ----------------------------------
q1	17822	5249	5070	5070
q2	1925	285	181	181
q3	10464	1322	766	766
q4	10213	1033	540	540
q5	7625	2433	2380	2380
q6	184	161	131	131
q7	900	744	592	592
q8	9303	1344	1053	1053
q9	6890	5103	5118	5103
q10	6915	2391	1995	1995
q11	474	296	274	274
q12	336	348	209	209
q13	17762	3754	3102	3102
q14	221	221	204	204
q15	550	476	476	476
q16	449	417	375	375
q17	598	875	363	363
q18	7617	7255	7211	7211
q19	1229	961	566	566
q20	338	333	222	222
q21	3920	3204	2359	2359
q22	1026	996	953	953
Total cold run time: 106761 ms
Total hot run time: 34125 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5114	5099	5081	5081
q2	250	321	222	222
q3	2175	2649	2273	2273
q4	1371	1762	1307	1307
q5	4218	4400	4414	4400
q6	204	164	124	124
q7	1971	1952	1794	1794
q8	2644	2663	2568	2568
q9	7252	7149	7210	7149
q10	3050	3261	2836	2836
q11	575	507	486	486
q12	656	760	619	619
q13	3622	3875	3302	3302
q14	291	299	277	277
q15	513	482	490	482
q16	453	475	425	425
q17	1184	1535	1332	1332
q18	7396	7155	7005	7005
q19	791	766	815	766
q20	1958	1964	1803	1803
q21	4844	4346	4204	4204
q22	1030	1021	1003	1003
Total cold run time: 51562 ms
Total hot run time: 49458 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 184636 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7b93292a24750de7e6d080af063a601642ad1526, data reload: false

query1	1021	389	380	380
query2	6519	1678	1673	1673
query3	6744	213	213	213
query4	26182	23800	23697	23697
query5	4329	603	448	448
query6	307	215	200	200
query7	4627	509	290	290
query8	277	218	214	214
query9	8644	2624	2625	2624
query10	458	336	279	279
query11	15778	15001	14815	14815
query12	163	107	109	107
query13	1651	536	423	423
query14	9269	5782	5749	5749
query15	202	181	186	181
query16	7468	623	429	429
query17	1196	723	596	596
query18	2009	411	315	315
query19	203	187	159	159
query20	128	121	114	114
query21	209	119	106	106
query22	4046	4086	4000	4000
query23	34293	33210	33138	33138
query24	8369	2358	2413	2358
query25	533	446	405	405
query26	717	269	149	149
query27	2683	502	334	334
query28	4252	2125	2086	2086
query29	663	549	436	436
query30	287	217	182	182
query31	902	870	760	760
query32	67	68	60	60
query33	562	352	302	302
query34	789	833	509	509
query35	785	812	726	726
query36	955	964	897	897
query37	107	100	73	73
query38	4104	4125	4071	4071
query39	1469	1418	1445	1418
query40	213	111	101	101
query41	55	57	56	56
query42	132	112	106	106
query43	474	484	473	473
query44	1385	808	801	801
query45	175	169	160	160
query46	844	1017	610	610
query47	1744	1790	1688	1688
query48	373	422	299	299
query49	678	467	387	387
query50	635	693	409	409
query51	4130	4215	4177	4177
query52	113	104	104	104
query53	226	256	176	176
query54	590	572	498	498
query55	79	79	83	79
query56	305	281	285	281
query57	1188	1178	1125	1125
query58	260	255	251	251
query59	2504	2651	2485	2485
query60	337	309	339	309
query61	125	120	122	120
query62	818	701	656	656
query63	223	184	184	184
query64	3032	1013	640	640
query65	4259	4149	4177	4149
query66	950	406	311	311
query67	15602	15778	15414	15414
query68	8539	892	521	521
query69	469	299	261	261
query70	1188	1091	1068	1068
query71	447	312	306	306
query72	5695	4698	4636	4636
query73	694	581	343	343
query74	8836	9023	8542	8542
query75	3945	3165	2662	2662
query76	3571	1144	717	717
query77	771	372	283	283
query78	10172	10397	9266	9266
query79	2139	868	580	580
query80	597	513	431	431
query81	497	261	216	216
query82	447	126	96	96
query83	243	251	224	224
query84	252	105	96	96
query85	800	349	336	336
query86	383	311	288	288
query87	4379	4497	4333	4333
query88	3600	2267	2270	2267
query89	377	317	276	276
query90	1818	211	206	206
query91	151	139	110	110
query92	78	61	56	56
query93	1655	1009	585	585
query94	665	417	300	300
query95	374	298	287	287
query96	501	571	281	281
query97	2732	2756	2640	2640
query98	228	203	206	203
query99	1657	1392	1255	1255
Total cold run time: 272316 ms
Total hot run time: 184636 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.7 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7b93292a24750de7e6d080af063a601642ad1526, data reload: false

query1	0.05	0.04	0.04
query2	0.07	0.04	0.04
query3	0.24	0.08	0.07
query4	1.61	0.11	0.11
query5	0.42	0.44	0.41
query6	1.17	0.65	0.66
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.60	0.53	0.52
query10	0.56	0.57	0.57
query11	0.16	0.11	0.11
query12	0.14	0.12	0.11
query13	0.62	0.62	0.61
query14	0.79	0.81	0.82
query15	0.91	0.88	0.87
query16	0.39	0.39	0.42
query17	1.11	1.06	1.06
query18	0.22	0.21	0.21
query19	1.97	1.84	1.93
query20	0.01	0.01	0.02
query21	15.38	0.89	0.55
query22	0.78	1.22	0.71
query23	14.85	1.39	0.66
query24	7.70	1.04	0.81
query25	0.50	0.23	0.07
query26	0.54	0.18	0.15
query27	0.06	0.06	0.06
query28	9.42	0.89	0.45
query29	12.53	3.94	3.31
query30	0.27	0.09	0.07
query31	2.84	0.61	0.39
query32	3.23	0.55	0.50
query33	3.01	3.10	3.07
query34	16.13	5.39	4.75
query35	4.80	4.85	4.84
query36	0.70	0.50	0.50
query37	0.08	0.06	0.07
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.17	0.14	0.14
query41	0.08	0.03	0.02
query42	0.03	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 104.32 s
Total hot run time: 29.7 s

Copy link
Member

@airborne12 airborne12 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@airborne12 airborne12 merged commit 0cd08b0 into apache:master Jun 27, 2025
30 of 34 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. cloud dev/3.0.7-merged dev/3.1.0-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants