Skip to content

Conversation

@github-actions
Copy link
Contributor

Cherry-picked from #49386

)

skip run PruneOlapScanTablet when exists lots of InPredicate, follow-up
#47608
@github-actions github-actions bot requested a review from dataroaring as a code owner March 26, 2025 06:08
@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring reopened this Mar 26, 2025
@hello-stephen
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40503 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8bd14ddbbd8172ec2da9f110d50538598f741b8f, data reload: false

------ Round 1 ----------------------------------
q1	17591	6838	6610	6610
q2	2039	170	167	167
q3	10563	1150	1197	1150
q4	10210	798	772	772
q5	7754	2978	2850	2850
q6	224	135	138	135
q7	1012	606	605	605
q8	9375	1981	2064	1981
q9	7184	6449	6491	6449
q10	7084	2309	2268	2268
q11	475	270	268	268
q12	511	215	218	215
q13	17800	2986	3022	2986
q14	236	206	209	206
q15	505	460	463	460
q16	689	595	583	583
q17	1012	543	538	538
q18	7369	6794	6766	6766
q19	1401	1092	1123	1092
q20	475	215	204	204
q21	4090	3252	3201	3201
q22	1118	997	1046	997
Total cold run time: 108717 ms
Total hot run time: 40503 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6613	6609	6574	6574
q2	325	231	233	231
q3	2925	2876	3025	2876
q4	2108	1802	1777	1777
q5	5771	5752	5767	5752
q6	218	127	121	121
q7	2286	1775	1748	1748
q8	3390	3606	3570	3570
q9	8807	8954	8971	8954
q10	3598	3535	3520	3520
q11	585	496	513	496
q12	807	616	618	616
q13	9523	3017	2980	2980
q14	278	273	246	246
q15	497	451	461	451
q16	713	630	628	628
q17	1825	1602	1552	1552
q18	7872	7489	7379	7379
q19	1666	1552	1488	1488
q20	2021	1835	1830	1830
q21	5505	5262	5236	5236
q22	1117	1050	1015	1015
Total cold run time: 68450 ms
Total hot run time: 59040 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192517 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8bd14ddbbd8172ec2da9f110d50538598f741b8f, data reload: false

query1	991	380	373	373
query2	6507	2105	2070	2070
query3	6698	220	223	220
query4	33545	23278	23425	23278
query5	4347	483	482	482
query6	272	173	180	173
query7	4644	315	318	315
query8	278	220	221	220
query9	9755	2619	2634	2619
query10	486	271	270	270
query11	18037	15014	15201	15014
query12	163	103	101	101
query13	1635	435	407	407
query14	10991	7759	7644	7644
query15	284	178	183	178
query16	8001	467	482	467
query17	1613	588	573	573
query18	2065	317	318	317
query19	322	178	160	160
query20	122	111	114	111
query21	214	104	107	104
query22	4650	4246	4232	4232
query23	34536	33543	33770	33543
query24	11150	2969	2912	2912
query25	640	422	432	422
query26	1136	176	176	176
query27	2765	348	354	348
query28	7707	2474	2431	2431
query29	874	467	460	460
query30	321	175	168	168
query31	1018	821	839	821
query32	92	61	61	61
query33	791	333	313	313
query34	935	522	550	522
query35	890	751	739	739
query36	1128	985	974	974
query37	123	73	70	70
query38	3990	3912	3938	3912
query39	1470	1437	1457	1437
query40	284	108	106	106
query41	55	51	52	51
query42	113	102	102	102
query43	549	498	486	486
query44	1289	818	830	818
query45	186	174	173	173
query46	1159	750	759	750
query47	1924	1834	1854	1834
query48	485	390	387	387
query49	1286	415	419	415
query50	830	433	433	433
query51	7373	7167	7184	7167
query52	108	93	93	93
query53	284	196	202	196
query54	1188	492	477	477
query55	82	80	83	80
query56	280	266	258	258
query57	1253	1139	1070	1070
query58	256	215	224	215
query59	3079	2877	2864	2864
query60	304	290	255	255
query61	125	111	117	111
query62	874	682	657	657
query63	243	203	204	203
query64	5112	674	644	644
query65	3348	3224	3259	3224
query66	1344	328	326	326
query67	15977	15770	15709	15709
query68	4769	577	587	577
query69	460	275	276	275
query70	1195	1173	1101	1101
query71	395	255	286	255
query72	6444	4037	4066	4037
query73	795	364	357	357
query74	10415	9060	8964	8964
query75	3440	2663	2690	2663
query76	2890	1112	1033	1033
query77	409	311	286	286
query78	10594	9741	9603	9603
query79	2325	624	623	623
query80	1065	439	443	439
query81	558	247	240	240
query82	907	93	92	92
query83	226	146	148	146
query84	239	81	77	77
query85	1328	330	290	290
query86	423	297	294	294
query87	4557	4309	4365	4309
query88	4012	2386	2309	2309
query89	423	316	318	316
query90	1992	193	190	190
query91	193	155	179	155
query92	74	53	56	53
query93	1714	589	568	568
query94	935	302	312	302
query95	359	267	261	261
query96	617	277	279	277
query97	3326	3208	3171	3171
query98	216	206	197	197
query99	1521	1320	1316	1316
Total cold run time: 303392 ms
Total hot run time: 192517 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.25 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8bd14ddbbd8172ec2da9f110d50538598f741b8f, data reload: false

query1	0.03	0.03	0.04
query2	0.07	0.03	0.03
query3	0.24	0.07	0.06
query4	1.62	0.10	0.10
query5	0.53	0.52	0.53
query6	1.16	0.72	0.73
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.57	0.51	0.49
query10	0.54	0.56	0.56
query11	0.14	0.11	0.11
query12	0.14	0.11	0.14
query13	0.61	0.59	0.62
query14	2.85	2.79	2.79
query15	0.91	0.83	0.83
query16	0.37	0.39	0.40
query17	0.99	1.05	1.06
query18	0.25	0.23	0.22
query19	1.98	1.92	2.00
query20	0.02	0.01	0.01
query21	15.36	0.57	0.59
query22	2.76	2.73	1.93
query23	17.00	0.89	0.88
query24	3.96	1.56	2.00
query25	0.20	0.17	0.09
query26	0.61	0.14	0.13
query27	0.05	0.04	0.04
query28	8.35	0.56	0.50
query29	12.58	3.28	3.23
query30	0.24	0.06	0.06
query31	2.86	0.40	0.40
query32	3.22	0.48	0.46
query33	3.03	3.00	3.07
query34	16.88	4.59	4.48
query35	4.58	4.56	4.57
query36	0.69	0.48	0.50
query37	0.10	0.06	0.07
query38	0.05	0.04	0.03
query39	0.03	0.02	0.03
query40	0.16	0.13	0.12
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.04
Total cold run time: 105.95 s
Total hot run time: 33.25 s

@morrySnow morrySnow closed this Apr 2, 2025
@924060929 924060929 deleted the auto-pick-49386-branch-3.0 branch April 2, 2025 06:28
@924060929 924060929 restored the auto-pick-49386-branch-3.0 branch April 2, 2025 06:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants