Skip to content

Conversation

@csun5285
Copy link
Contributor

@csun5285 csun5285 commented Sep 9, 2024

Proposed changes

revert parts of #38537 ,restrict the execution of match on the scan

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@csun5285
Copy link
Contributor Author

csun5285 commented Sep 9, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38113 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 953730ca6d28695e570a49c951a7f5c67bb41635, data reload: false

------ Round 1 ----------------------------------
q1	17608	4399	4272	4272
q2	2014	187	176	176
q3	11896	932	1174	932
q4	10531	790	814	790
q5	7774	2825	2837	2825
q6	224	139	135	135
q7	961	639	598	598
q8	9325	2057	2067	2057
q9	7028	6490	6530	6490
q10	6993	2202	2242	2202
q11	477	240	242	240
q12	389	226	223	223
q13	18384	3100	3085	3085
q14	273	244	250	244
q15	534	483	478	478
q16	521	433	434	433
q17	971	674	766	674
q18	7400	6888	6797	6797
q19	1387	1033	1067	1033
q20	707	342	329	329
q21	3877	3084	3189	3084
q22	1109	1016	1026	1016
Total cold run time: 110383 ms
Total hot run time: 38113 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4353	4280	4237	4237
q2	394	268	272	268
q3	2854	2631	2679	2631
q4	1917	1641	1627	1627
q5	5576	5696	5750	5696
q6	228	137	135	135
q7	2184	1819	1788	1788
q8	3256	3446	3507	3446
q9	8856	8799	8772	8772
q10	3593	3371	3358	3358
q11	609	513	512	512
q12	845	638	653	638
q13	16701	3257	3328	3257
q14	320	293	283	283
q15	541	490	498	490
q16	556	499	504	499
q17	1820	1540	1559	1540
q18	8137	7960	7846	7846
q19	1727	1475	1539	1475
q20	2183	1894	1931	1894
q21	5775	5453	5370	5370
q22	1138	1049	1029	1029
Total cold run time: 73563 ms
Total hot run time: 56791 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192761 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 953730ca6d28695e570a49c951a7f5c67bb41635, data reload: false

query1	1263	877	869	869
query2	6452	1889	1871	1871
query3	10768	4096	4095	4095
query4	59978	24038	23225	23225
query5	5284	503	504	503
query6	401	183	172	172
query7	5783	306	289	289
query8	305	219	215	215
query9	8975	2501	2493	2493
query10	493	285	264	264
query11	17903	15114	15401	15114
query12	157	101	104	101
query13	1608	408	380	380
query14	11109	7312	7456	7312
query15	251	176	190	176
query16	7489	489	526	489
query17	1083	574	584	574
query18	2025	298	308	298
query19	289	155	144	144
query20	121	116	107	107
query21	205	103	105	103
query22	4614	4378	4309	4309
query23	34265	33356	33519	33356
query24	5987	2852	2850	2850
query25	540	389	406	389
query26	680	151	153	151
query27	1770	278	278	278
query28	3658	2023	1998	1998
query29	689	405	410	405
query30	241	154	149	149
query31	951	742	771	742
query32	83	57	53	53
query33	434	282	290	282
query34	869	478	476	476
query35	835	719	714	714
query36	1054	934	941	934
query37	143	89	86	86
query38	4029	3839	3830	3830
query39	1440	1399	1386	1386
query40	198	117	115	115
query41	47	45	45	45
query42	114	96	98	96
query43	526	489	478	478
query44	1107	753	748	748
query45	198	169	164	164
query46	1081	742	747	742
query47	1896	1802	1799	1799
query48	391	300	296	296
query49	786	460	459	459
query50	832	417	469	417
query51	7033	6896	6944	6896
query52	99	89	89	89
query53	249	178	180	178
query54	557	453	445	445
query55	76	74	76	74
query56	278	261	268	261
query57	1180	1068	1067	1067
query58	220	234	249	234
query59	3048	2748	2833	2748
query60	286	266	269	266
query61	106	106	98	98
query62	756	654	653	653
query63	220	191	192	191
query64	2828	707	705	705
query65	3191	3128	3139	3128
query66	677	335	355	335
query67	15545	15212	15266	15212
query68	2997	558	575	558
query69	406	292	277	277
query70	1200	1121	1115	1115
query71	357	281	281	281
query72	5385	4071	4056	4056
query73	736	317	323	317
query74	9044	8883	8829	8829
query75	3362	2653	2770	2653
query76	1495	1024	979	979
query77	520	331	332	331
query78	10391	9011	9175	9011
query79	1067	551	539	539
query80	718	529	514	514
query81	460	233	226	226
query82	236	139	142	139
query83	176	158	154	154
query84	257	77	84	77
query85	724	293	290	290
query86	312	308	259	259
query87	4529	4320	4198	4198
query88	3000	2281	2272	2272
query89	376	284	284	284
query90	1787	201	198	198
query91	124	111	111	111
query92	65	50	52	50
query93	1069	536	538	536
query94	607	314	308	308
query95	354	278	265	265
query96	579	262	265	262
query97	3184	3093	3116	3093
query98	210	210	202	202
query99	1531	1271	1256	1256
Total cold run time: 305007 ms
Total hot run time: 192761 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.02 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 953730ca6d28695e570a49c951a7f5c67bb41635, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.04	0.04
query3	0.23	0.05	0.06
query4	1.69	0.08	0.07
query5	0.49	0.48	0.50
query6	1.12	0.72	0.73
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.55	0.48	0.48
query10	0.54	0.57	0.53
query11	0.15	0.12	0.12
query12	0.14	0.13	0.13
query13	0.60	0.60	0.59
query14	1.39	1.42	1.42
query15	0.86	0.82	0.82
query16	0.37	0.38	0.37
query17	0.97	0.95	0.99
query18	0.22	0.20	0.21
query19	1.86	1.73	1.69
query20	0.01	0.02	0.01
query21	15.38	0.68	0.67
query22	3.78	8.57	1.60
query23	18.31	1.43	1.38
query24	2.12	0.22	0.20
query25	0.16	0.08	0.08
query26	0.27	0.18	0.19
query27	0.08	0.07	0.08
query28	13.31	1.02	1.00
query29	12.64	3.34	3.31
query30	0.25	0.06	0.05
query31	2.87	0.41	0.39
query32	3.28	0.48	0.48
query33	2.98	2.99	3.04
query34	17.20	4.37	4.39
query35	4.54	4.47	4.44
query36	0.64	0.49	0.47
query37	0.18	0.16	0.15
query38	0.15	0.14	0.15
query39	0.05	0.03	0.04
query40	0.15	0.13	0.14
query41	0.10	0.04	0.04
query42	0.05	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 109.93 s
Total hot run time: 31.02 s

Copy link
Member

@airborne12 airborne12 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Sep 10, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

Copy link
Contributor

@qidaye qidaye left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@qidaye qidaye merged commit abf6897 into apache:master Sep 10, 2024
yiguolei pushed a commit that referenced this pull request Sep 13, 2024
…40780)

## Proposed changes

pick from master #40532

<!--Describe your changes.-->
dataroaring pushed a commit that referenced this pull request Oct 9, 2024
revert parts of #38537 ,restrict the execution of match on the scan
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.7-merged dev/3.0.3-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants