Skip to content

Conversation

@zddr
Copy link
Contributor

@zddr zddr commented Sep 9, 2024

The old optimizer checked permissions, but the new optimizer did not check permissions,
We keep the permissions of the new optimizer and the old optimizer consistent.

ps: We will add cases to other PRs as a whole

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zddr
Copy link
Contributor Author

zddr commented Sep 9, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38276 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 39331329a5a7c39390043d2f6207bea9d1955bfe, data reload: false

------ Round 1 ----------------------------------
q1	18048	4531	4323	4323
q2	2023	216	212	212
q3	10754	1168	1150	1150
q4	11129	808	714	714
q5	8096	2937	2840	2840
q6	228	139	140	139
q7	993	622	615	615
q8	9723	2096	2115	2096
q9	7075	6630	6630	6630
q10	7607	2194	2266	2194
q11	469	250	246	246
q12	397	220	220	220
q13	17999	3147	3096	3096
q14	275	251	241	241
q15	551	501	485	485
q16	559	431	430	430
q17	980	675	734	675
q18	7445	6805	6722	6722
q19	1423	992	988	988
q20	697	328	332	328
q21	3960	3007	2923	2923
q22	1146	1012	1009	1009
Total cold run time: 111577 ms
Total hot run time: 38276 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4373	4279	4260	4260
q2	394	265	279	265
q3	2909	2613	2651	2613
q4	1931	1670	1737	1670
q5	5655	5709	5607	5607
q6	238	135	131	131
q7	2217	1743	1767	1743
q8	3376	3482	3453	3453
q9	8924	8738	8824	8738
q10	3566	3373	3317	3317
q11	613	546	516	516
q12	831	635	637	635
q13	9651	3266	3279	3266
q14	333	321	271	271
q15	541	487	496	487
q16	552	511	515	511
q17	1849	1567	1548	1548
q18	8182	8034	7820	7820
q19	1711	1613	1605	1605
q20	2193	1849	1815	1815
q21	5497	5499	5426	5426
q22	1141	1056	1063	1056
Total cold run time: 66677 ms
Total hot run time: 56753 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192300 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 39331329a5a7c39390043d2f6207bea9d1955bfe, data reload: false

query1	1254	894	901	894
query2	6197	1847	1867	1847
query3	10615	3924	3907	3907
query4	59383	27082	23231	23231
query5	5442	501	503	501
query6	418	162	171	162
query7	5887	294	292	292
query8	315	228	232	228
query9	9051	2501	2494	2494
query10	494	278	268	268
query11	18045	15121	15412	15121
query12	155	102	106	102
query13	1597	418	385	385
query14	11253	7530	7769	7530
query15	230	175	177	175
query16	7239	483	468	468
query17	1118	564	549	549
query18	1485	299	297	297
query19	293	148	148	148
query20	121	117	112	112
query21	208	112	104	104
query22	4630	4359	4398	4359
query23	34381	33275	33403	33275
query24	5925	2820	2890	2820
query25	514	383	384	383
query26	687	158	151	151
query27	1802	274	282	274
query28	3838	2042	2021	2021
query29	649	402	414	402
query30	231	153	150	150
query31	913	735	781	735
query32	83	51	55	51
query33	430	277	284	277
query34	943	482	486	482
query35	805	734	706	706
query36	1067	921	921	921
query37	147	86	88	86
query38	3931	3856	3825	3825
query39	1447	1411	1405	1405
query40	197	113	111	111
query41	46	47	44	44
query42	118	96	97	96
query43	526	464	482	464
query44	1070	747	731	731
query45	196	167	165	165
query46	1080	754	720	720
query47	1849	1780	1795	1780
query48	386	288	294	288
query49	781	447	487	447
query50	830	407	406	406
query51	6974	6836	6851	6836
query52	97	85	86	85
query53	248	177	179	177
query54	570	443	447	443
query55	76	75	73	73
query56	257	250	248	248
query57	1150	1091	1064	1064
query58	240	230	228	228
query59	3088	2825	2835	2825
query60	284	258	258	258
query61	102	94	99	94
query62	749	647	653	647
query63	220	191	193	191
query64	2886	656	670	656
query65	3216	3128	3159	3128
query66	674	318	335	318
query67	15298	15130	15091	15091
query68	2990	570	568	568
query69	381	285	272	272
query70	1192	1096	1066	1066
query71	330	276	282	276
query72	5197	4011	4024	4011
query73	728	320	322	320
query74	9061	8753	8928	8753
query75	3401	2684	2673	2673
query76	1340	947	1041	947
query77	523	332	323	323
query78	9688	9692	9040	9040
query79	1026	547	531	531
query80	664	496	491	491
query81	495	230	230	230
query82	235	146	145	145
query83	171	148	147	147
query84	253	80	75	75
query85	668	285	275	275
query86	333	313	300	300
query87	4369	4303	4314	4303
query88	2862	2299	2296	2296
query89	453	282	288	282
query90	1898	191	187	187
query91	123	97	97	97
query92	56	46	48	46
query93	1035	539	533	533
query94	689	299	298	298
query95	309	255	250	250
query96	574	262	262	262
query97	3188	3113	3103	3103
query98	223	202	195	195
query99	1480	1302	1253	1253
Total cold run time: 302366 ms
Total hot run time: 192300 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.76 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 39331329a5a7c39390043d2f6207bea9d1955bfe, data reload: false

query1	0.05	0.04	0.05
query2	0.08	0.05	0.04
query3	0.22	0.05	0.05
query4	1.69	0.07	0.07
query5	0.50	0.48	0.49
query6	1.13	0.73	0.73
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.54	0.48	0.48
query10	0.53	0.56	0.55
query11	0.16	0.12	0.11
query12	0.15	0.12	0.11
query13	0.60	0.58	0.58
query14	1.39	1.44	1.42
query15	0.83	0.82	0.82
query16	0.35	0.37	0.36
query17	1.05	1.01	1.04
query18	0.21	0.20	0.20
query19	1.87	1.82	1.83
query20	0.01	0.01	0.01
query21	15.40	0.67	0.67
query22	4.08	5.87	3.15
query23	18.29	1.32	1.30
query24	2.11	0.22	0.22
query25	0.15	0.08	0.08
query26	0.27	0.18	0.18
query27	0.08	0.08	0.08
query28	13.32	1.02	1.00
query29	12.61	3.29	3.34
query30	0.24	0.06	0.06
query31	2.92	0.39	0.38
query32	3.24	0.48	0.48
query33	2.96	2.99	3.05
query34	17.02	4.44	4.44
query35	4.40	4.45	4.44
query36	0.67	0.51	0.47
query37	0.19	0.15	0.15
query38	0.16	0.15	0.15
query39	0.04	0.03	0.04
query40	0.15	0.13	0.12
query41	0.10	0.05	0.05
query42	0.06	0.06	0.06
query43	0.04	0.04	0.04
Total cold run time: 109.93 s
Total hot run time: 32.76 s

@zddr
Copy link
Contributor Author

zddr commented Sep 9, 2024

run p0

1 similar comment
@zddr
Copy link
Contributor Author

zddr commented Sep 10, 2024

run p0

@morrySnow
Copy link
Contributor

run buildall

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Sep 10, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@zddr
Copy link
Contributor Author

zddr commented Sep 10, 2024

run cloud_p0

@zddr
Copy link
Contributor Author

zddr commented Sep 11, 2024

run performance

@doris-robot
Copy link

TPC-H: Total hot run time: 38462 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9e68e82e517cebe50dab53dc108e439d78e03f20, data reload: false

------ Round 1 ----------------------------------
q1	17598	4464	4361	4361
q2	2018	199	187	187
q3	11689	1018	1089	1018
q4	10512	734	729	729
q5	7763	2844	2876	2844
q6	237	142	140	140
q7	976	615	613	613
q8	9341	2086	2124	2086
q9	7245	6590	6616	6590
q10	7022	2263	2242	2242
q11	458	257	255	255
q12	401	234	235	234
q13	18711	3124	3146	3124
q14	291	243	242	242
q15	559	500	491	491
q16	529	447	435	435
q17	1005	663	766	663
q18	7352	6892	6923	6892
q19	1392	1050	1098	1050
q20	674	348	357	348
q21	3941	3109	2916	2916
q22	1085	1002	1016	1002
Total cold run time: 110799 ms
Total hot run time: 38462 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4395	4330	4322	4322
q2	376	276	274	274
q3	2913	2666	2735	2666
q4	1928	1685	1683	1683
q5	5735	5699	5806	5699
q6	237	141	139	139
q7	2184	1843	1825	1825
q8	3332	3481	3529	3481
q9	8946	8913	8831	8831
q10	3634	3410	3385	3385
q11	605	519	511	511
q12	835	672	666	666
q13	15687	3266	3346	3266
q14	329	282	281	281
q15	543	498	490	490
q16	561	503	506	503
q17	1869	1544	1554	1544
q18	8082	7735	7858	7735
q19	1782	1595	1696	1595
q20	2198	1932	1935	1932
q21	5957	5509	5499	5499
q22	1116	1061	1014	1014
Total cold run time: 73244 ms
Total hot run time: 57341 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 199025 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9e68e82e517cebe50dab53dc108e439d78e03f20, data reload: false

query1	1264	875	901	875
query2	6431	2000	1910	1910
query3	10626	3786	3970	3786
query4	58645	26317	23506	23506
query5	5130	500	497	497
query6	388	162	179	162
query7	5637	301	294	294
query8	314	235	239	235
query9	7869	2543	2536	2536
query10	422	288	300	288
query11	17231	15112	15304	15112
query12	152	108	104	104
query13	1445	388	403	388
query14	10669	7576	7464	7464
query15	220	185	186	185
query16	6800	466	488	466
query17	1089	573	558	558
query18	1581	288	296	288
query19	199	147	145	145
query20	122	115	114	114
query21	219	107	126	107
query22	4620	4346	4364	4346
query23	34417	33685	33616	33616
query24	6073	2972	2932	2932
query25	521	394	415	394
query26	622	162	160	160
query27	1601	281	287	281
query28	3834	2049	2025	2025
query29	670	432	440	432
query30	225	161	160	160
query31	941	759	777	759
query32	73	56	61	56
query33	435	306	308	306
query34	895	482	492	482
query35	848	726	742	726
query36	1063	967	958	958
query37	145	91	91	91
query38	4011	3847	3905	3847
query39	1444	1449	1397	1397
query40	204	124	119	119
query41	48	51	48	48
query42	115	99	98	98
query43	533	483	479	479
query44	1120	759	757	757
query45	203	172	167	167
query46	1110	786	774	774
query47	1863	1775	1792	1775
query48	386	308	302	302
query49	784	458	470	458
query50	854	433	434	433
query51	7102	6933	6893	6893
query52	101	92	90	90
query53	270	190	186	186
query54	584	471	479	471
query55	78	83	80	80
query56	295	269	269	269
query57	1199	1096	1100	1096
query58	233	251	240	240
query59	3146	2911	2963	2911
query60	316	277	288	277
query61	130	127	121	121
query62	753	647	648	647
query63	225	192	193	192
query64	1473	763	788	763
query65	3209	3138	3204	3138
query66	656	337	342	337
query67	15827	15422	15305	15305
query68	1885	871	874	871
query69	455	338	346	338
query70	1223	1209	1208	1208
query71	360	349	362	349
query72	5278	3619	3518	3518
query73	601	583	584	583
query74	9044	8879	8866	8866
query75	3084	2974	3043	2974
query76	1034	858	872	858
query77	509	427	417	417
query78	9573	9363	9255	9255
query79	932	925	890	890
query80	822	815	806	806
query81	468	264	266	264
query82	271	271	269	269
query83	194	193	188	188
query84	228	111	107	107
query85	621	401	387	387
query86	320	320	303	303
query87	4334	4372	4395	4372
query88	4410	4138	4165	4138
query89	385	383	375	375
query90	1581	318	310	310
query91	125	122	124	122
query92	78	76	77	76
query93	924	921	917	917
query94	533	390	358	358
query95	433	422	421	421
query96	475	475	476	475
query97	3129	3117	3088	3088
query98	233	235	233	233
query99	1432	1275	1282	1275
Total cold run time: 296682 ms
Total hot run time: 199025 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.64 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9e68e82e517cebe50dab53dc108e439d78e03f20, data reload: false

query1	0.05	0.05	0.04
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.68	0.08	0.08
query5	0.51	0.49	0.50
query6	1.14	0.74	0.74
query7	0.02	0.02	0.01
query8	0.06	0.05	0.05
query9	0.54	0.51	0.49
query10	0.54	0.54	0.54
query11	0.16	0.12	0.11
query12	0.16	0.13	0.12
query13	0.60	0.59	0.60
query14	1.42	1.40	1.44
query15	0.86	0.84	0.83
query16	0.37	0.37	0.38
query17	1.07	1.07	1.06
query18	0.24	0.21	0.21
query19	1.93	1.73	1.81
query20	0.01	0.01	0.02
query21	15.40	0.68	0.66
query22	3.75	7.85	2.00
query23	18.30	1.53	1.36
query24	2.06	0.23	0.22
query25	0.16	0.08	0.07
query26	0.27	0.18	0.17
query27	0.07	0.08	0.07
query28	13.28	1.02	1.00
query29	12.63	3.37	3.36
query30	0.25	0.05	0.05
query31	2.88	0.40	0.38
query32	3.23	0.48	0.48
query33	2.99	2.98	3.00
query34	17.03	4.41	4.41
query35	4.44	4.41	4.46
query36	0.66	0.47	0.47
query37	0.18	0.15	0.15
query38	0.16	0.15	0.15
query39	0.05	0.04	0.04
query40	0.16	0.13	0.13
query41	0.09	0.04	0.06
query42	0.06	0.05	0.04
query43	0.05	0.04	0.04
Total cold run time: 109.81 s
Total hot run time: 31.64 s

@morrySnow morrySnow merged commit d0cb128 into apache:master Sep 11, 2024
dataroaring pushed a commit that referenced this pull request Oct 9, 2024
The old optimizer checked permissions, but the new optimizer did not
check permissions,
We keep the permissions of the new optimizer and the old optimizer
consistent.

ps: We will add cases to other PRs as a whole
@gavinchou gavinchou mentioned this pull request Nov 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/3.0.3-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants