Skip to content

Conversation

@starocean999
Copy link
Contributor

pick from master #31057

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49903 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 17ee1dd45f8d07930f0a79b5a4a8971229080a32, data reload: false

------ Round 1 ----------------------------------
q1	17931	4391	4307	4307
q2	2029	151	149	149
q3	10331	1893	1935	1893
q4	10105	1242	1302	1242
q5	8389	3985	4016	3985
q6	236	126	124	124
q7	2060	1627	1601	1601
q8	9265	2725	2726	2725
q9	10888	10458	10353	10353
q10	8647	3551	3520	3520
q11	431	247	246	246
q12	470	295	301	295
q13	18354	3954	4026	3954
q14	349	329	325	325
q15	502	456	453	453
q16	696	602	595	595
q17	1119	962	976	962
q18	7336	6945	6834	6834
q19	1702	1556	1510	1510
q20	520	318	298	298
q21	4493	4168	4131	4131
q22	487	401	406	401
Total cold run time: 116340 ms
Total hot run time: 49903 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4323	4290	4325	4290
q2	322	226	226	226
q3	4154	4132	4129	4129
q4	2742	2743	2745	2743
q5	7309	7195	7141	7141
q6	236	121	119	119
q7	3277	2811	2835	2811
q8	4373	4527	4487	4487
q9	17143	16910	17056	16910
q10	4226	4295	4264	4264
q11	754	681	700	681
q12	1013	846	846	846
q13	6797	3721	3775	3721
q14	470	427	431	427
q15	505	458	459	458
q16	753	713	696	696
q17	3786	3866	3916	3866
q18	8822	8605	8639	8605
q19	1730	1705	1660	1660
q20	2424	2184	2152	2152
q21	8591	8581	8563	8563
q22	1083	950	965	950
Total cold run time: 84833 ms
Total hot run time: 79745 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 240732 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 17ee1dd45f8d07930f0a79b5a4a8971229080a32, data reload: false

query1	909	397	378	378
query2	6516	2194	2100	2100
query3	6913	209	205	205
query4	20194	18033	18001	18001
query5	19712	6487	6448	6448
query6	284	212	238	212
query7	4152	296	293	293
query8	238	267	224	224
query9	3121	2686	2632	2632
query10	431	274	295	274
query11	11467	10752	10693	10693
query12	122	71	72	71
query13	5566	638	624	624
query14	17735	13651	13200	13200
query15	363	230	242	230
query16	6429	256	282	256
query17	1715	1467	886	886
query18	2293	411	402	402
query19	207	144	141	141
query20	79	79	72	72
query21	190	90	96	90
query22	5398	5295	5235	5235
query23	32509	31853	31955	31853
query24	6868	6432	6478	6432
query25	528	408	406	406
query26	521	167	153	153
query27	1891	293	291	291
query28	6085	2235	2191	2191
query29	2849	2689	2824	2689
query30	245	168	160	160
query31	923	710	720	710
query32	69	62	59	59
query33	377	254	245	245
query34	838	472	478	472
query35	1112	918	851	851
query36	1394	1313	1511	1313
query37	85	65	57	57
query38	3114	2927	2888	2888
query39	1361	1349	1327	1327
query40	202	96	94	94
query41	35	31	31	31
query42	86	85	89	85
query43	717	608	599	599
query44	1136	698	708	698
query45	234	230	227	227
query46	1217	966	969	966
query47	1914	1846	1729	1729
query48	983	678	659	659
query49	611	356	363	356
query50	852	578	620	578
query51	5545	5424	5487	5424
query52	88	79	80	79
query53	433	311	320	311
query54	2633	2414	2472	2414
query55	90	83	79	79
query56	211	191	207	191
query57	1270	1137	1113	1113
query58	195	209	202	202
query59	3452	3296	3460	3296
query60	211	194	203	194
query61	82	85	80	80
query62	837	481	508	481
query63	464	331	331	331
query64	2435	1488	1337	1337
query65	3638	3581	3532	3532
query66	765	363	357	357
query67	15958	15691	15627	15627
query68	8619	661	672	661
query69	572	355	362	355
query70	1818	1788	1828	1788
query71	417	297	304	297
query72	6471	3415	3382	3382
query73	738	318	324	318
query74	6355	5915	5878	5878
query75	4772	3714	3696	3696
query76	4902	1143	1157	1143
query77	762	245	244	244
query78	32435	53428	49570	49570
query79	16369	663	638	638
query80	5482	371	375	371
query81	571	234	224	224
query82	1155	92	93	92
query83	418	134	128	128
query84	258	68	68	68
query85	2649	271	271	271
query86	484	367	351	351
query87	3312	2995	2990	2990
query88	7175	2334	2301	2301
query89	473	299	293	293
query90	2499	203	206	203
query91	152	114	115	114
query92	67	51	51	51
query93	7130	533	574	533
query94	1845	201	216	201
query95	1112	1059	1063	1059
query96	654	343	325	325
query97	6469	6372	6335	6335
query98	189	171	166	166
query99	3946	852	879	852
Total cold run time: 351367 ms
Total hot run time: 240732 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.12 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 17ee1dd45f8d07930f0a79b5a4a8971229080a32, data reload: false

query1	0.02	0.02	0.02
query2	0.05	0.02	0.02
query3	0.25	0.05	0.04
query4	1.83	0.07	0.06
query5	0.52	0.52	0.52
query6	1.28	0.62	0.66
query7	0.02	0.01	0.01
query8	0.04	0.02	0.02
query9	0.51	0.48	0.48
query10	0.53	0.52	0.53
query11	0.11	0.08	0.09
query12	0.12	0.09	0.09
query13	0.61	0.61	0.61
query14	0.78	0.77	0.80
query15	0.77	0.76	0.76
query16	0.37	0.36	0.36
query17	1.00	1.01	0.96
query18	0.21	0.27	0.24
query19	1.91	1.85	1.87
query20	0.01	0.00	0.01
query21	15.49	0.56	0.53
query22	2.40	2.39	1.48
query23	17.61	1.02	1.02
query24	4.06	3.10	1.34
query25	1.46	0.12	0.10
query26	0.26	0.14	0.13
query27	0.10	0.11	0.11
query28	7.64	0.72	0.70
query29	12.69	2.34	2.38
query30	0.63	0.53	0.53
query31	2.82	0.38	0.38
query32	3.42	0.50	0.49
query33	3.08	3.07	3.07
query34	15.28	4.78	4.80
query35	4.86	4.86	4.83
query36	1.06	1.01	1.00
query37	0.05	0.04	0.05
query38	0.03	0.02	0.02
query39	0.01	0.02	0.02
query40	0.16	0.15	0.14
query41	0.07	0.01	0.02
query42	0.02	0.01	0.01
query43	0.02	0.02	0.02
Total cold run time: 104.16 s
Total hot run time: 31.12 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 17ee1dd45f8d07930f0a79b5a4a8971229080a32 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.2 seconds inserted 10000000 Rows, about 471K ops/s

@xiaokang xiaokang merged commit 7a1988e into apache:branch-2.0 Feb 18, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants