Skip to content

Conversation

@starocean999
Copy link
Contributor

Proposed changes

pick from master #33002

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 50049 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f537ebb112840134ca593e6311162c71720a54f7, data reload: false

------ Round 1 ----------------------------------
q1	17703	4481	4357	4357
q2	2053	150	143	143
q3	10371	1866	1926	1866
q4	10176	1266	1325	1266
q5	8464	3957	4004	3957
q6	230	123	120	120
q7	2056	1617	1592	1592
q8	9315	2746	2741	2741
q9	10662	10446	10528	10446
q10	8652	3511	3529	3511
q11	420	247	243	243
q12	466	293	300	293
q13	18334	3971	3993	3971
q14	355	320	328	320
q15	509	463	460	460
q16	709	603	598	598
q17	1134	952	952	952
q18	7311	6981	6897	6897
q19	1665	1562	1509	1509
q20	510	299	313	299
q21	4454	4121	4119	4119
q22	496	389	411	389
Total cold run time: 116045 ms
Total hot run time: 50049 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4345	4307	4317	4307
q2	318	220	213	213
q3	4136	4133	4167	4133
q4	2768	2733	2751	2733
q5	7325	7265	7220	7220
q6	239	119	121	119
q7	3277	2838	2885	2838
q8	4392	4430	4488	4430
q9	17080	17038	16932	16932
q10	4209	4260	4248	4248
q11	781	687	655	655
q12	1034	844	858	844
q13	7024	3726	3770	3726
q14	457	424	428	424
q15	498	453	456	453
q16	754	690	716	690
q17	3816	3939	3890	3890
q18	8790	8812	8821	8812
q19	1694	1689	1665	1665
q20	2433	2167	2109	2109
q21	8590	8563	8580	8563
q22	1045	916	946	916
Total cold run time: 85005 ms
Total hot run time: 79920 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 200822 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f537ebb112840134ca593e6311162c71720a54f7, data reload: false

query1	932	393	376	376
query2	6526	2129	2134	2129
query3	6919	204	195	195
query4	20059	17993	18037	17993
query5	19727	6496	6511	6496
query6	316	227	225	225
query7	4158	309	301	301
query8	251	249	230	230
query9	3172	2731	2676	2676
query10	432	295	297	295
query11	11345	10762	10855	10762
query12	123	78	70	70
query13	5584	625	637	625
query14	17410	13527	13078	13078
query15	362	232	228	228
query16	6471	273	254	254
query17	1719	1473	885	885
query18	2286	411	405	405
query19	207	141	143	141
query20	80	77	76	76
query21	187	102	92	92
query22	5128	4994	5086	4994
query23	32825	31822	32032	31822
query24	6963	6563	6487	6487
query25	520	439	419	419
query26	610	160	154	154
query27	2003	298	291	291
query28	6184	2302	2253	2253
query29	2792	2685	2737	2685
query30	239	160	159	159
query31	909	714	738	714
query32	66	58	53	53
query33	397	251	254	251
query34	861	461	487	461
query35	1106	943	917	917
query36	1143	1199	1259	1199
query37	93	62	60	60
query38	3104	2884	2918	2884
query39	1382	1309	1315	1309
query40	207	94	94	94
query41	39	37	32	32
query42	84	85	92	85
query43	647	631	623	623
query44	1150	716	722	716
query45	240	229	229	229
query46	1233	961	966	961
query47	2067	1696	1756	1696
query48	982	680	659	659
query49	632	371	361	361
query50	879	599	589	589
query51	4794	4661	4654	4654
query52	91	72	76	72
query53	434	317	321	317
query54	2647	2469	2477	2469
query55	82	76	74	74
query56	222	206	211	206
query57	1191	1147	1050	1050
query58	215	185	194	185
query59	3380	3046	3244	3046
query60	208	188	190	188
query61	83	82	89	82
query62	872	495	446	446
query63	468	332	326	326
query64	2536	1362	1464	1362
query65	3657	3572	3562	3562
query66	790	379	362	362
query67	15670	15656	15053	15053
query68	10109	659	666	659
query69	576	327	331	327
query70	1765	1359	1434	1359
query71	414	293	310	293
query72	6686	3487	3422	3422
query73	735	320	320	320
query74	6305	5875	5860	5860
query75	5331	3703	3749	3703
query76	6506	1190	1219	1190
query77	1085	261	250	250
query78	12500	11741	11709	11709
query79	5892	637	624	624
query80	996	390	397	390
query81	458	229	231	229
query82	856	95	94	94
query83	174	137	130	130
query84	251	71	69	69
query85	858	288	282	282
query86	330	288	286	286
query87	3210	3024	3037	3024
query88	4031	2308	2313	2308
query89	385	267	302	267
query90	1931	204	214	204
query91	152	120	117	117
query92	58	51	50	50
query93	5958	569	589	569
query94	696	200	203	200
query95	1109	1081	1039	1039
query96	630	330	329	329
query97	6503	6355	6357	6355
query98	179	176	170	170
query99	2910	917	851	851
Total cold run time: 309670 ms
Total hot run time: 200822 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.52 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f537ebb112840134ca593e6311162c71720a54f7, data reload: false

query1	0.02	0.02	0.02
query2	0.06	0.03	0.02
query3	0.24	0.04	0.05
query4	1.81	0.07	0.08
query5	0.53	0.53	0.51
query6	1.24	0.67	0.62
query7	0.01	0.01	0.01
query8	0.04	0.02	0.02
query9	0.52	0.48	0.48
query10	0.53	0.54	0.54
query11	0.12	0.09	0.08
query12	0.12	0.09	0.09
query13	0.62	0.62	0.61
query14	0.81	0.79	0.79
query15	0.78	0.76	0.77
query16	0.36	0.37	0.35
query17	1.00	0.99	0.98
query18	0.23	0.26	0.24
query19	1.94	1.89	1.84
query20	0.02	0.01	0.00
query21	15.44	0.58	0.56
query22	2.36	1.78	1.49
query23	16.93	0.98	1.11
query24	7.13	0.67	1.29
query25	0.38	0.14	0.06
query26	0.72	0.16	0.14
query27	0.05	0.04	0.04
query28	6.12	0.73	0.75
query29	12.70	2.42	2.39
query30	0.59	0.56	0.59
query31	2.82	0.39	0.37
query32	3.40	0.49	0.50
query33	3.06	3.08	3.09
query34	15.26	4.83	4.79
query35	4.85	4.84	4.83
query36	1.08	1.01	1.04
query37	0.05	0.04	0.04
query38	0.03	0.02	0.02
query39	0.02	0.01	0.01
query40	0.17	0.14	0.15
query41	0.07	0.01	0.02
query42	0.02	0.02	0.02
query43	0.03	0.02	0.02
Total cold run time: 104.28 s
Total hot run time: 30.52 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit f537ebb112840134ca593e6311162c71720a54f7 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       19.9 seconds inserted 10000000 Rows, about 502K ops/s

@yiguolei yiguolei merged commit ed4822f into apache:branch-2.0 Mar 29, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants