Skip to content

Conversation

@wuwenchi
Copy link
Contributor

@wuwenchi wuwenchi commented Apr 1, 2024

Proposed changes

mirror #32923

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@wuwenchi
Copy link
Contributor Author

wuwenchi commented Apr 1, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49839 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 01daa3717df7a54d612d3af5453ec21c8f85f2f3, data reload: false

------ Round 1 ----------------------------------
q1	17573	4380	4327	4327
q2	2051	155	141	141
q3	10536	1893	1926	1893
q4	10346	1253	1319	1253
q5	8427	3917	3963	3917
q6	233	125	119	119
q7	2040	1587	1584	1584
q8	9353	2714	2702	2702
q9	10590	10562	10402	10402
q10	8670	3557	3526	3526
q11	419	236	234	234
q12	461	298	299	298
q13	18363	3962	4024	3962
q14	352	323	321	321
q15	500	462	459	459
q16	699	594	586	586
q17	1113	948	952	948
q18	7137	6947	6877	6877
q19	1650	1593	1517	1517
q20	536	307	306	306
q21	4441	4074	4119	4074
q22	516	393	394	393
Total cold run time: 116006 ms
Total hot run time: 49839 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4273	4299	4277	4277
q2	318	215	226	215
q3	4175	4152	4146	4146
q4	2766	2776	2746	2746
q5	7297	7222	7276	7222
q6	236	120	118	118
q7	3306	2824	2851	2824
q8	4396	4475	4495	4475
q9	17114	17207	17222	17207
q10	4407	4468	4437	4437
q11	754	698	706	698
q12	1065	914	903	903
q13	9252	3850	3817	3817
q14	438	433	424	424
q15	494	467	455	455
q16	757	706	718	706
q17	3942	3859	3865	3859
q18	9229	8788	8788	8788
q19	1689	1710	1687	1687
q20	2366	2150	2112	2112
q21	8500	8589	8417	8417
q22	1018	958	917	917
Total cold run time: 87792 ms
Total hot run time: 80450 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 201902 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 01daa3717df7a54d612d3af5453ec21c8f85f2f3, data reload: false

query1	918	385	385	385
query2	6546	2201	2241	2201
query3	6910	202	197	197
query4	20434	18172	18268	18172
query5	19722	6505	6470	6470
query6	285	210	230	210
query7	4152	298	296	296
query8	237	250	229	229
query9	3197	2739	2662	2662
query10	405	296	307	296
query11	11571	10997	10912	10912
query12	124	73	69	69
query13	5563	655	623	623
query14	17773	13232	13101	13101
query15	390	229	221	221
query16	6441	274	253	253
query17	1728	1456	855	855
query18	2328	407	397	397
query19	218	149	141	141
query20	80	77	73	73
query21	179	89	92	89
query22	5348	5156	5130	5130
query23	32568	31756	32101	31756
query24	6924	6530	6493	6493
query25	527	433	410	410
query26	527	163	156	156
query27	1885	296	289	289
query28	6008	2246	2237	2237
query29	3018	2679	2743	2679
query30	238	161	164	161
query31	904	720	737	720
query32	67	58	57	57
query33	384	258	253	253
query34	862	456	470	456
query35	1104	896	867	867
query36	1326	1164	1138	1138
query37	87	63	58	58
query38	3105	2903	2928	2903
query39	1357	1322	1303	1303
query40	202	92	97	92
query41	37	33	32	32
query42	92	88	83	83
query43	670	667	629	629
query44	1139	708	726	708
query45	240	228	229	228
query46	1254	969	1010	969
query47	1939	1635	1726	1635
query48	968	675	665	665
query49	625	361	376	361
query50	861	613	598	598
query51	4754	4689	4598	4598
query52	94	78	82	78
query53	442	315	328	315
query54	2674	2440	2456	2440
query55	89	77	83	77
query56	196	207	208	207
query57	1237	1154	1053	1053
query58	205	202	192	192
query59	3381	3261	3162	3162
query60	211	181	186	181
query61	84	82	88	82
query62	824	498	499	498
query63	472	329	332	329
query64	2406	1485	1444	1444
query65	3666	3558	3557	3557
query66	765	367	373	367
query67	15906	15718	16109	15718
query68	9481	683	667	667
query69	589	339	341	339
query70	1635	1321	1428	1321
query71	417	303	307	303
query72	6554	3414	3444	3414
query73	729	321	319	319
query74	6410	5959	5859	5859
query75	5566	3784	3804	3784
query76	5868	1135	1240	1135
query77	1006	245	243	243
query78	12728	11714	12991	11714
query79	10994	617	629	617
query80	963	388	389	388
query81	460	226	233	226
query82	704	97	93	93
query83	161	135	125	125
query84	246	71	69	69
query85	859	287	281	281
query86	333	307	302	302
query87	3217	2995	2995	2995
query88	4345	2338	2304	2304
query89	474	267	283	267
query90	1992	193	216	193
query91	148	120	119	119
query92	52	48	50	48
query93	6612	575	594	575
query94	741	206	206	206
query95	1133	1062	1056	1056
query96	644	331	325	325
query97	6456	6403	6418	6403
query98	213	172	173	172
query99	2811	881	824	824
Total cold run time: 315414 ms
Total hot run time: 201902 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.36 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 01daa3717df7a54d612d3af5453ec21c8f85f2f3, data reload: false

query1	0.02	0.02	0.02
query2	0.06	0.02	0.02
query3	0.24	0.04	0.04
query4	1.80	0.06	0.07
query5	0.53	0.51	0.51
query6	1.25	0.62	0.60
query7	0.02	0.02	0.01
query8	0.03	0.03	0.03
query9	0.50	0.50	0.48
query10	0.54	0.53	0.53
query11	0.12	0.09	0.08
query12	0.11	0.10	0.09
query13	0.62	0.62	0.61
query14	0.80	0.79	0.80
query15	0.78	0.75	0.76
query16	0.35	0.37	0.38
query17	1.02	1.05	1.03
query18	0.19	0.30	0.20
query19	1.92	1.86	1.88
query20	0.01	0.01	0.01
query21	15.45	0.55	0.52
query22	2.33	1.71	1.53
query23	17.04	1.11	0.95
query24	3.41	0.82	1.26
query25	0.32	0.13	0.04
query26	0.48	0.16	0.14
query27	0.04	0.03	0.05
query28	9.56	0.72	0.70
query29	12.72	2.27	2.28
query30	0.58	0.51	0.52
query31	2.81	0.38	0.37
query32	3.41	0.50	0.50
query33	3.08	3.12	3.05
query34	15.24	4.78	4.77
query35	4.85	4.87	4.80
query36	1.04	1.00	1.02
query37	0.06	0.04	0.04
query38	0.03	0.02	0.02
query39	0.02	0.01	0.02
query40	0.15	0.14	0.14
query41	0.07	0.02	0.02
query42	0.02	0.02	0.02
query43	0.03	0.02	0.02
Total cold run time: 103.65 s
Total hot run time: 30.36 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 01daa3717df7a54d612d3af5453ec21c8f85f2f3 with default session variables
Stream load json:         21 seconds loaded 2358488459 Bytes, about 107 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       20.3 seconds inserted 10000000 Rows, about 492K ops/s

@xiaokang xiaokang merged commit de7cabb into apache:branch-2.0 Apr 2, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants