Skip to content

Conversation

@w41ter
Copy link
Contributor

@w41ter w41ter commented Jul 26, 2024

Cherry-pick #38370

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@w41ter
Copy link
Contributor Author

w41ter commented Jul 26, 2024

run buildall

@w41ter w41ter force-pushed the pick/38370_to_2.0 branch from d431b01 to 68e847e Compare July 26, 2024 03:06
@w41ter
Copy link
Contributor Author

w41ter commented Jul 26, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 50313 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 68e847ee25b8cb07ac4d1ac974072dbc553520b3, data reload: false

------ Round 1 ----------------------------------
q1	18555	4408	4395	4395
q2	2086	153	151	151
q3	10270	1906	1969	1906
q4	11114	1252	1335	1252
q5	8474	3866	3957	3866
q6	235	151	125	125
q7	2057	1622	1579	1579
q8	9579	2775	2756	2756
q9	10972	10761	10546	10546
q10	8917	3634	3532	3532
q11	425	238	256	238
q12	466	305	308	305
q13	19680	4043	4069	4043
q14	356	336	334	334
q15	527	458	468	458
q16	694	579	573	573
q17	1144	951	963	951
q18	7346	6809	6920	6809
q19	1773	1669	1645	1645
q20	547	318	311	311
q21	4405	4106	4087	4087
q22	528	451	455	451
Total cold run time: 120150 ms
Total hot run time: 50313 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4342	4271	4291	4271
q2	321	226	226	226
q3	4169	4131	4163	4131
q4	2755	2746	2739	2739
q5	7098	7056	7041	7041
q6	237	124	125	124
q7	3194	2845	2815	2815
q8	4330	4418	4439	4418
q9	16802	16806	16746	16746
q10	4275	4263	4231	4231
q11	773	674	687	674
q12	1032	841	869	841
q13	6975	3767	3767	3767
q14	465	420	429	420
q15	497	456	451	451
q16	739	694	700	694
q17	3835	3829	3814	3814
q18	8678	8673	8723	8673
q19	1834	1699	1632	1632
q20	2435	2128	2111	2111
q21	8444	8439	8468	8439
q22	1025	964	1028	964
Total cold run time: 84255 ms
Total hot run time: 79222 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204028 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 68e847ee25b8cb07ac4d1ac974072dbc553520b3, data reload: false

query1	924	415	377	377
query2	6544	2834	2450	2450
query3	6919	209	200	200
query4	20078	18071	18080	18071
query5	19732	6571	6616	6571
query6	290	214	226	214
query7	4160	300	300	300
query8	428	408	387	387
query9	3095	2683	2612	2612
query10	424	286	305	286
query11	11304	10812	10741	10741
query12	123	83	72	72
query13	5618	683	675	675
query14	17697	13356	13601	13356
query15	401	245	244	244
query16	6456	290	264	264
query17	1708	1469	870	870
query18	2299	402	411	402
query19	209	158	151	151
query20	72	81	77	77
query21	192	98	92	92
query22	5335	4986	4991	4986
query23	32799	31935	31907	31907
query24	6985	6511	6487	6487
query25	529	431	426	426
query26	521	164	158	158
query27	1830	295	293	293
query28	6079	2376	2342	2342
query29	2949	2740	2705	2705
query30	244	167	161	161
query31	916	731	746	731
query32	67	61	58	58
query33	394	253	264	253
query34	854	473	479	473
query35	1132	916	952	916
query36	1278	1211	1215	1211
query37	92	57	60	57
query38	3069	2935	2886	2886
query39	1387	1337	1314	1314
query40	204	88	96	88
query41	46	43	43	43
query42	84	86	84	84
query43	715	699	681	681
query44	1136	719	716	716
query45	254	236	236	236
query46	1238	954	995	954
query47	1935	1732	1787	1732
query48	1032	723	693	693
query49	632	365	374	365
query50	858	609	624	609
query51	4688	4686	4668	4668
query52	94	74	80	74
query53	440	333	310	310
query54	2668	2457	2442	2442
query55	80	81	86	81
query56	242	205	210	205
query57	1206	1049	1050	1049
query58	211	218	205	205
query59	4257	4010	4044	4010
query60	223	202	227	202
query61	98	94	96	94
query62	844	437	498	437
query63	487	336	349	336
query64	2523	1511	1463	1463
query65	3627	3535	3514	3514
query66	768	373	381	373
query67	15583	15993	16775	15993
query68	9294	692	683	683
query69	583	346	353	346
query70	1520	1319	1468	1319
query71	421	299	321	299
query72	6694	3495	3474	3474
query73	745	325	326	325
query74	6363	5926	5845	5845
query75	5398	3725	3714	3714
query76	5783	1176	1227	1176
query77	994	263	249	249
query78	12610	11760	11432	11432
query79	7979	642	632	632
query80	1264	407	402	402
query81	500	230	229	229
query82	1681	99	94	94
query83	187	136	127	127
query84	265	71	69	69
query85	880	329	332	329
query86	339	293	325	293
query87	3199	3021	2961	2961
query88	4887	2295	2278	2278
query89	409	279	286	279
query90	1957	208	203	203
query91	169	149	154	149
query92	64	53	52	52
query93	5904	601	599	599
query94	695	212	208	208
query95	1105	1040	1057	1040
query96	634	330	321	321
query97	6392	6369	6417	6369
query98	197	181	180	180
query99	2945	919	958	919
Total cold run time: 313363 ms
Total hot run time: 204028 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.72 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 68e847ee25b8cb07ac4d1ac974072dbc553520b3, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.25	0.04	0.05
query4	1.79	0.07	0.05
query5	0.53	0.53	0.52
query6	1.25	0.66	0.63
query7	0.01	0.00	0.01
query8	0.03	0.03	0.02
query9	0.52	0.49	0.48
query10	0.53	0.54	0.53
query11	0.13	0.08	0.09
query12	0.12	0.09	0.09
query13	0.63	0.61	0.62
query14	0.77	0.79	0.80
query15	0.77	0.75	0.75
query16	0.37	0.40	0.38
query17	1.00	0.99	0.99
query18	0.23	0.24	0.25
query19	1.95	1.85	1.84
query20	0.02	0.01	0.01
query21	15.52	0.59	0.55
query22	2.04	2.37	1.48
query23	17.08	1.04	1.12
query24	4.86	1.09	1.49
query25	0.36	0.10	0.07
query26	0.60	0.14	0.14
query27	0.04	0.04	0.04
query28	7.67	0.76	0.72
query29	12.63	2.28	2.35
query30	0.55	0.51	0.52
query31	2.82	0.37	0.36
query32	3.39	0.50	0.49
query33	3.07	3.08	3.03
query34	15.24	4.80	4.79
query35	4.85	4.81	4.84
query36	1.06	1.02	1.00
query37	0.05	0.04	0.04
query38	0.04	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.15	0.13
query41	0.06	0.01	0.02
query42	0.03	0.01	0.01
query43	0.02	0.01	0.02
Total cold run time: 103.15 s
Total hot run time: 30.72 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 68e847ee25b8cb07ac4d1ac974072dbc553520b3 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.2 seconds inserted 10000000 Rows, about 471K ops/s

@w41ter w41ter merged commit fe2fdf0 into apache:branch-2.0 Jul 26, 2024
@w41ter w41ter deleted the pick/38370_to_2.0 branch July 26, 2024 06:37
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants