Skip to content

Conversation

@zzzxl1993
Copy link
Contributor

Proposed changes

#37949

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zzzxl1993
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 50261 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ffbdff5d5a469f3938eab87dfca54a243ca6e469, data reload: false

------ Round 1 ----------------------------------
q1	17532	4401	4337	4337
q2	2072	161	153	153
q3	10255	1849	1915	1849
q4	10105	1274	1326	1274
q5	8497	3931	3928	3928
q6	235	124	128	124
q7	2082	1617	1578	1578
q8	9308	2745	2725	2725
q9	10633	11019	10547	10547
q10	8688	3498	3504	3498
q11	429	258	253	253
q12	478	315	311	311
q13	18386	3955	4011	3955
q14	353	335	317	317
q15	510	463	466	463
q16	699	572	560	560
q17	1146	983	965	965
q18	7336	6931	6958	6931
q19	1819	1699	1621	1621
q20	555	353	307	307
q21	4425	4193	4124	4124
q22	545	441	455	441
Total cold run time: 116088 ms
Total hot run time: 50261 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4336	4320	4292	4292
q2	323	229	216	216
q3	4196	4187	4148	4148
q4	2746	2758	2740	2740
q5	7161	7144	7162	7144
q6	237	122	122	122
q7	3229	2873	2838	2838
q8	4293	4453	4453	4453
q9	16934	16906	16824	16824
q10	4244	4313	4254	4254
q11	756	695	668	668
q12	1022	859	853	853
q13	7068	3783	3742	3742
q14	448	433	448	433
q15	518	455	465	455
q16	730	669	686	669
q17	3808	3884	3766	3766
q18	8691	8855	8738	8738
q19	1764	1753	1674	1674
q20	2382	2090	2121	2090
q21	8516	8492	8467	8467
q22	1073	985	999	985
Total cold run time: 84475 ms
Total hot run time: 79571 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203519 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ffbdff5d5a469f3938eab87dfca54a243ca6e469, data reload: false

query1	921	422	387	387
query2	6524	2854	2801	2801
query3	6933	217	205	205
query4	20394	17914	17857	17857
query5	19718	6536	6499	6499
query6	290	221	236	221
query7	4163	299	304	299
query8	430	418	412	412
query9	3168	2708	2645	2645
query10	413	316	300	300
query11	11284	10683	10680	10680
query12	128	77	78	77
query13	5608	693	693	693
query14	17589	13673	13444	13444
query15	406	237	253	237
query16	6474	279	266	266
query17	1705	1463	875	875
query18	2319	410	414	410
query19	213	147	158	147
query20	84	80	76	76
query21	190	97	98	97
query22	5332	5109	5007	5007
query23	32474	32006	31888	31888
query24	7047	6508	6490	6490
query25	521	440	415	415
query26	532	172	165	165
query27	1859	300	299	299
query28	6219	2387	2342	2342
query29	2892	2717	2842	2717
query30	241	167	169	167
query31	914	736	737	736
query32	69	62	64	62
query33	395	251	245	245
query34	869	478	494	478
query35	1081	926	918	918
query36	1374	1290	1010	1010
query37	89	70	62	62
query38	3064	2945	2919	2919
query39	1360	1338	1318	1318
query40	204	97	94	94
query41	47	44	44	44
query42	85	84	84	84
query43	803	673	688	673
query44	1125	729	733	729
query45	244	240	242	240
query46	1227	970	982	970
query47	1853	1816	1728	1728
query48	1027	721	728	721
query49	628	383	378	378
query50	869	611	629	611
query51	4798	4651	4658	4651
query52	94	74	84	74
query53	449	321	321	321
query54	2654	2447	2411	2411
query55	93	84	81	81
query56	247	226	199	199
query57	1121	1060	1086	1060
query58	227	210	208	208
query59	4152	3946	4116	3946
query60	218	213	211	211
query61	95	94	92	92
query62	872	480	469	469
query63	495	351	351	351
query64	2404	1479	1418	1418
query65	3659	3518	3580	3518
query66	810	377	379	377
query67	17472	15309	15151	15151
query68	10194	665	658	658
query69	582	350	347	347
query70	1810	1729	1554	1554
query71	408	304	320	304
query72	6594	3457	3484	3457
query73	734	321	323	321
query74	6329	5858	5793	5793
query75	5316	3704	3740	3704
query76	6594	1133	1183	1133
query77	1130	268	254	254
query78	12715	11491	11676	11491
query79	7837	640	638	638
query80	1262	411	424	411
query81	490	245	234	234
query82	1636	97	102	97
query83	174	142	135	135
query84	257	74	70	70
query85	881	330	330	330
query86	345	292	295	292
query87	3250	3048	3010	3010
query88	4642	2333	2338	2333
query89	385	301	295	295
query90	1970	210	216	210
query91	175	147	150	147
query92	59	52	56	52
query93	6496	618	586	586
query94	704	210	208	208
query95	1108	1058	1110	1058
query96	640	325	324	324
query97	6383	6370	6392	6370
query98	183	170	168	168
query99	2911	864	859	859
Total cold run time: 317452 ms
Total hot run time: 203519 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.48 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ffbdff5d5a469f3938eab87dfca54a243ca6e469, data reload: false

query1	0.02	0.03	0.02
query2	0.07	0.02	0.02
query3	0.25	0.05	0.05
query4	1.78	0.06	0.06
query5	0.52	0.52	0.52
query6	1.27	0.62	0.62
query7	0.01	0.01	0.01
query8	0.03	0.02	0.02
query9	0.52	0.51	0.49
query10	0.54	0.54	0.53
query11	0.11	0.08	0.08
query12	0.12	0.09	0.09
query13	0.62	0.61	0.61
query14	0.78	0.78	0.78
query15	0.78	0.76	0.76
query16	0.36	0.36	0.36
query17	1.03	1.00	1.01
query18	0.22	0.24	0.26
query19	1.91	1.88	1.85
query20	0.02	0.01	0.01
query21	15.48	0.55	0.54
query22	1.95	2.45	1.62
query23	17.37	0.95	0.79
query24	7.74	1.06	1.11
query25	0.38	0.08	0.08
query26	0.81	0.17	0.16
query27	0.05	0.04	0.04
query28	5.26	0.72	0.71
query29	12.64	2.09	2.32
query30	0.61	0.54	0.50
query31	2.81	0.38	0.37
query32	3.38	0.50	0.49
query33	3.07	3.06	3.06
query34	15.24	4.78	4.77
query35	4.85	4.84	4.82
query36	1.04	1.00	1.01
query37	0.06	0.05	0.05
query38	0.04	0.02	0.02
query39	0.02	0.02	0.01
query40	0.15	0.14	0.14
query41	0.06	0.01	0.02
query42	0.02	0.01	0.02
query43	0.03	0.02	0.02
Total cold run time: 104.02 s
Total hot run time: 30.48 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit ffbdff5d5a469f3938eab87dfca54a243ca6e469 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.1 seconds inserted 10000000 Rows, about 473K ops/s

@zzzxl1993 zzzxl1993 force-pushed the branch-2.0.202407162049 branch from ffbdff5 to 3b398de Compare July 17, 2024 15:09
@zzzxl1993
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49464 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3b398de14c6e126dfb8b4166be415188007926ee, data reload: false

------ Round 1 ----------------------------------
q1	17804	4364	4319	4319
q2	2071	153	153	153
q3	10289	1876	1924	1876
q4	10353	1247	1325	1247
q5	8678	3886	3873	3873
q6	228	124	125	124
q7	2026	1627	1604	1604
q8	9361	2713	2691	2691
q9	10553	10303	10098	10098
q10	8619	3514	3490	3490
q11	420	256	234	234
q12	468	307	294	294
q13	18335	3968	3998	3968
q14	350	325	320	320
q15	499	461	450	450
q16	684	576	563	563
q17	1120	962	918	918
q18	7371	6818	6847	6818
q19	1789	1613	1581	1581
q20	530	314	309	309
q21	4444	4123	4094	4094
q22	517	440	451	440
Total cold run time: 116509 ms
Total hot run time: 49464 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4339	4246	4300	4246
q2	319	223	227	223
q3	4177	4126	4137	4126
q4	2749	2750	2734	2734
q5	7197	7135	7154	7135
q6	237	119	117	117
q7	3265	2822	2820	2820
q8	4341	4442	4491	4442
q9	16834	16726	16793	16726
q10	4220	4227	4271	4227
q11	776	693	667	667
q12	1030	879	863	863
q13	6885	3705	3689	3689
q14	444	424	419	419
q15	505	456	451	451
q16	736	673	661	661
q17	3863	3809	3813	3809
q18	8697	8854	8768	8768
q19	1720	1706	1633	1633
q20	2384	2092	2116	2092
q21	8437	8515	8519	8515
q22	1016	1005	997	997
Total cold run time: 84171 ms
Total hot run time: 79360 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203558 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3b398de14c6e126dfb8b4166be415188007926ee, data reload: false

query1	933	424	379	379
query2	6534	2787	2586	2586
query3	6922	214	206	206
query4	20266	17834	17814	17814
query5	19727	6467	6501	6467
query6	289	224	220	220
query7	4153	297	316	297
query8	424	425	434	425
query9	3062	2631	2575	2575
query10	425	286	297	286
query11	11500	10623	10703	10623
query12	125	80	71	71
query13	5600	717	700	700
query14	17368	12911	13767	12911
query15	387	259	242	242
query16	6465	293	263	263
query17	1688	1479	871	871
query18	2321	413	420	413
query19	210	154	149	149
query20	82	77	81	77
query21	193	98	97	97
query22	5311	5075	4973	4973
query23	32439	31872	31915	31872
query24	7018	6464	6455	6455
query25	514	424	410	410
query26	541	164	158	158
query27	1899	301	295	295
query28	6167	2344	2326	2326
query29	2827	2724	2694	2694
query30	245	171	172	171
query31	898	738	727	727
query32	63	65	58	58
query33	418	277	251	251
query34	864	475	493	475
query35	1129	910	935	910
query36	1384	1163	1054	1054
query37	89	64	60	60
query38	3098	2932	2927	2927
query39	1383	1312	1308	1308
query40	207	95	97	95
query41	47	46	43	43
query42	83	81	81	81
query43	711	691	646	646
query44	1148	727	727	727
query45	247	244	233	233
query46	1242	964	976	964
query47	1838	1884	1723	1723
query48	1028	725	704	704
query49	621	381	368	368
query50	861	613	621	613
query51	4753	4627	4713	4627
query52	93	82	84	82
query53	448	322	313	313
query54	2641	2465	2502	2465
query55	96	94	78	78
query56	237	202	207	202
query57	1160	1108	1001	1001
query58	205	211	212	211
query59	4063	3757	4371	3757
query60	210	210	208	208
query61	98	98	97	97
query62	872	533	437	437
query63	495	343	345	343
query64	2613	1527	1475	1475
query65	3642	3559	3559	3559
query66	755	381	368	368
query67	17013	15272	16453	15272
query68	8174	674	653	653
query69	562	345	335	335
query70	1573	1387	1333	1333
query71	397	309	318	309
query72	6480	3499	3486	3486
query73	731	337	318	318
query74	6264	5871	5804	5804
query75	4639	3721	3686	3686
query76	4573	1165	1194	1165
query77	559	262	257	257
query78	12522	13113	12934	12934
query79	10620	661	677	661
query80	1390	404	424	404
query81	516	241	228	228
query82	490	102	97	97
query83	168	134	140	134
query84	259	70	69	69
query85	734	333	339	333
query86	365	294	308	294
query87	3227	3063	3039	3039
query88	4685	2309	2313	2309
query89	382	285	284	284
query90	1700	206	213	206
query91	179	140	142	140
query92	60	52	53	52
query93	3677	574	556	556
query94	816	216	207	207
query95	1125	1070	1068	1068
query96	654	328	316	316
query97	6444	6462	6349	6349
query98	191	172	170	170
query99	2660	885	874	874
Total cold run time: 309204 ms
Total hot run time: 203558 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.84 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3b398de14c6e126dfb8b4166be415188007926ee, data reload: false

query1	0.02	0.03	0.02
query2	0.07	0.03	0.02
query3	0.25	0.04	0.05
query4	1.80	0.07	0.06
query5	0.53	0.52	0.51
query6	1.27	0.63	0.62
query7	0.02	0.01	0.01
query8	0.03	0.03	0.02
query9	0.54	0.51	0.49
query10	0.54	0.53	0.54
query11	0.12	0.08	0.09
query12	0.13	0.09	0.09
query13	0.62	0.61	0.62
query14	0.79	0.78	0.78
query15	0.78	0.76	0.76
query16	0.37	0.37	0.36
query17	1.00	1.00	1.01
query18	0.21	0.27	0.24
query19	1.92	1.85	1.86
query20	0.02	0.01	0.01
query21	15.49	0.55	0.53
query22	2.25	1.79	1.72
query23	17.00	1.02	0.98
query24	5.06	0.96	1.41
query25	0.38	0.11	0.06
query26	0.55	0.17	0.15
query27	0.04	0.04	0.03
query28	7.77	0.73	0.74
query29	12.66	2.34	2.33
query30	0.57	0.54	0.51
query31	2.82	0.38	0.37
query32	3.37	0.48	0.49
query33	3.10	3.04	3.08
query34	15.26	4.81	4.78
query35	4.90	4.81	4.86
query36	1.05	1.01	1.02
query37	0.06	0.05	0.04
query38	0.03	0.02	0.02
query39	0.02	0.02	0.01
query40	0.15	0.14	0.15
query41	0.07	0.02	0.01
query42	0.02	0.01	0.02
query43	0.03	0.02	0.02
Total cold run time: 103.68 s
Total hot run time: 30.84 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 3b398de14c6e126dfb8b4166be415188007926ee with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.6 seconds inserted 10000000 Rows, about 462K ops/s

@xiaokang xiaokang merged commit 3a1c8e7 into apache:branch-2.0 Jul 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants