Skip to content

Conversation

@csun5285
Copy link
Contributor

Proposed changes

pick from master #41375

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@csun5285
Copy link
Contributor Author

run buildall

@csun5285
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 48866 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 40d63472d885a9763ad0b87c73bd15af2df1676f, data reload: false

------ Round 1 ----------------------------------
q1	17727	4380	4346	4346
q2	2084	152	142	142
q3	10268	1920	1915	1915
q4	10363	1221	1297	1221
q5	8826	3902	3897	3897
q6	238	120	121	120
q7	2002	1642	1591	1591
q8	9276	2738	2705	2705
q9	10164	9821	9749	9749
q10	8616	3538	3491	3491
q11	408	254	258	254
q12	464	292	292	292
q13	18383	3947	4054	3947
q14	348	325	329	325
q15	511	467	454	454
q16	536	455	452	452
q17	1125	971	933	933
q18	7258	6779	6870	6779
q19	1668	1574	1491	1491
q20	539	301	311	301
q21	4361	4189	4074	4074
q22	487	397	387	387
Total cold run time: 115652 ms
Total hot run time: 48866 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4276	4283	4318	4283
q2	325	228	224	224
q3	4222	4191	4143	4143
q4	2746	2749	2754	2749
q5	7132	7054	7150	7054
q6	234	118	117	117
q7	3245	2875	2859	2859
q8	4356	4474	4471	4471
q9	13693	13474	13598	13474
q10	4227	4247	4236	4236
q11	768	696	698	696
q12	1020	861	858	858
q13	7046	3782	3736	3736
q14	454	425	431	425
q15	493	460	460	460
q16	625	588	590	588
q17	3821	3901	3843	3843
q18	8785	8764	8799	8764
q19	1724	1668	1646	1646
q20	2357	2126	2115	2115
q21	8428	8431	8449	8431
q22	1020	943	959	943
Total cold run time: 80997 ms
Total hot run time: 76115 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 212102 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 40d63472d885a9763ad0b87c73bd15af2df1676f, data reload: false

query1	953	391	414	391
query2	6549	2145	2025	2025
query3	6926	204	202	202
query4	22943	21819	21496	21496
query5	19715	6486	6489	6486
query6	290	218	244	218
query7	4321	304	310	304
query8	249	252	244	244
query9	3057	2650	2597	2597
query10	473	311	324	311
query11	15630	15054	15060	15054
query12	129	75	72	72
query13	1040	465	436	436
query14	17210	13387	13978	13387
query15	361	217	225	217
query16	6479	277	258	258
query17	1772	938	905	905
query18	881	321	315	315
query19	211	152	148	148
query20	102	97	104	97
query21	194	94	94	94
query22	5140	5091	4860	4860
query23	34290	33778	33649	33649
query24	7630	6297	6332	6297
query25	516	446	423	423
query26	1255	163	159	159
query27	2270	292	289	289
query28	6121	2287	2272	2272
query29	2967	2846	2664	2664
query30	240	168	165	165
query31	941	744	761	744
query32	73	65	57	57
query33	451	265	256	256
query34	873	474	469	469
query35	1142	883	892	883
query36	1566	1122	1131	1122
query37	90	62	59	59
query38	3082	2930	2928	2928
query39	1369	1308	1319	1308
query40	300	96	96	96
query41	39	37	44	37
query42	91	83	86	83
query43	585	654	611	611
query44	1211	734	732	732
query45	243	232	237	232
query46	1238	950	960	950
query47	1859	1772	1755	1755
query48	520	408	415	408
query49	658	377	379	377
query50	857	619	627	619
query51	4755	4669	4726	4669
query52	84	77	75	75
query53	227	184	187	184
query54	2660	2454	2453	2453
query55	95	69	84	69
query56	210	233	191	191
query57	1364	1157	1148	1148
query58	219	212	210	210
query59	3463	3539	3395	3395
query60	223	219	201	201
query61	94	90	92	90
query62	726	436	522	436
query63	204	180	174	174
query64	3535	1606	1492	1492
query65	3583	3544	3562	3544
query66	768	439	435	435
query67	15907	15416	14996	14996
query68	9535	654	644	644
query69	489	274	265	265
query70	1629	1528	1378	1378
query71	402	302	306	302
query72	7076	4811	4798	4798
query73	756	333	318	318
query74	6395	5891	5800	5800
query75	5138	3691	3668	3668
query76	5261	1156	1186	1156
query77	874	256	254	254
query78	12496	11458	11910	11458
query79	7097	642	618	618
query80	1479	388	389	388
query81	493	236	237	236
query82	1641	99	98	98
query83	170	133	129	129
query84	257	71	71	71
query85	876	316	310	310
query86	333	294	305	294
query87	3242	2988	3012	2988
query88	4542	2297	2294	2294
query89	403	289	279	279
query90	1951	211	209	209
query91	156	127	126	126
query92	56	51	51	51
query93	5988	579	579	579
query94	713	202	206	202
query95	1988	1927	1983	1927
query96	659	331	318	318
query97	6461	6354	6408	6354
query98	231	201	195	195
query99	2829	927	872	872
Total cold run time: 316835 ms
Total hot run time: 212102 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.11 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 40d63472d885a9763ad0b87c73bd15af2df1676f, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.03
query3	0.25	0.05	0.05
query4	1.79	0.07	0.06
query5	0.55	0.53	0.53
query6	1.24	0.61	0.63
query7	0.01	0.02	0.01
query8	0.03	0.02	0.02
query9	0.51	0.51	0.49
query10	0.54	0.52	0.53
query11	0.12	0.09	0.09
query12	0.12	0.09	0.08
query13	0.62	0.62	0.61
query14	0.77	0.78	0.78
query15	0.78	0.77	0.78
query16	0.36	0.39	0.36
query17	0.97	1.00	1.01
query18	0.22	0.26	0.24
query19	1.84	1.87	1.86
query20	0.01	0.01	0.01
query21	15.45	0.55	0.56
query22	2.07	2.42	2.27
query23	17.23	1.09	0.87
query24	4.66	1.72	1.65
query25	0.36	0.10	0.05
query26	0.73	0.17	0.16
query27	0.04	0.05	0.03
query28	7.13	0.74	0.74
query29	12.64	2.40	2.35
query30	0.60	0.52	0.51
query31	2.82	0.38	0.38
query32	3.40	0.48	0.50
query33	3.04	3.06	3.08
query34	15.27	4.78	4.81
query35	4.82	4.85	4.88
query36	1.05	1.03	1.01
query37	0.06	0.04	0.05
query38	0.03	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.13	0.14
query41	0.07	0.01	0.01
query42	0.02	0.01	0.02
query43	0.03	0.01	0.02
Total cold run time: 102.52 s
Total hot run time: 32.11 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 40d63472d885a9763ad0b87c73bd15af2df1676f with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       22.0 seconds inserted 10000000 Rows, about 454K ops/s

@xiaokang xiaokang merged commit f29beba into apache:branch-2.0 Oct 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants