Skip to content

Conversation

@yujun777
Copy link
Contributor

cherry pick from #36795

@yujun777
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@yujun777
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49776 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6f4c57f6e4e4d27feb4239495ba8b4b195140054, data reload: false

------ Round 1 ----------------------------------
q1	18038	4344	4306	4306
q2	2073	157	154	154
q3	10261	1868	1941	1868
q4	10274	1269	1296	1269
q5	8729	3863	3924	3863
q6	233	148	125	125
q7	2037	1647	1646	1646
q8	9519	2723	2710	2710
q9	13511	10284	10270	10270
q10	8699	3576	3580	3576
q11	414	236	237	236
q12	465	303	303	303
q13	18363	4008	4037	4008
q14	362	339	328	328
q15	508	452	460	452
q16	656	566	573	566
q17	1136	958	918	918
q18	7360	6752	6935	6752
q19	1785	1670	1600	1600
q20	530	295	306	295
q21	4340	4087	4101	4087
q22	536	444	446	444
Total cold run time: 119829 ms
Total hot run time: 49776 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4300	4299	4292	4292
q2	320	229	235	229
q3	4233	4148	4120	4120
q4	2753	2747	2742	2742
q5	7177	7105	7087	7087
q6	239	119	120	119
q7	3237	2887	2846	2846
q8	4350	4465	4454	4454
q9	16962	16980	16769	16769
q10	4258	4274	4296	4274
q11	738	688	678	678
q12	1024	860	878	860
q13	6752	3755	3737	3737
q14	461	430	440	430
q15	504	462	454	454
q16	733	671	690	671
q17	3746	3856	3901	3856
q18	8766	8784	8848	8784
q19	1727	1646	1687	1646
q20	2358	2118	2109	2109
q21	8501	8502	8454	8454
q22	1028	980	1025	980
Total cold run time: 84167 ms
Total hot run time: 79591 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204013 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6f4c57f6e4e4d27feb4239495ba8b4b195140054, data reload: false

query1	926	416	378	378
query2	6519	2746	2688	2688
query3	6918	206	203	203
query4	20540	18166	18158	18158
query5	19738	6499	6505	6499
query6	294	240	226	226
query7	4155	297	308	297
query8	442	410	414	410
query9	3106	2684	2596	2596
query10	418	314	301	301
query11	11581	10939	11000	10939
query12	127	74	73	73
query13	5586	686	679	679
query14	17550	13337	13637	13337
query15	356	243	254	243
query16	6475	287	262	262
query17	1699	1453	859	859
query18	2347	439	407	407
query19	204	146	151	146
query20	73	81	84	81
query21	187	97	93	93
query22	5365	5227	4991	4991
query23	32490	31914	31873	31873
query24	6948	6511	6454	6454
query25	530	438	441	438
query26	530	166	168	166
query27	1863	300	296	296
query28	6143	2374	2327	2327
query29	2939	2810	2721	2721
query30	234	171	173	171
query31	897	738	754	738
query32	67	61	61	61
query33	425	261	259	259
query34	840	479	470	470
query35	1119	948	926	926
query36	1180	1236	1140	1140
query37	89	56	61	56
query38	3120	2969	3005	2969
query39	1390	1328	1305	1305
query40	205	98	94	94
query41	56	45	45	45
query42	90	84	85	84
query43	744	732	703	703
query44	1154	725	720	720
query45	241	240	231	231
query46	1237	941	965	941
query47	1901	1979	1758	1758
query48	1006	703	718	703
query49	631	373	373	373
query50	875	600	583	583
query51	4728	4743	4640	4640
query52	94	92	81	81
query53	455	319	318	318
query54	2666	2476	2401	2401
query55	94	77	84	77
query56	225	216	214	214
query57	1117	1101	1043	1043
query58	220	208	201	201
query59	4482	3925	4019	3925
query60	220	209	217	209
query61	97	93	95	93
query62	856	544	514	514
query63	498	344	342	342
query64	2567	1501	1494	1494
query65	3635	3556	3543	3543
query66	824	397	381	381
query67	15832	15467	15793	15467
query68	9601	682	681	681
query69	562	366	360	360
query70	1694	1400	1287	1287
query71	414	311	313	311
query72	6503	3450	3470	3450
query73	754	328	325	325
query74	6337	5949	5901	5901
query75	5406	3711	3645	3645
query76	6004	1196	1230	1196
query77	1007	255	254	254
query78	12900	11755	11473	11473
query79	7665	639	658	639
query80	836	400	397	397
query81	494	235	235	235
query82	1558	98	101	98
query83	176	136	131	131
query84	262	76	70	70
query85	756	325	313	313
query86	337	291	303	291
query87	3277	3032	3055	3032
query88	4792	2302	2304	2302
query89	372	282	301	282
query90	1913	195	208	195
query91	175	142	143	142
query92	56	54	52	52
query93	5813	555	611	555
query94	686	214	206	206
query95	1106	1060	1055	1055
query96	658	342	331	331
query97	6529	6359	6452	6359
query98	193	179	179	179
query99	2827	852	881	852
Total cold run time: 313823 ms
Total hot run time: 204013 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.42 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6f4c57f6e4e4d27feb4239495ba8b4b195140054, data reload: false

query1	0.02	0.03	0.03
query2	0.07	0.02	0.02
query3	0.25	0.06	0.06
query4	1.77	0.07	0.06
query5	0.53	0.53	0.51
query6	1.25	0.67	0.62
query7	0.02	0.01	0.00
query8	0.03	0.02	0.03
query9	0.52	0.50	0.48
query10	0.53	0.54	0.54
query11	0.11	0.09	0.09
query12	0.11	0.09	0.09
query13	0.62	0.61	0.61
query14	0.81	0.78	0.78
query15	0.78	0.76	0.77
query16	0.36	0.36	0.37
query17	1.04	0.97	1.03
query18	0.23	0.26	0.24
query19	1.85	1.85	1.88
query20	0.02	0.01	0.01
query21	15.47	0.56	0.55
query22	2.04	2.54	1.72
query23	17.38	0.89	0.84
query24	5.88	0.80	1.83
query25	0.40	0.13	0.04
query26	0.65	0.15	0.16
query27	0.04	0.03	0.04
query28	7.01	0.76	0.72
query29	12.62	2.33	2.12
query30	0.53	0.53	0.50
query31	2.81	0.38	0.38
query32	3.40	0.50	0.50
query33	3.09	3.08	3.11
query34	15.31	4.80	4.78
query35	4.87	4.86	4.86
query36	1.07	1.02	1.02
query37	0.06	0.04	0.04
query38	0.03	0.02	0.02
query39	0.02	0.01	0.01
query40	0.17	0.13	0.14
query41	0.06	0.01	0.02
query42	0.03	0.02	0.01
query43	0.02	0.01	0.02
Total cold run time: 103.88 s
Total hot run time: 30.42 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 6f4c57f6e4e4d27feb4239495ba8b4b195140054 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.2 seconds inserted 10000000 Rows, about 471K ops/s

@yujun777
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 50914 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e46d62fa3925d912143d50506b9b5f054bb9b974, data reload: false

------ Round 1 ----------------------------------
q1	17533	4489	4542	4489
q2	2073	155	148	148
q3	10262	1920	1938	1920
q4	10103	1279	1351	1279
q5	8515	3958	3950	3950
q6	232	128	125	125
q7	2079	1628	1589	1589
q8	9282	2772	2752	2752
q9	11062	11102	10880	10880
q10	8705	3572	3558	3558
q11	428	252	251	251
q12	471	318	309	309
q13	18361	3994	4056	3994
q14	364	324	327	324
q15	525	457	467	457
q16	685	566	589	566
q17	1149	991	974	974
q18	7380	6904	6783	6783
q19	1781	1705	1635	1635
q20	550	317	305	305
q21	4531	4178	4193	4178
q22	541	448	451	448
Total cold run time: 116612 ms
Total hot run time: 50914 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4321	4342	4323	4323
q2	327	231	224	224
q3	4163	4167	4151	4151
q4	2774	2755	2769	2755
q5	7253	7204	7206	7204
q6	239	123	124	123
q7	3269	2887	2835	2835
q8	4421	4540	4557	4540
q9	17497	17178	17265	17178
q10	4267	4274	4293	4274
q11	779	671	676	671
q12	1049	847	878	847
q13	6561	3738	3736	3736
q14	432	427	429	427
q15	515	452	463	452
q16	748	680	676	676
q17	3887	3923	3831	3831
q18	8858	8841	8908	8841
q19	1763	1733	1708	1708
q20	2391	2101	2145	2101
q21	8592	8431	8518	8431
q22	1028	913	976	913
Total cold run time: 85134 ms
Total hot run time: 80241 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204381 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e46d62fa3925d912143d50506b9b5f054bb9b974, data reload: false

query1	958	399	380	380
query2	6546	2818	2839	2818
query3	6912	215	206	206
query4	20061	17991	18013	17991
query5	19729	6563	6501	6501
query6	282	233	223	223
query7	4163	309	322	309
query8	419	428	385	385
query9	3155	2705	2632	2632
query10	400	320	308	308
query11	11290	10780	10622	10622
query12	124	77	75	75
query13	5585	704	719	704
query14	17536	13809	13438	13438
query15	361	250	248	248
query16	6480	292	275	275
query17	1688	1460	868	868
query18	2322	415	413	413
query19	201	154	154	154
query20	83	80	81	80
query21	195	96	95	95
query22	5404	5035	5203	5035
query23	32513	31958	32211	31958
query24	7020	6519	6545	6519
query25	537	434	441	434
query26	639	167	161	161
query27	2036	300	301	300
query28	6129	2395	2332	2332
query29	2822	2836	2624	2624
query30	246	170	179	170
query31	921	741	732	732
query32	70	64	74	64
query33	401	256	246	246
query34	855	473	480	473
query35	1130	945	949	945
query36	1360	1046	1160	1046
query37	92	61	60	60
query38	3131	2916	2959	2916
query39	1375	1348	1335	1335
query40	279	98	100	98
query41	47	44	44	44
query42	81	99	91	91
query43	777	618	679	618
query44	1123	729	736	729
query45	255	232	228	228
query46	1239	984	988	984
query47	1840	1770	1683	1683
query48	1048	725	728	725
query49	633	371	378	371
query50	880	628	648	628
query51	4770	4665	4721	4665
query52	93	85	87	85
query53	459	334	326	326
query54	2646	2475	2464	2464
query55	90	87	86	86
query56	233	239	209	209
query57	1147	1110	1111	1110
query58	212	222	209	209
query59	4307	4148	4093	4093
query60	223	197	211	197
query61	100	99	100	99
query62	890	497	479	479
query63	505	341	348	341
query64	2694	1572	1481	1481
query65	3595	3589	3556	3556
query66	830	402	382	382
query67	16056	15515	15166	15166
query68	10042	650	644	644
query69	578	348	345	345
query70	1883	1495	1511	1495
query71	414	332	307	307
query72	6548	3460	3525	3460
query73	735	316	331	316
query74	6247	5886	5840	5840
query75	5398	3744	3690	3690
query76	6555	1141	1192	1141
query77	1105	261	251	251
query78	12861	11866	12330	11866
query79	7993	640	652	640
query80	1076	402	402	402
query81	487	243	241	241
query82	1482	107	98	98
query83	174	137	134	134
query84	264	72	72	72
query85	883	326	319	319
query86	326	332	295	295
query87	3225	3023	3034	3023
query88	4671	2319	2336	2319
query89	405	289	306	289
query90	1916	207	204	204
query91	174	141	144	141
query92	61	52	54	52
query93	6012	564	613	564
query94	665	208	210	208
query95	1096	1064	1050	1050
query96	650	327	317	317
query97	6589	6464	6511	6464
query98	191	178	174	174
query99	2993	798	822	798
Total cold run time: 315922 ms
Total hot run time: 204381 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.31 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e46d62fa3925d912143d50506b9b5f054bb9b974, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.02
query3	0.25	0.05	0.05
query4	1.78	0.06	0.06
query5	0.53	0.52	0.52
query6	1.22	0.62	0.62
query7	0.01	0.01	0.02
query8	0.03	0.02	0.03
query9	0.54	0.51	0.49
query10	0.52	0.55	0.53
query11	0.12	0.08	0.09
query12	0.11	0.09	0.09
query13	0.62	0.61	0.62
query14	0.80	0.78	0.79
query15	0.78	0.75	0.75
query16	0.39	0.37	0.38
query17	1.04	1.05	0.99
query18	0.23	0.25	0.24
query19	1.93	1.86	1.86
query20	0.01	0.00	0.01
query21	15.46	0.56	0.56
query22	2.32	2.37	1.45
query23	16.57	0.95	0.96
query24	4.72	1.89	1.69
query25	0.38	0.12	0.05
query26	0.62	0.15	0.14
query27	0.05	0.04	0.04
query28	7.94	0.73	0.74
query29	12.77	2.25	2.21
query30	0.56	0.54	0.53
query31	2.82	0.39	0.37
query32	3.38	0.49	0.49
query33	3.10	3.08	3.09
query34	15.26	4.84	4.79
query35	4.90	4.88	4.87
query36	1.06	1.01	1.01
query37	0.06	0.05	0.04
query38	0.04	0.02	0.02
query39	0.02	0.01	0.02
query40	0.17	0.13	0.14
query41	0.06	0.01	0.01
query42	0.02	0.02	0.01
query43	0.02	0.02	0.02
Total cold run time: 103.3 s
Total hot run time: 31.31 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit e46d62fa3925d912143d50506b9b5f054bb9b974 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s

@dataroaring dataroaring merged commit 02b9d7a into apache:branch-2.0 Jun 27, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants