Skip to content

Conversation

@w41ter
Copy link
Contributor

@w41ter w41ter commented May 29, 2024

Cherry-pick #35250, refs: #34359, #34888

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@w41ter
Copy link
Contributor Author

w41ter commented May 29, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49660 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cc27962d997b333dbbc9726161a23a5a805b2559, data reload: false

------ Round 1 ----------------------------------
q1	17681	4354	4347	4347
q2	2042	199	151	151
q3	10219	1864	1907	1864
q4	10310	1231	1331	1231
q5	8408	4153	3903	3903
q6	235	125	125	125
q7	2030	1635	1571	1571
q8	9509	2712	2702	2702
q9	13808	10444	10554	10444
q10	8620	3497	3513	3497
q11	415	253	252	252
q12	470	308	297	297
q13	18359	3926	4044	3926
q14	353	338	336	336
q15	504	452	468	452
q16	675	569	577	569
q17	1124	966	929	929
q18	7235	6899	6806	6806
q19	1705	1568	1516	1516
q20	536	325	299	299
q21	4364	4147	4051	4051
q22	494	408	392	392
Total cold run time: 119096 ms
Total hot run time: 49660 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4332	4301	4296	4296
q2	313	232	231	231
q3	4203	4119	4136	4119
q4	2754	2722	2744	2722
q5	7103	7150	7061	7061
q6	239	122	120	120
q7	3196	2801	2817	2801
q8	4381	4468	4422	4422
q9	17396	17149	16883	16883
q10	4190	4258	4214	4214
q11	756	677	688	677
q12	1020	837	849	837
q13	6814	3749	3748	3748
q14	449	438	431	431
q15	501	459	471	459
q16	732	683	677	677
q17	3782	3820	3920	3820
q18	8762	8654	8767	8654
q19	1756	1668	1675	1668
q20	2369	2124	2141	2124
q21	8520	8397	8409	8397
q22	1021	986	936	936
Total cold run time: 84589 ms
Total hot run time: 79297 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203601 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cc27962d997b333dbbc9726161a23a5a805b2559, data reload: false

query1	932	396	382	382
query2	6593	2792	2433	2433
query3	7236	225	220	220
query4	22620	18136	18180	18136
query5	19815	6625	6587	6587
query6	423	244	246	244
query7	5272	324	330	324
query8	271	244	279	244
query9	3142	2703	2656	2656
query10	424	331	319	319
query11	12179	10983	10994	10983
query12	124	80	74	74
query13	5938	717	736	717
query14	20850	13408	13466	13408
query15	368	227	230	227
query16	6439	287	262	262
query17	1323	1512	898	898
query18	2240	425	407	407
query19	208	151	152	151
query20	82	78	79	78
query21	193	93	97	93
query22	5251	4996	4959	4959
query23	32403	31918	31820	31820
query24	6795	6645	6524	6524
query25	532	422	435	422
query26	524	165	167	165
query27	1688	299	298	298
query28	6141	2365	2318	2318
query29	2901	2747	2658	2658
query30	238	168	166	166
query31	917	740	743	740
query32	62	66	65	65
query33	417	259	264	259
query34	837	470	472	470
query35	1120	927	894	894
query36	1234	1048	1265	1048
query37	92	63	61	61
query38	3054	2950	2963	2950
query39	1374	1307	1316	1307
query40	211	93	98	93
query41	40	38	38	38
query42	83	81	78	78
query43	727	726	632	632
query44	1124	719	720	719
query45	254	237	232	232
query46	1231	972	967	967
query47	1910	1683	1656	1656
query48	1003	719	725	719
query49	635	385	367	367
query50	845	611	613	611
query51	4779	4748	4688	4688
query52	96	88	97	88
query53	449	329	337	329
query54	2683	2464	2479	2464
query55	95	82	95	82
query56	249	229	247	229
query57	1381	1131	1164	1131
query58	223	209	193	193
query59	4136	4087	3806	3806
query60	217	213	200	200
query61	105	97	99	97
query62	846	487	489	487
query63	501	342	348	342
query64	2510	1546	1450	1450
query65	3619	3540	3578	3540
query66	766	386	382	382
query67	16371	15005	15111	15005
query68	8434	653	650	650
query69	577	367	352	352
query70	1580	1449	1384	1384
query71	424	313	304	304
query72	6579	3489	3523	3489
query73	735	325	329	325
query74	6310	5793	5935	5793
query75	4639	3762	3698	3698
query76	4714	1148	1212	1148
query77	664	260	263	260
query78	12645	11934	12695	11934
query79	11849	623	644	623
query80	1349	405	409	405
query81	502	239	237	237
query82	1442	98	97	97
query83	169	131	134	131
query84	262	71	72	71
query85	1010	327	333	327
query86	340	297	299	297
query87	3193	3007	2949	2949
query88	4923	2365	2363	2363
query89	489	284	308	284
query90	1930	215	219	215
query91	179	139	152	139
query92	59	56	52	52
query93	5993	585	569	569
query94	807	212	211	211
query95	1107	1044	1061	1044
query96	650	330	333	330
query97	6617	6322	6375	6322
query98	184	178	180	178
query99	2788	1008	828	828
Total cold run time: 322484 ms
Total hot run time: 203601 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.73 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cc27962d997b333dbbc9726161a23a5a805b2559, data reload: false

query1	0.02	0.03	0.02
query2	0.06	0.03	0.02
query3	0.24	0.05	0.05
query4	1.81	0.06	0.07
query5	0.54	0.52	0.52
query6	1.23	0.62	0.61
query7	0.01	0.01	0.02
query8	0.03	0.02	0.02
query9	0.51	0.50	0.49
query10	0.53	0.53	0.52
query11	0.12	0.08	0.08
query12	0.11	0.09	0.09
query13	0.62	0.62	0.61
query14	0.78	0.78	0.77
query15	0.78	0.76	0.75
query16	0.35	0.37	0.36
query17	1.01	0.99	1.02
query18	0.22	0.26	0.24
query19	1.93	1.89	1.84
query20	0.02	0.01	0.01
query21	15.48	0.56	0.55
query22	2.13	2.52	1.70
query23	17.31	0.98	1.08
query24	4.48	0.83	1.74
query25	0.36	0.11	0.06
query26	0.54	0.15	0.15
query27	0.05	0.04	0.04
query28	8.10	0.77	0.73
query29	12.66	2.29	2.35
query30	0.62	0.53	0.51
query31	2.82	0.39	0.38
query32	3.37	0.50	0.49
query33	3.07	3.09	3.04
query34	15.27	4.82	4.78
query35	4.89	4.87	4.87
query36	1.04	1.02	1.03
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.02	0.02	0.01
query40	0.16	0.14	0.14
query41	0.06	0.02	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 103.49 s
Total hot run time: 30.73 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit cc27962d997b333dbbc9726161a23a5a805b2559 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.6 seconds inserted 10000000 Rows, about 462K ops/s

@dataroaring dataroaring merged commit 3a7f68a into apache:branch-2.0 May 29, 2024
@w41ter w41ter deleted the pick/35250 branch May 29, 2024 06:06
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants