Skip to content

Conversation

@w41ter
Copy link
Contributor

@w41ter w41ter commented May 29, 2024

Cherry-pick #35245

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@w41ter
Copy link
Contributor Author

w41ter commented May 29, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49681 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cd937dc750e6719705881c132e8012dca399cd76, data reload: false

------ Round 1 ----------------------------------
q1	18160	4450	4366	4366
q2	2042	193	150	150
q3	10439	1897	1944	1897
q4	10325	1237	1301	1237
q5	8530	3933	3952	3933
q6	239	127	127	127
q7	2070	1611	1620	1611
q8	9544	2714	2700	2700
q9	14308	10304	10437	10304
q10	8634	3513	3476	3476
q11	405	242	263	242
q12	486	299	300	299
q13	18353	3969	4021	3969
q14	351	327	347	327
q15	511	466	467	466
q16	672	564	573	564
q17	1136	948	908	908
q18	7202	6926	6879	6879
q19	1688	1595	1486	1486
q20	521	306	326	306
q21	4364	4109	4041	4041
q22	491	393	395	393
Total cold run time: 120471 ms
Total hot run time: 49681 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4309	4321	4304	4304
q2	323	225	223	223
q3	4165	4106	4107	4106
q4	2740	2732	2731	2731
q5	7164	7117	7139	7117
q6	243	119	120	119
q7	3180	2835	2788	2788
q8	4313	4435	4458	4435
q9	17264	17131	17005	17005
q10	4214	4256	4268	4256
q11	745	680	667	667
q12	1052	863	857	857
q13	6648	3761	3755	3755
q14	466	440	423	423
q15	505	455	464	455
q16	733	671	686	671
q17	3797	3781	3886	3781
q18	8920	8707	8770	8707
q19	1728	1660	1670	1660
q20	2335	2154	2144	2144
q21	8362	8396	8362	8362
q22	1023	930	964	930
Total cold run time: 84229 ms
Total hot run time: 79496 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204825 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cd937dc750e6719705881c132e8012dca399cd76, data reload: false

query1	928	394	376	376
query2	6579	2746	2652	2652
query3	6927	214	206	206
query4	20865	18076	18029	18029
query5	19753	6512	6554	6512
query6	317	216	228	216
query7	4359	297	306	297
query8	271	281	247	247
query9	3103	2658	2604	2604
query10	413	289	288	288
query11	11396	10583	10657	10583
query12	124	79	71	71
query13	5590	704	707	704
query14	18168	13400	13632	13400
query15	389	238	224	224
query16	6446	279	264	264
query17	1673	1447	885	885
query18	2302	407	420	407
query19	209	151	151	151
query20	84	77	82	77
query21	192	93	95	93
query22	5393	4954	4948	4948
query23	32439	31781	31877	31781
query24	6808	6531	6455	6455
query25	517	443	426	426
query26	529	169	160	160
query27	1883	293	298	293
query28	6181	2329	2320	2320
query29	2948	2735	2849	2735
query30	251	167	166	166
query31	934	716	727	716
query32	68	65	65	65
query33	404	258	247	247
query34	837	473	482	473
query35	1120	921	939	921
query36	1348	1288	1178	1178
query37	93	62	61	61
query38	3040	2932	2894	2894
query39	1384	1313	1327	1313
query40	218	93	97	93
query41	41	37	37	37
query42	84	81	83	81
query43	772	726	663	663
query44	1122	707	717	707
query45	238	229	229	229
query46	1220	953	984	953
query47	1874	1811	1910	1811
query48	1014	715	725	715
query49	620	370	359	359
query50	860	578	619	578
query51	4755	4633	4653	4633
query52	96	84	89	84
query53	447	313	323	313
query54	2659	2435	2435	2435
query55	93	81	90	81
query56	242	207	232	207
query57	1114	1141	1221	1141
query58	220	206	202	202
query59	4077	3724	4145	3724
query60	232	201	200	200
query61	99	99	97	97
query62	808	468	475	468
query63	485	334	334	334
query64	2617	1550	1415	1415
query65	3619	3575	3563	3563
query66	771	382	377	377
query67	15975	17889	17222	17222
query68	8333	654	647	647
query69	574	351	352	351
query70	1692	1309	1541	1309
query71	423	303	317	303
query72	6530	3487	3475	3475
query73	736	322	323	322
query74	6270	5831	5803	5803
query75	4514	3698	3603	3603
query76	4729	1170	1153	1153
query77	608	262	250	250
query78	12861	11740	17048	11740
query79	6342	631	646	631
query80	1651	397	402	397
query81	519	240	232	232
query82	264	97	103	97
query83	187	142	132	132
query84	264	73	70	70
query85	1397	330	327	327
query86	371	301	289	289
query87	3182	3006	2989	2989
query88	4397	2339	2346	2339
query89	347	284	287	284
query90	1762	209	202	202
query91	171	140	139	139
query92	59	56	53	53
query93	908	557	535	535
query94	908	216	214	214
query95	1100	1064	1051	1051
query96	640	331	332	331
query97	6425	6399	6495	6399
query98	196	174	181	174
query99	2727	824	825	824
Total cold run time: 303724 ms
Total hot run time: 204825 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.9 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cd937dc750e6719705881c132e8012dca399cd76, data reload: false

query1	0.03	0.02	0.02
query2	0.07	0.03	0.02
query3	0.25	0.04	0.04
query4	1.79	0.08	0.06
query5	0.55	0.52	0.52
query6	1.24	0.62	0.61
query7	0.02	0.01	0.01
query8	0.03	0.03	0.03
query9	0.52	0.50	0.49
query10	0.54	0.54	0.53
query11	0.12	0.09	0.09
query12	0.11	0.09	0.09
query13	0.62	0.62	0.60
query14	0.78	0.77	0.79
query15	0.78	0.76	0.77
query16	0.36	0.37	0.39
query17	1.01	1.00	1.01
query18	0.20	0.26	0.25
query19	1.94	1.84	1.76
query20	0.01	0.00	0.00
query21	15.48	0.57	0.55
query22	2.28	2.34	1.93
query23	17.26	0.99	0.98
query24	4.69	0.89	3.94
query25	0.40	0.16	0.05
query26	0.67	0.16	0.14
query27	0.04	0.04	0.04
query28	5.68	0.76	0.75
query29	12.62	2.17	2.30
query30	0.60	0.53	0.54
query31	2.82	0.39	0.37
query32	3.37	0.49	0.50
query33	3.11	3.07	3.07
query34	15.26	4.80	4.81
query35	4.84	4.85	4.86
query36	1.07	1.02	1.02
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.14	0.14
query41	0.07	0.01	0.01
query42	0.02	0.02	0.01
query43	0.02	0.02	0.02
Total cold run time: 101.55 s
Total hot run time: 30.9 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit cd937dc750e6719705881c132e8012dca399cd76 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.2 seconds inserted 10000000 Rows, about 471K ops/s

@dataroaring dataroaring merged commit 4727338 into apache:branch-2.0 May 29, 2024
@w41ter w41ter deleted the pick/35245 branch May 29, 2024 06:06
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Cherry-pick apache#35245

Co-authored-by: Yongqiang YANG <98214048+dataroaring@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants