Skip to content

Conversation

@xiaokang
Copy link
Contributor

Proposed changes

Issue Number: close #xxx

rollback some changes of #31003

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

@xiaokang
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 50332 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 38bf869765bd5a02c75d6d86efccb00fb3dc85e0, data reload: false

------ Round 1 ----------------------------------
q1	17527	4359	4320	4320
q2	2022	155	144	144
q3	10268	1914	1941	1914
q4	10094	1267	1304	1267
q5	8449	3944	3982	3944
q6	228	126	125	125
q7	2078	1591	1600	1591
q8	9320	2723	2716	2716
q9	10773	11177	10700	10700
q10	8641	3494	3535	3494
q11	418	243	241	241
q12	463	301	297	297
q13	18364	3970	4029	3970
q14	360	324	333	324
q15	515	454	456	454
q16	698	598	592	592
q17	1141	965	977	965
q18	7278	6986	6984	6984
q19	1677	1565	1501	1501
q20	490	299	329	299
q21	4439	4128	4089	4089
q22	507	405	401	401
Total cold run time: 115750 ms
Total hot run time: 50332 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4327	4307	4273	4273
q2	320	226	225	225
q3	4190	4171	4128	4128
q4	2756	2741	2775	2741
q5	7275	7226	7430	7226
q6	232	119	121	119
q7	3241	2847	2907	2847
q8	4349	4448	4484	4448
q9	17190	16979	16923	16923
q10	4229	4288	4283	4283
q11	764	697	681	681
q12	1028	859	853	853
q13	5375	3755	3738	3738
q14	443	420	437	420
q15	499	460	453	453
q16	767	714	699	699
q17	3761	3830	3771	3771
q18	8813	8781	8884	8781
q19	1693	1724	1638	1638
q20	2364	2166	2091	2091
q21	8681	8520	8483	8483
q22	1079	946	939	939
Total cold run time: 83376 ms
Total hot run time: 79760 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 201277 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 38bf869765bd5a02c75d6d86efccb00fb3dc85e0, data reload: false

query1	914	388	381	381
query2	6516	2245	2010	2010
query3	6914	193	194	193
query4	21081	18140	17926	17926
query5	19737	6568	6506	6506
query6	288	215	229	215
query7	4148	307	315	307
query8	260	231	240	231
query9	3109	2682	2640	2640
query10	430	297	290	290
query11	11317	10713	10850	10713
query12	118	78	71	71
query13	5599	643	620	620
query14	18056	13314	13369	13314
query15	365	230	242	230
query16	6448	262	266	262
query17	1729	1447	866	866
query18	2298	408	409	408
query19	208	148	148	148
query20	79	76	75	75
query21	187	93	89	89
query22	5363	5168	5258	5168
query23	32742	31862	31917	31862
query24	6952	6539	6498	6498
query25	512	428	422	422
query26	521	171	161	161
query27	1889	296	301	296
query28	6158	2220	2194	2194
query29	2919	2658	2693	2658
query30	240	162	161	161
query31	883	736	739	736
query32	68	60	56	56
query33	409	254	261	254
query34	848	478	486	478
query35	1089	881	889	881
query36	1668	1658	1459	1459
query37	91	64	60	60
query38	3142	2916	2913	2913
query39	1370	1326	1312	1312
query40	205	102	99	99
query41	37	37	37	37
query42	92	80	84	80
query43	647	646	577	577
query44	1150	711	713	711
query45	237	227	232	227
query46	1222	994	992	992
query47	1888	2017	1673	1673
query48	969	690	657	657
query49	608	366	376	366
query50	873	708	634	634
query51	4766	4701	4611	4611
query52	91	84	75	75
query53	445	312	315	312
query54	2640	2452	2479	2452
query55	92	73	79	73
query56	222	196	225	196
query57	1164	1099	1060	1060
query58	221	207	198	198
query59	3333	3278	3243	3243
query60	215	199	201	199
query61	86	93	86	86
query62	834	523	636	523
query63	463	337	337	337
query64	2495	1510	1371	1371
query65	3642	3569	3597	3569
query66	795	358	372	358
query67	16476	15785	14782	14782
query68	9477	685	677	677
query69	570	346	344	344
query70	2036	1607	1655	1607
query71	410	311	320	311
query72	6402	3419	3419	3419
query73	735	315	322	315
query74	6332	5953	5760	5760
query75	5651	3830	3650	3650
query76	6021	1155	1221	1155
query77	982	247	246	246
query78	12489	11480	11675	11480
query79	6765	638	667	638
query80	1043	406	402	402
query81	506	237	233	233
query82	1489	100	97	97
query83	176	132	134	132
query84	255	68	68	68
query85	859	286	279	279
query86	400	371	383	371
query87	3245	3056	3010	3010
query88	4709	2311	2308	2308
query89	371	305	291	291
query90	1950	214	214	214
query91	155	116	116	116
query92	56	56	52	52
query93	5187	537	567	537
query94	694	199	210	199
query95	1140	1076	1049	1049
query96	637	330	319	319
query97	6487	6351	6451	6351
query98	191	177	174	174
query99	2888	918	911	911
Total cold run time: 312881 ms
Total hot run time: 201277 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.14 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 38bf869765bd5a02c75d6d86efccb00fb3dc85e0, data reload: false

query1	0.02	0.03	0.02
query2	0.05	0.02	0.02
query3	0.24	0.06	0.07
query4	1.80	0.11	0.11
query5	0.53	0.54	0.53
query6	1.29	0.67	0.62
query7	0.01	0.01	0.01
query8	0.03	0.02	0.03
query9	0.53	0.48	0.47
query10	0.54	0.54	0.55
query11	0.12	0.08	0.09
query12	0.11	0.09	0.10
query13	0.62	0.61	0.61
query14	0.79	0.77	0.81
query15	0.78	0.77	0.78
query16	0.36	0.35	0.37
query17	1.03	1.00	1.02
query18	0.23	0.25	0.24
query19	1.91	1.86	1.89
query20	0.01	0.01	0.01
query21	15.51	0.57	0.57
query22	1.96	1.80	1.22
query23	17.09	1.09	0.93
query24	3.66	4.01	1.64
query25	1.62	0.12	0.11
query26	0.36	0.15	0.14
query27	0.12	0.12	0.11
query28	5.71	0.80	0.71
query29	12.67	2.21	2.29
query30	0.54	0.53	0.51
query31	2.81	0.39	0.39
query32	3.39	0.49	0.50
query33	3.12	3.04	3.15
query34	15.24	4.82	4.78
query35	4.85	4.87	4.85
query36	1.06	1.01	1.02
query37	0.05	0.05	0.04
query38	0.03	0.03	0.02
query39	0.02	0.01	0.02
query40	0.16	0.13	0.14
query41	0.07	0.02	0.02
query42	0.02	0.01	0.01
query43	0.02	0.02	0.02
Total cold run time: 101.08 s
Total hot run time: 31.14 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 38bf869765bd5a02c75d6d86efccb00fb3dc85e0 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.2 seconds inserted 10000000 Rows, about 471K ops/s

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Feb 22, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@xiaokang xiaokang merged commit 6b1050a into apache:branch-2.0 Feb 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.0.5-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants