Skip to content

Conversation

@AshinGau
Copy link
Member

Proposed changes

backport: #31128

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

@AshinGau
Copy link
Member Author

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 49676 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bf65aab4d912ce7377cf10f28976a2e5477fe899, data reload: false

------ Round 1 ----------------------------------
q1	18279	4372	4309	4309
q2	2035	152	142	142
q3	10414	1853	1899	1853
q4	10305	1241	1335	1241
q5	8451	3922	3972	3922
q6	230	121	120	120
q7	2065	1556	1605	1556
q8	9506	2692	2704	2692
q9	13401	10552	10318	10318
q10	8635	3488	3500	3488
q11	423	230	238	230
q12	465	301	305	301
q13	18376	4044	4129	4044
q14	352	331	325	325
q15	516	458	466	458
q16	712	619	611	611
q17	1130	970	966	966
q18	7271	6911	6788	6788
q19	1699	1582	1536	1536
q20	552	289	296	289
q21	4454	4125	4092	4092
q22	503	395	396	395
Total cold run time: 119774 ms
Total hot run time: 49676 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4365	4345	4287	4287
q2	315	220	222	220
q3	4114	4121	4151	4121
q4	2735	2761	2749	2749
q5	7239	7137	7157	7137
q6	233	118	116	116
q7	3210	2845	2797	2797
q8	4367	4480	4463	4463
q9	17141	16843	17091	16843
q10	4231	4241	4326	4241
q11	733	685	678	678
q12	1025	859	860	859
q13	6638	3796	3752	3752
q14	453	426	433	426
q15	506	465	458	458
q16	767	713	699	699
q17	3907	3890	3837	3837
q18	8884	8850	8964	8850
q19	1706	1615	1618	1615
q20	2409	2164	2154	2154
q21	8563	8573	8764	8573
q22	1105	1022	1010	1010
Total cold run time: 84646 ms
Total hot run time: 79885 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.83% (8037/21247)
Line Coverage: 29.49% (65528/222169)
Region Coverage: 28.97% (33720/116414)
Branch Coverage: 24.82% (17306/69730)
Coverage Report: http://coverage.selectdb-in.cc/coverage/bf65aab4d912ce7377cf10f28976a2e5477fe899_bf65aab4d912ce7377cf10f28976a2e5477fe899/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 240592 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bf65aab4d912ce7377cf10f28976a2e5477fe899, data reload: false

query1	1929	395	397	395
query2	8944	2153	1914	1914
query3	8500	210	219	210
query4	22573	18058	17984	17984
query5	19716	6406	6514	6406
query6	412	207	229	207
query7	5125	295	290	290
query8	247	224	233	224
query9	3090	2682	2629	2629
query10	423	288	315	288
query11	11297	10695	10591	10591
query12	118	74	71	71
query13	5583	625	613	613
query14	18880	13643	13501	13501
query15	359	231	238	231
query16	6352	261	266	261
query17	1589	1427	860	860
query18	2333	400	389	389
query19	194	146	142	142
query20	76	84	76	76
query21	186	93	91	91
query22	5269	5162	4972	4972
query23	32403	31885	31866	31866
query24	6826	6549	6499	6499
query25	498	429	418	418
query26	524	157	151	151
query27	1834	290	288	288
query28	6094	2209	2179	2179
query29	2838	2712	2602	2602
query30	238	159	157	157
query31	918	695	720	695
query32	66	61	61	61
query33	399	231	253	231
query34	849	455	468	455
query35	1110	939	902	902
query36	1508	1535	1561	1535
query37	86	60	60	60
query38	3149	2911	2904	2904
query39	1367	1326	1320	1320
query40	200	90	91	90
query41	36	35	32	32
query42	87	84	87	84
query43	776	555	615	555
query44	1144	706	715	706
query45	243	226	225	225
query46	1245	990	968	968
query47	1783	1787	1681	1681
query48	991	695	668	668
query49	615	375	376	375
query50	862	564	612	564
query51	5548	5386	5480	5386
query52	90	83	79	79
query53	450	312	316	312
query54	2655	2475	2477	2475
query55	85	83	74	74
query56	217	215	199	199
query57	1144	1095	1186	1095
query58	206	200	201	200
query59	3450	3329	3126	3126
query60	216	201	204	201
query61	84	86	79	79
query62	898	512	470	470
query63	468	328	330	328
query64	2352	1469	1471	1469
query65	3625	3602	3571	3571
query66	746	362	365	362
query67	17696	18388	15320	15320
query68	6063	639	652	639
query69	558	352	355	352
query70	1679	1635	1895	1635
query71	417	302	307	302
query72	6375	3374	3359	3359
query73	733	313	316	313
query74	6338	5842	5871	5842
query75	4669	3697	3682	3682
query76	3734	1167	1163	1163
query77	549	259	274	259
query78	31434	51437	50033	50033
query79	15504	651	629	629
query80	4664	387	375	375
query81	561	228	229	228
query82	1349	93	92	92
query83	329	135	131	131
query84	255	67	69	67
query85	2035	281	271	271
query86	463	373	371	371
query87	3268	3001	3035	3001
query88	7193	2376	2326	2326
query89	454	293	277	277
query90	2520	199	200	199
query91	163	115	123	115
query92	61	49	54	49
query93	6354	556	570	556
query94	1672	209	200	200
query95	1119	1082	1049	1049
query96	630	325	315	315
query97	6457	6338	6413	6338
query98	189	176	173	173
query99	3658	889	912	889
Total cold run time: 353261 ms
Total hot run time: 240592 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.53 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bf65aab4d912ce7377cf10f28976a2e5477fe899, data reload: false

query1	0.03	0.02	0.02
query2	0.07	0.02	0.02
query3	0.25	0.04	0.05
query4	1.80	0.06	0.07
query5	0.54	0.52	0.53
query6	1.24	0.64	0.63
query7	0.01	0.01	0.01
query8	0.03	0.02	0.02
query9	0.52	0.48	0.48
query10	0.53	0.54	0.54
query11	0.12	0.09	0.08
query12	0.11	0.09	0.09
query13	0.61	0.61	0.62
query14	0.78	0.78	0.79
query15	0.79	0.77	0.76
query16	0.37	0.37	0.36
query17	1.02	0.97	1.00
query18	0.23	0.26	0.25
query19	1.90	1.86	1.85
query20	0.01	0.01	0.01
query21	15.46	0.55	0.55
query22	2.44	2.27	1.98
query23	17.45	0.95	1.05
query24	3.75	3.11	1.33
query25	1.58	0.11	0.11
query26	0.28	0.14	0.13
query27	0.11	0.11	0.12
query28	6.74	0.72	0.70
query29	12.59	2.18	2.34
query30	0.57	0.52	0.52
query31	2.80	0.37	0.38
query32	3.41	0.50	0.49
query33	3.09	3.08	3.08
query34	15.23	4.82	4.82
query35	4.87	4.86	4.85
query36	1.11	1.01	1.02
query37	0.06	0.05	0.05
query38	0.03	0.02	0.02
query39	0.02	0.01	0.01
query40	0.17	0.14	0.14
query41	0.06	0.02	0.01
query42	0.02	0.01	0.01
query43	0.02	0.02	0.01
Total cold run time: 102.82 s
Total hot run time: 31.53 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit bf65aab4d912ce7377cf10f28976a2e5477fe899 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s

@xiaokang xiaokang merged commit 1142806 into apache:branch-2.0 Feb 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants