Skip to content

Conversation

@mrhhsg
Copy link
Member

@mrhhsg mrhhsg commented Feb 18, 2024

Proposed changes

pick #30990 from master

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

@mrhhsg
Copy link
Member Author

mrhhsg commented Feb 18, 2024

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 49826 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3b4ffe34b05e9fd3d2a599c5b2f071ad328cd0b2, data reload: false

------ Round 1 ----------------------------------
q1	17729	4404	4357	4357
q2	2050	151	142	142
q3	10483	1895	1899	1895
q4	10318	1238	1329	1238
q5	8364	4053	3924	3924
q6	229	119	118	118
q7	2029	1633	1588	1588
q8	9519	2695	2697	2695
q9	13198	10713	10376	10376
q10	8630	3508	3469	3469
q11	414	236	233	233
q12	455	297	302	297
q13	18361	4009	4057	4009
q14	347	315	315	315
q15	505	464	468	464
q16	701	600	599	599
q17	1125	963	955	955
q18	7197	6783	6911	6783
q19	1664	1578	1518	1518
q20	527	330	299	299
q21	4469	4187	4138	4138
q22	513	419	414	414
Total cold run time: 118827 ms
Total hot run time: 49826 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4438	4463	4451	4451
q2	325	223	226	223
q3	4169	4143	4134	4134
q4	2742	2760	2749	2749
q5	7222	7163	7146	7146
q6	232	120	116	116
q7	3235	2824	2832	2824
q8	4349	4477	4488	4477
q9	17001	16971	17034	16971
q10	4244	4261	4292	4261
q11	770	688	675	675
q12	1026	863	850	850
q13	6767	3779	3775	3775
q14	463	429	413	413
q15	495	464	462	462
q16	765	710	705	705
q17	3846	3915	3848	3848
q18	8846	8819	8826	8819
q19	1734	1691	1652	1652
q20	2380	2158	2138	2138
q21	8460	8941	8846	8846
q22	1134	1020	1071	1020
Total cold run time: 84643 ms
Total hot run time: 80555 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.83% (8035/21240)
Line Coverage: 29.49% (65504/222118)
Region Coverage: 28.96% (33705/116376)
Branch Coverage: 24.82% (17303/69716)
Coverage Report: http://coverage.selectdb-in.cc/coverage/3b4ffe34b05e9fd3d2a599c5b2f071ad328cd0b2_3b4ffe34b05e9fd3d2a599c5b2f071ad328cd0b2/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 242975 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3b4ffe34b05e9fd3d2a599c5b2f071ad328cd0b2, data reload: false

query1	2758	386	392	386
query2	8162	2348	2202	2202
query3	6916	205	201	201
query4	20060	18007	18063	18007
query5	19708	6511	6507	6507
query6	413	215	237	215
query7	5095	314	296	296
query8	251	247	229	229
query9	3076	2670	2622	2622
query10	425	280	301	280
query11	11415	10640	10728	10640
query12	124	72	73	72
query13	5595	635	624	624
query14	19251	13566	13548	13548
query15	365	234	231	231
query16	6404	271	277	271
query17	1361	1489	850	850
query18	2297	395	407	395
query19	201	143	144	143
query20	75	74	74	74
query21	190	93	93	93
query22	5305	5218	5082	5082
query23	32701	31997	31915	31915
query24	6778	6529	6449	6449
query25	512	422	428	422
query26	460	160	159	159
query27	1171	296	290	290
query28	4100	2243	2227	2227
query29	2934	2726	2778	2726
query30	238	158	158	158
query31	872	709	747	709
query32	64	56	56	56
query33	328	237	247	237
query34	848	455	468	455
query35	1009	931	885	885
query36	1505	1462	1528	1462
query37	86	59	58	58
query38	3091	2920	2895	2895
query39	1365	1317	1313	1313
query40	200	95	92	92
query41	36	36	31	31
query42	88	87	87	87
query43	634	594	570	570
query44	1071	709	702	702
query45	242	226	226	226
query46	1235	961	960	960
query47	1851	1767	1654	1654
query48	972	685	648	648
query49	597	387	364	364
query50	862	618	640	618
query51	5532	5409	5420	5409
query52	86	90	76	76
query53	449	319	318	318
query54	2625	2476	2471	2471
query55	92	83	83	83
query56	226	207	209	207
query57	1166	1123	1138	1123
query58	206	206	186	186
query59	3439	3116	3156	3116
query60	211	189	183	183
query61	79	81	79	79
query62	806	462	472	462
query63	479	339	331	331
query64	2148	1487	1340	1340
query65	3606	3540	3549	3540
query66	755	367	365	365
query67	16682	15915	15245	15245
query68	7041	657	663	657
query69	560	364	348	348
query70	1900	1683	1814	1683
query71	400	296	298	296
query72	6416	3347	3411	3347
query73	731	320	317	317
query74	6317	5847	5820	5820
query75	4534	3599	3718	3599
query76	4365	1152	1216	1152
query77	533	245	245	245
query78	32131	51846	55158	51846
query79	15888	668	641	641
query80	5192	373	378	373
query81	561	235	232	232
query82	1665	96	95	95
query83	328	139	134	134
query84	256	69	66	66
query85	1974	284	273	273
query86	483	370	374	370
query87	3280	3003	3027	3003
query88	7204	2336	2344	2336
query89	473	299	287	287
query90	2508	205	205	205
query91	161	122	118	118
query92	65	57	51	51
query93	6326	601	603	601
query94	1853	204	205	204
query95	1128	1080	1062	1062
query96	651	326	326	326
query97	6477	6387	6386	6386
query98	188	175	166	166
query99	3858	866	888	866
Total cold run time: 349331 ms
Total hot run time: 242975 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.18 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3b4ffe34b05e9fd3d2a599c5b2f071ad328cd0b2, data reload: false

query1	0.02	0.03	0.02
query2	0.06	0.02	0.02
query3	0.24	0.04	0.05
query4	1.84	0.08	0.07
query5	0.53	0.52	0.52
query6	1.24	0.63	0.65
query7	0.01	0.00	0.01
query8	0.03	0.02	0.02
query9	0.53	0.48	0.48
query10	0.54	0.51	0.52
query11	0.12	0.09	0.08
query12	0.10	0.09	0.08
query13	0.61	0.61	0.61
query14	0.78	0.79	0.79
query15	0.77	0.76	0.75
query16	0.39	0.38	0.37
query17	1.00	1.01	0.99
query18	0.22	0.28	0.25
query19	1.91	1.84	1.79
query20	0.01	0.01	0.01
query21	15.48	0.58	0.58
query22	2.14	2.88	2.07
query23	17.55	0.78	0.93
query24	5.10	1.01	2.81
query25	1.51	0.12	0.12
query26	0.30	0.14	0.15
query27	0.11	0.11	0.10
query28	7.27	0.72	0.71
query29	12.61	2.36	2.32
query30	0.61	0.51	0.51
query31	2.81	0.39	0.38
query32	3.43	0.49	0.49
query33	3.04	3.07	3.07
query34	15.24	4.80	4.79
query35	4.86	4.83	4.83
query36	1.06	1.00	1.02
query37	0.06	0.04	0.05
query38	0.03	0.02	0.03
query39	0.02	0.01	0.02
query40	0.17	0.14	0.14
query41	0.06	0.02	0.01
query42	0.02	0.01	0.01
query43	0.02	0.02	0.02
Total cold run time: 104.45 s
Total hot run time: 31.18 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 3b4ffe34b05e9fd3d2a599c5b2f071ad328cd0b2 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s

@yiguolei yiguolei merged commit 61a5827 into apache:branch-2.0 Feb 18, 2024
@mrhhsg mrhhsg deleted the pick_30990 branch February 18, 2024 06:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants