Skip to content

Conversation

@xy720
Copy link
Member

@xy720 xy720 commented May 15, 2024

Proposed changes

Issue Number: close #xxx

cherry-pick: #25654

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@xy720
Copy link
Member Author

xy720 commented May 15, 2024

run buildall

@github-actions github-actions bot added area/planner Issues or PRs related to the query planner kind/test labels May 15, 2024
@xy720
Copy link
Member Author

xy720 commented May 15, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49860 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d363e784b187df9d001d958adc9c9da6d9c99acc, data reload: false

------ Round 1 ----------------------------------
q1	17804	4440	4351	4351
q2	2033	152	146	146
q3	10449	1902	1927	1902
q4	10323	1229	1344	1229
q5	8557	3897	3944	3897
q6	241	123	125	123
q7	2033	1619	1610	1610
q8	9307	2750	2741	2741
q9	10705	10338	10285	10285
q10	8667	3500	3575	3500
q11	424	232	244	232
q12	468	303	308	303
q13	18352	3967	4062	3967
q14	360	323	318	318
q15	510	476	447	447
q16	676	570	574	570
q17	1147	984	1009	984
q18	7451	6894	6934	6894
q19	1699	1567	1530	1530
q20	534	308	306	306
q21	4500	4166	4134	4134
q22	502	395	391	391
Total cold run time: 116742 ms
Total hot run time: 49860 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4333	4305	4299	4299
q2	324	225	230	225
q3	4184	4152	4171	4152
q4	2764	2742	2747	2742
q5	7220	7153	7151	7151
q6	239	122	120	120
q7	3259	2855	2935	2855
q8	4426	4488	4486	4486
q9	16842	16953	16824	16824
q10	4223	4271	4295	4271
q11	769	682	686	682
q12	1023	852	864	852
q13	6859	3785	3790	3785
q14	457	439	432	432
q15	505	468	446	446
q16	742	684	675	675
q17	3816	3836	3867	3836
q18	8925	8825	8779	8779
q19	1727	1698	1654	1654
q20	2355	2154	2107	2107
q21	8482	8588	8626	8588
q22	1020	924	929	924
Total cold run time: 84494 ms
Total hot run time: 79885 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 202373 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d363e784b187df9d001d958adc9c9da6d9c99acc, data reload: false

query1	954	391	378	378
query2	6520	2884	2528	2528
query3	6924	209	208	208
query4	21069	17969	18004	17969
query5	19732	6489	6451	6451
query6	299	220	224	220
query7	4328	304	311	304
query8	268	255	228	228
query9	3166	2755	2662	2662
query10	430	297	305	297
query11	11314	10693	10781	10693
query12	120	80	70	70
query13	5578	693	679	679
query14	18238	13490	13450	13450
query15	365	221	226	221
query16	6433	273	254	254
query17	1535	1452	881	881
query18	2278	407	406	406
query19	199	148	154	148
query20	79	78	83	78
query21	189	91	98	91
query22	5255	5149	5089	5089
query23	32376	31865	31894	31865
query24	6818	6562	6503	6503
query25	520	426	428	426
query26	528	165	163	163
query27	1802	296	294	294
query28	6165	2380	2338	2338
query29	2843	2757	2766	2757
query30	239	166	163	163
query31	914	708	716	708
query32	65	64	58	58
query33	390	255	254	254
query34	859	482	482	482
query35	1120	887	894	887
query36	1344	1117	1245	1117
query37	93	58	61	58
query38	3071	2912	2904	2904
query39	1372	1327	1320	1320
query40	212	93	92	92
query41	38	36	35	35
query42	85	83	88	83
query43	751	685	820	685
query44	1123	706	728	706
query45	243	233	229	229
query46	1208	963	953	953
query47	1762	1723	1689	1689
query48	984	711	719	711
query49	617	367	364	364
query50	852	609	614	609
query51	4790	4707	4670	4670
query52	90	81	82	81
query53	440	316	315	315
query54	2637	2455	2489	2455
query55	94	81	87	81
query56	228	232	204	204
query57	1239	1146	1028	1028
query58	214	223	176	176
query59	4166	3902	4026	3902
query60	219	181	197	181
query61	89	81	83	81
query62	808	465	455	455
query63	477	335	339	335
query64	2445	1516	1314	1314
query65	3636	3549	3561	3549
query66	764	379	378	378
query67	16111	15341	14937	14937
query68	8515	651	668	651
query69	572	337	331	331
query70	1529	1385	1356	1356
query71	405	314	303	303
query72	6449	3433	3399	3399
query73	728	339	325	325
query74	6379	5852	5843	5843
query75	4517	3737	3724	3724
query76	4706	1150	1190	1150
query77	623	251	260	251
query78	12540	11456	11597	11456
query79	8780	639	657	639
query80	1377	387	392	387
query81	484	245	231	231
query82	1725	95	98	95
query83	176	136	127	127
query84	249	69	68	68
query85	992	305	315	305
query86	333	287	309	287
query87	3192	2998	3032	2998
query88	5099	2364	2365	2364
query89	381	277	297	277
query90	1861	221	212	212
query91	172	132	144	132
query92	60	59	54	54
query93	5364	582	571	571
query94	790	205	209	205
query95	1128	1068	1062	1062
query96	649	341	335	335
query97	6495	6358	6337	6337
query98	196	177	179	177
query99	2935	821	923	821
Total cold run time: 311515 ms
Total hot run time: 202373 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.78% (8073/21367)
Line Coverage: 29.44% (65910/223879)
Region Coverage: 28.91% (33928/117363)
Branch Coverage: 24.77% (17411/70300)
Coverage Report: http://coverage.selectdb-in.cc/coverage/d363e784b187df9d001d958adc9c9da6d9c99acc_d363e784b187df9d001d958adc9c9da6d9c99acc/report/index.html

@doris-robot
Copy link

ClickBench: Total hot run time: 30.96 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d363e784b187df9d001d958adc9c9da6d9c99acc, data reload: false

query1	0.02	0.03	0.02
query2	0.08	0.02	0.02
query3	0.24	0.05	0.05
query4	1.80	0.07	0.07
query5	0.54	0.54	0.53
query6	1.23	0.62	0.67
query7	0.01	0.02	0.01
query8	0.04	0.03	0.02
query9	0.52	0.48	0.48
query10	0.54	0.54	0.53
query11	0.11	0.08	0.09
query12	0.12	0.09	0.10
query13	0.61	0.62	0.62
query14	0.79	0.78	0.79
query15	0.78	0.77	0.77
query16	0.36	0.39	0.38
query17	1.01	0.97	0.99
query18	0.22	0.27	0.24
query19	1.91	1.84	1.82
query20	0.01	0.00	0.00
query21	15.45	0.55	0.55
query22	2.54	1.90	1.82
query23	17.64	1.02	1.00
query24	6.34	1.03	0.92
query25	0.39	0.07	0.07
query26	0.66	0.15	0.16
query27	0.04	0.04	0.05
query28	6.89	0.73	0.78
query29	12.65	2.25	2.32
query30	0.56	0.54	0.57
query31	2.80	0.38	0.37
query32	3.38	0.49	0.48
query33	3.09	3.07	3.11
query34	15.23	4.78	4.79
query35	4.86	4.88	4.82
query36	1.04	1.02	1.02
query37	0.07	0.04	0.04
query38	0.03	0.02	0.02
query39	0.02	0.02	0.01
query40	0.16	0.13	0.14
query41	0.06	0.02	0.01
query42	0.02	0.02	0.02
query43	0.02	0.02	0.02
Total cold run time: 104.88 s
Total hot run time: 30.96 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit d363e784b187df9d001d958adc9c9da6d9c99acc with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.2 seconds inserted 10000000 Rows, about 471K ops/s

Copy link
Contributor

@cambyzju cambyzju left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label May 16, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

Copy link
Contributor

@lide-reed lide-reed left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@lide-reed lide-reed merged commit 7103872 into apache:branch-2.0 May 16, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. area/planner Issues or PRs related to the query planner kind/test reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants