Skip to content

Conversation

@w41ter
Copy link
Contributor

@w41ter w41ter commented May 29, 2024

Cherry-pick #35206

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@w41ter
Copy link
Contributor Author

w41ter commented May 29, 2024

run buildall

…rflow

Cherry-pick apache#35206

Co-authored-by: Luennng <luennng@gmail.com>
@w41ter
Copy link
Contributor Author

w41ter commented May 29, 2024

run buildall

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.81% (8099/21420)
Line Coverage: 29.46% (66118/224412)
Region Coverage: 28.96% (34089/117717)
Branch Coverage: 24.81% (17497/70520)
Coverage Report: http://coverage.selectdb-in.cc/coverage/e769b9d08b0a98f6839171803385f18f57e139a7_e769b9d08b0a98f6839171803385f18f57e139a7/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 49785 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e769b9d08b0a98f6839171803385f18f57e139a7, data reload: false

------ Round 1 ----------------------------------
q1	17752	4446	4381	4381
q2	2032	185	151	151
q3	10413	1869	1960	1869
q4	10335	1275	1311	1275
q5	8416	3940	3958	3940
q6	232	126	126	126
q7	2088	1593	1598	1593
q8	9507	2762	2713	2713
q9	13243	10233	10153	10153
q10	8665	3529	3542	3529
q11	428	243	241	241
q12	479	305	302	302
q13	18374	3989	4031	3989
q14	361	322	322	322
q15	508	467	468	467
q16	664	573	585	573
q17	1129	987	969	969
q18	7219	6873	6896	6873
q19	1685	1551	1522	1522
q20	561	333	316	316
q21	4463	4173	4093	4093
q22	503	399	388	388
Total cold run time: 119057 ms
Total hot run time: 49785 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4329	4332	4288	4288
q2	326	226	230	226
q3	4164	4166	4151	4151
q4	2776	2741	2754	2741
q5	7148	7137	7178	7137
q6	237	123	121	121
q7	3260	2841	2841	2841
q8	4373	4457	4494	4457
q9	16956	16774	16677	16677
q10	4233	4284	4292	4284
q11	748	703	695	695
q12	1026	862	858	858
q13	6585	3747	3721	3721
q14	451	429	431	429
q15	513	461	452	452
q16	739	683	677	677
q17	3888	3816	3881	3816
q18	8824	8716	8886	8716
q19	1739	1661	1663	1661
q20	2400	2127	2101	2101
q21	8455	8518	8410	8410
q22	1068	915	943	915
Total cold run time: 84238 ms
Total hot run time: 79374 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203587 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e769b9d08b0a98f6839171803385f18f57e139a7, data reload: false

query1	922	395	379	379
query2	6579	2873	2785	2785
query3	6924	211	209	209
query4	19901	17959	18099	17959
query5	19737	6518	6510	6510
query6	287	220	231	220
query7	4156	293	301	293
query8	251	248	242	242
query9	3142	2717	2641	2641
query10	416	300	290	290
query11	11367	10690	10782	10690
query12	123	78	76	76
query13	5581	683	709	683
query14	17872	13205	13361	13205
query15	364	229	236	229
query16	6458	288	262	262
query17	1711	1454	859	859
query18	2321	409	403	403
query19	202	148	150	148
query20	80	81	80	80
query21	192	95	102	95
query22	5159	5058	4973	4973
query23	32435	31736	31749	31736
query24	6994	6502	6509	6502
query25	512	459	421	421
query26	610	159	158	158
query27	2000	292	292	292
query28	6125	2370	2348	2348
query29	2965	2722	2845	2722
query30	247	168	172	168
query31	893	733	769	733
query32	73	64	59	59
query33	398	263	246	246
query34	851	480	472	472
query35	1121	947	904	904
query36	1241	1179	1354	1179
query37	88	64	58	58
query38	3061	2910	2907	2907
query39	1382	1348	1322	1322
query40	205	94	92	92
query41	42	37	37	37
query42	85	86	88	86
query43	809	716	819	716
query44	1131	718	714	714
query45	245	241	229	229
query46	1228	998	966	966
query47	1834	1783	1780	1780
query48	1001	713	702	702
query49	623	384	367	367
query50	868	606	575	575
query51	4716	4611	4631	4611
query52	89	79	78	78
query53	455	312	317	312
query54	2631	2448	2476	2448
query55	91	90	83	83
query56	235	204	202	202
query57	1202	1209	1109	1109
query58	220	203	196	196
query59	4171	4065	3847	3847
query60	231	207	196	196
query61	99	95	118	95
query62	811	484	479	479
query63	484	341	329	329
query64	2586	1555	1493	1493
query65	3668	3553	3524	3524
query66	786	377	382	377
query67	15556	15741	17520	15741
query68	8585	652	647	647
query69	576	353	378	353
query70	1533	1385	1579	1385
query71	412	299	318	299
query72	6576	3519	3487	3487
query73	731	334	327	327
query74	6363	5824	5823	5823
query75	4694	3639	3638	3638
query76	4929	1122	1179	1122
query77	701	275	259	259
query78	12572	11596	13046	11596
query79	11388	654	635	635
query80	1827	404	404	404
query81	515	235	228	228
query82	1431	103	102	102
query83	172	134	130	130
query84	258	72	72	72
query85	1152	334	328	328
query86	343	320	294	294
query87	3196	3019	3013	3013
query88	5026	2363	2337	2337
query89	487	293	297	293
query90	1793	208	213	208
query91	174	138	139	138
query92	61	58	57	57
query93	6058	619	563	563
query94	763	211	208	208
query95	1088	1096	1062	1062
query96	653	332	334	332
query97	6449	6311	6329	6311
query98	197	175	178	175
query99	2660	919	1105	919
Total cold run time: 314206 ms
Total hot run time: 203587 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.98 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e769b9d08b0a98f6839171803385f18f57e139a7, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.02
query3	0.25	0.05	0.05
query4	1.80	0.07	0.08
query5	0.53	0.52	0.53
query6	1.23	0.61	0.61
query7	0.01	0.02	0.01
query8	0.03	0.02	0.02
query9	0.52	0.51	0.48
query10	0.54	0.51	0.54
query11	0.13	0.09	0.09
query12	0.12	0.09	0.10
query13	0.63	0.61	0.60
query14	0.77	0.78	0.78
query15	0.77	0.76	0.78
query16	0.39	0.39	0.38
query17	1.00	1.00	1.01
query18	0.24	0.25	0.25
query19	1.89	1.80	1.90
query20	0.02	0.01	0.01
query21	15.46	0.55	0.55
query22	1.97	2.56	1.96
query23	17.16	1.02	0.94
query24	5.75	1.00	0.77
query25	0.40	0.08	0.05
query26	0.54	0.16	0.16
query27	0.05	0.04	0.04
query28	7.64	0.75	0.76
query29	12.60	2.33	2.36
query30	0.68	0.56	0.57
query31	2.81	0.39	0.37
query32	3.37	0.50	0.50
query33	3.07	3.06	3.06
query34	15.25	4.77	4.78
query35	4.88	4.87	4.85
query36	1.06	1.04	1.00
query37	0.06	0.05	0.04
query38	0.04	0.02	0.02
query39	0.02	0.02	0.01
query40	0.16	0.14	0.14
query41	0.06	0.02	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 104.03 s
Total hot run time: 30.98 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit e769b9d08b0a98f6839171803385f18f57e139a7 with default session variables
Stream load json:         21 seconds loaded 2358488459 Bytes, about 107 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       24.3 seconds inserted 10000000 Rows, about 411K ops/s

@w41ter
Copy link
Contributor Author

w41ter commented May 30, 2024

run buildall

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.82% (8101/21420)
Line Coverage: 29.47% (66134/224412)
Region Coverage: 28.96% (34095/117717)
Branch Coverage: 24.81% (17497/70518)
Coverage Report: http://coverage.selectdb-in.cc/coverage/43c05002fc7b62ec63e173a7916a880e3ac2e894_43c05002fc7b62ec63e173a7916a880e3ac2e894/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 49903 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 43c05002fc7b62ec63e173a7916a880e3ac2e894, data reload: false

------ Round 1 ----------------------------------
q1	17861	4360	4376	4360
q2	2055	166	175	166
q3	10420	1906	1972	1906
q4	10323	1266	1319	1266
q5	8653	3905	3880	3880
q6	235	124	124	124
q7	2058	1608	1608	1608
q8	9347	2768	2725	2725
q9	10667	10367	10291	10291
q10	8648	3530	3532	3530
q11	421	236	251	236
q12	468	301	301	301
q13	18329	3972	4026	3972
q14	358	329	335	329
q15	513	456	458	456
q16	686	573	562	562
q17	1147	976	971	971
q18	7374	6974	6957	6957
q19	1750	1593	1493	1493
q20	532	297	329	297
q21	4437	4085	4119	4085
q22	500	388	396	388
Total cold run time: 116782 ms
Total hot run time: 49903 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4373	4490	4293	4293
q2	317	217	222	217
q3	4147	4136	4148	4136
q4	2752	2760	2744	2744
q5	7098	7174	7115	7115
q6	240	119	118	118
q7	3203	2823	2843	2823
q8	4306	4420	4440	4420
q9	16837	16764	16739	16739
q10	4215	4268	4286	4268
q11	750	705	688	688
q12	1039	850	852	850
q13	6880	3731	3716	3716
q14	465	424	421	421
q15	523	466	455	455
q16	743	686	691	686
q17	3720	3856	3850	3850
q18	8760	8732	8810	8732
q19	1715	1679	1639	1639
q20	2374	2108	2111	2108
q21	8462	8411	8448	8411
q22	1023	930	945	930
Total cold run time: 83942 ms
Total hot run time: 79359 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203126 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 43c05002fc7b62ec63e173a7916a880e3ac2e894, data reload: false

query1	920	389	377	377
query2	6576	2816	2536	2536
query3	6922	209	212	209
query4	20624	18064	18131	18064
query5	19726	6524	6528	6524
query6	284	215	226	215
query7	4162	297	306	297
query8	248	235	238	235
query9	3119	2692	2639	2639
query10	413	299	307	299
query11	11238	10617	10529	10529
query12	124	78	75	75
query13	5592	692	686	686
query14	17702	13291	13645	13291
query15	366	231	229	229
query16	6483	284	260	260
query17	1765	1438	891	891
query18	2315	414	414	414
query19	206	142	153	142
query20	81	75	81	75
query21	197	98	98	98
query22	5171	4919	4983	4919
query23	32754	31882	31870	31870
query24	7013	6634	6771	6634
query25	539	429	410	410
query26	530	162	162	162
query27	1876	297	293	293
query28	6135	2339	2329	2329
query29	2791	2799	2677	2677
query30	259	166	165	165
query31	905	716	759	716
query32	71	65	67	65
query33	405	272	268	268
query34	843	464	467	464
query35	1115	899	929	899
query36	1167	1138	1138	1138
query37	93	63	64	63
query38	3057	2983	2907	2907
query39	1364	1331	1325	1325
query40	208	100	92	92
query41	39	38	37	37
query42	85	91	79	79
query43	786	803	654	654
query44	1140	717	722	717
query45	250	233	233	233
query46	1228	949	966	949
query47	1756	1822	1843	1822
query48	996	715	714	714
query49	625	373	363	363
query50	864	587	596	587
query51	4801	4624	4677	4624
query52	99	86	78	78
query53	448	334	319	319
query54	2670	2456	2477	2456
query55	85	83	85	83
query56	246	233	219	219
query57	1217	1090	1099	1090
query58	213	206	204	204
query59	4193	4048	3923	3923
query60	213	205	228	205
query61	97	95	101	95
query62	788	489	468	468
query63	482	345	342	342
query64	2355	1503	1449	1449
query65	3611	3613	3578	3578
query66	794	380	370	370
query67	15828	16989	15339	15339
query68	9237	686	686	686
query69	571	333	354	333
query70	1856	1366	1352	1352
query71	423	306	324	306
query72	6499	3483	3502	3483
query73	736	324	332	324
query74	6318	5827	5825	5825
query75	5453	3709	3666	3666
query76	5617	1114	1184	1114
query77	969	263	252	252
query78	12620	11570	11838	11570
query79	9031	662	646	646
query80	1198	395	403	395
query81	487	229	229	229
query82	1633	99	98	98
query83	163	134	128	128
query84	256	72	71	71
query85	869	318	318	318
query86	339	284	328	284
query87	3256	2990	3005	2990
query88	4680	2391	2376	2376
query89	483	335	277	277
query90	1994	205	218	205
query91	173	143	139	139
query92	57	52	54	52
query93	7144	633	562	562
query94	713	211	206	206
query95	1113	1061	1071	1061
query96	647	334	336	334
query97	6483	6374	6314	6314
query98	189	177	157	157
query99	3105	997	895	895
Total cold run time: 315580 ms
Total hot run time: 203126 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.9 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 43c05002fc7b62ec63e173a7916a880e3ac2e894, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.02
query3	0.25	0.04	0.05
query4	1.81	0.07	0.07
query5	0.53	0.52	0.53
query6	1.29	0.62	0.61
query7	0.01	0.02	0.01
query8	0.04	0.02	0.02
query9	0.53	0.50	0.48
query10	0.54	0.54	0.51
query11	0.12	0.08	0.08
query12	0.12	0.09	0.09
query13	0.62	0.62	0.61
query14	0.79	0.78	0.78
query15	0.76	0.77	0.75
query16	0.36	0.37	0.39
query17	1.02	1.01	1.03
query18	0.20	0.27	0.24
query19	1.94	1.85	1.85
query20	0.01	0.01	0.01
query21	15.45	0.55	0.56
query22	2.07	2.28	1.62
query23	17.19	0.86	0.84
query24	5.30	1.28	1.45
query25	0.37	0.05	0.06
query26	0.70	0.15	0.15
query27	0.04	0.05	0.03
query28	7.15	0.80	0.78
query29	12.60	2.27	2.22
query30	0.60	0.51	0.50
query31	2.81	0.38	0.37
query32	3.38	0.51	0.50
query33	3.03	3.06	3.05
query34	15.24	4.78	4.80
query35	4.84	4.84	4.83
query36	1.09	1.01	1.01
query37	0.06	0.05	0.04
query38	0.03	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.15	0.14
query41	0.06	0.01	0.01
query42	0.02	0.02	0.01
query43	0.02	0.02	0.02
Total cold run time: 103.26 s
Total hot run time: 30.9 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 43c05002fc7b62ec63e173a7916a880e3ac2e894 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.2 seconds inserted 10000000 Rows, about 471K ops/s

@xiaokang xiaokang merged commit 8321a3f into apache:branch-2.0 May 30, 2024
@w41ter w41ter deleted the pick/35206 branch May 30, 2024 06:17
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants