Skip to content

Conversation

@xiaokang
Copy link
Contributor

@xiaokang xiaokang commented Aug 2, 2024

related to #38176

comment out _s3_stats.*

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@xiaokang
Copy link
Contributor Author

xiaokang commented Aug 2, 2024

run p0 10

@github-actions
Copy link
Contributor

github-actions bot commented Aug 2, 2024

clang-tidy review says "All clean, LGTM! 👍"

@xiaokang
Copy link
Contributor Author

xiaokang commented Aug 2, 2024

run buildall

@github-actions
Copy link
Contributor

github-actions bot commented Aug 2, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.74% (8102/21466)
Line Coverage: 29.38% (66346/225835)
Region Coverage: 28.89% (34241/118516)
Branch Coverage: 24.78% (17595/71012)
Coverage Report: http://coverage.selectdb-in.cc/coverage/bff2a760314a6b9e90bf7b0024c861f94f760c94_bff2a760314a6b9e90bf7b0024c861f94f760c94/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 49661 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bff2a760314a6b9e90bf7b0024c861f94f760c94, data reload: false

------ Round 1 ----------------------------------
q1	17683	4403	4331	4331
q2	2042	158	153	153
q3	10261	1872	1918	1872
q4	10309	1231	1317	1231
q5	8492	3857	3881	3857
q6	226	123	147	123
q7	2008	1596	1617	1596
q8	9417	2718	2715	2715
q9	10860	10283	10224	10224
q10	8656	3522	3554	3522
q11	418	234	249	234
q12	471	304	296	296
q13	18383	3942	4051	3942
q14	354	321	323	321
q15	503	457	463	457
q16	675	572	568	568
q17	1124	979	971	971
q18	7311	6877	6915	6877
q19	1789	1689	1615	1615
q20	514	313	301	301
q21	4420	4020	4017	4017
q22	536	438	443	438
Total cold run time: 116452 ms
Total hot run time: 49661 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4322	4305	4290	4290
q2	328	226	220	220
q3	4209	4177	4114	4114
q4	2752	2759	2743	2743
q5	7208	7068	7068	7068
q6	236	117	117	117
q7	3244	2797	2846	2797
q8	4402	4425	4497	4425
q9	16977	16841	16721	16721
q10	4232	4235	4274	4235
q11	743	702	663	663
q12	1034	873	867	867
q13	6902	3745	3774	3745
q14	469	412	423	412
q15	492	455	452	452
q16	745	668	684	668
q17	3875	3809	3787	3787
q18	8826	8816	8775	8775
q19	1697	1709	1628	1628
q20	2522	2138	2132	2132
q21	8499	8419	8589	8419
q22	1067	1014	974	974
Total cold run time: 84781 ms
Total hot run time: 79252 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204866 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bff2a760314a6b9e90bf7b0024c861f94f760c94, data reload: false

query1	933	393	421	393
query2	6547	2946	2491	2491
query3	6988	221	212	212
query4	21942	18293	18200	18200
query5	19839	6627	6590	6590
query6	397	245	265	245
query7	4779	320	337	320
query8	455	466	461	461
query9	3134	2672	2637	2637
query10	438	316	331	316
query11	12447	11242	11230	11230
query12	125	75	75	75
query13	5974	718	699	699
query14	20885	13620	13308	13308
query15	368	257	249	249
query16	6420	285	262	262
query17	1626	1426	862	862
query18	2323	407	422	407
query19	204	148	148	148
query20	81	81	78	78
query21	195	98	98	98
query22	5356	5183	5096	5096
query23	32466	31796	31917	31796
query24	6835	6551	6528	6528
query25	523	439	428	428
query26	526	165	161	161
query27	1799	300	293	293
query28	6139	2335	2293	2293
query29	2850	2638	2668	2638
query30	237	170	167	167
query31	909	740	746	740
query32	65	64	59	59
query33	395	261	252	252
query34	869	471	478	471
query35	1095	927	892	892
query36	1432	1202	1193	1193
query37	90	64	60	60
query38	3104	2944	3002	2944
query39	1380	1337	1325	1325
query40	204	96	96	96
query41	47	46	44	44
query42	84	87	82	82
query43	780	720	657	657
query44	1132	705	705	705
query45	246	239	233	233
query46	1232	975	964	964
query47	1976	1905	1874	1874
query48	1019	709	701	701
query49	623	376	381	376
query50	862	640	565	565
query51	4738	4671	4675	4671
query52	96	76	81	76
query53	461	324	324	324
query54	2684	2459	2463	2459
query55	87	80	84	80
query56	225	213	218	213
query57	1251	1052	1101	1052
query58	223	206	200	200
query59	4219	4297	3909	3909
query60	216	195	200	195
query61	97	96	99	96
query62	845	469	454	454
query63	482	337	341	337
query64	2417	1511	1500	1500
query65	3622	3539	3556	3539
query66	775	374	366	366
query67	18231	17344	15253	15253
query68	6771	655	655	655
query69	590	375	341	341
query70	1520	1397	1425	1397
query71	425	305	310	305
query72	6592	3512	3515	3512
query73	758	322	314	314
query74	6382	5852	5897	5852
query75	4583	3746	3616	3616
query76	4397	1180	1210	1180
query77	564	251	251	251
query78	12726	12676	12000	12000
query79	9354	670	654	654
query80	832	411	406	406
query81	498	240	236	236
query82	1114	98	94	94
query83	165	128	135	128
query84	265	72	71	71
query85	759	345	327	327
query86	328	279	293	279
query87	3238	3048	3013	3013
query88	4987	2301	2312	2301
query89	420	288	291	288
query90	2094	219	210	210
query91	176	142	151	142
query92	61	53	53	53
query93	5641	564	590	564
query94	756	211	211	211
query95	1137	1063	1074	1063
query96	648	329	330	329
query97	6534	6386	6372	6372
query98	185	178	171	171
query99	2856	896	893	893
Total cold run time: 318400 ms
Total hot run time: 204866 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.92 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bff2a760314a6b9e90bf7b0024c861f94f760c94, data reload: false

query1	0.02	0.03	0.03
query2	0.08	0.02	0.03
query3	0.25	0.06	0.05
query4	1.77	0.06	0.05
query5	0.54	0.52	0.52
query6	1.24	0.61	0.61
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.53	0.49	0.48
query10	0.54	0.54	0.54
query11	0.12	0.09	0.08
query12	0.13	0.09	0.09
query13	0.63	0.62	0.60
query14	0.80	0.78	0.79
query15	0.79	0.76	0.75
query16	0.38	0.36	0.38
query17	0.99	1.00	1.02
query18	0.21	0.25	0.26
query19	1.93	1.85	1.92
query20	0.02	0.01	0.01
query21	15.48	0.55	0.54
query22	2.06	2.44	1.82
query23	17.28	1.02	1.01
query24	5.30	0.97	1.53
query25	0.31	0.14	0.04
query26	0.60	0.17	0.17
query27	0.04	0.04	0.03
query28	7.38	0.72	0.74
query29	12.74	2.19	2.32
query30	0.65	0.55	0.53
query31	2.81	0.39	0.37
query32	3.39	0.49	0.49
query33	3.05	3.05	3.10
query34	15.24	4.81	4.79
query35	4.87	4.85	4.86
query36	1.07	1.00	1.02
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.14	0.13
query41	0.07	0.02	0.02
query42	0.02	0.02	0.01
query43	0.03	0.02	0.02
Total cold run time: 103.69 s
Total hot run time: 30.92 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit bff2a760314a6b9e90bf7b0024c861f94f760c94 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.6 seconds inserted 10000000 Rows, about 462K ops/s

@xiaokang
Copy link
Contributor Author

xiaokang commented Aug 2, 2024

run p0 10

@xiaokang
Copy link
Contributor Author

xiaokang commented Aug 2, 2024

run p0

@github-actions
Copy link
Contributor

github-actions bot commented Aug 2, 2024

clang-tidy review says "All clean, LGTM! 👍"

@xiaokang
Copy link
Contributor Author

xiaokang commented Aug 2, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49550 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 85b74d8d7842f3923fb08f0abd9452ff5a3e1ec7, data reload: false

------ Round 1 ----------------------------------
q1	18088	4397	4326	4326
q2	2030	158	154	154
q3	10445	1897	1940	1897
q4	10318	1224	1281	1224
q5	8874	3914	3874	3874
q6	236	122	125	122
q7	2070	1588	1573	1573
q8	9341	2721	2701	2701
q9	10588	10338	10260	10260
q10	8653	3498	3450	3450
q11	419	246	255	246
q12	492	307	306	306
q13	18349	3980	3980	3980
q14	356	321	335	321
q15	509	457	463	457
q16	689	566	567	566
q17	1132	964	980	964
q18	7230	6788	6817	6788
q19	1800	1671	1589	1589
q20	515	317	300	300
q21	4414	4007	4047	4007
q22	530	445	452	445
Total cold run time: 117078 ms
Total hot run time: 49550 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4271	4293	4267	4267
q2	321	226	228	226
q3	4131	4155	4111	4111
q4	2758	2737	2748	2737
q5	7191	7086	7079	7079
q6	239	121	119	119
q7	3239	2875	2788	2788
q8	4413	4541	4548	4541
q9	16898	16799	17578	16799
q10	4196	4244	4266	4244
q11	780	667	672	667
q12	1026	849	861	849
q13	7377	3728	3745	3728
q14	454	420	412	412
q15	506	470	458	458
q16	753	679	675	675
q17	3828	3851	3833	3833
q18	8692	8738	8913	8738
q19	1694	1713	1676	1676
q20	2401	2177	2097	2097
q21	8462	8399	8491	8399
q22	1032	978	971	971
Total cold run time: 84662 ms
Total hot run time: 79414 ms

@xiaokang
Copy link
Contributor Author

xiaokang commented Aug 2, 2024

run buildall

@github-actions
Copy link
Contributor

github-actions bot commented Aug 2, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 49812 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8607c51a109442043106c192f859359a5892e771, data reload: false

------ Round 1 ----------------------------------
q1	17693	4380	4419	4380
q2	2059	190	147	147
q3	10416	1896	1960	1896
q4	10372	1264	1342	1264
q5	8358	3847	3935	3847
q6	230	124	127	124
q7	2082	1588	1634	1588
q8	9279	2747	2717	2717
q9	10654	10274	10191	10191
q10	8652	3504	3576	3504
q11	419	242	250	242
q12	476	309	307	307
q13	18335	3955	4042	3955
q14	359	323	329	323
q15	552	466	472	466
q16	685	573	567	567
q17	1132	948	965	948
q18	7345	6886	6908	6886
q19	1786	1693	1622	1622
q20	516	320	316	316
q21	4512	4123	4087	4087
q22	530	450	435	435
Total cold run time: 116442 ms
Total hot run time: 49812 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4404	4345	4329	4329
q2	322	225	229	225
q3	4187	4137	4195	4137
q4	2774	2756	2748	2748
q5	7154	7086	7117	7086
q6	240	122	119	119
q7	3271	2797	2834	2797
q8	4398	4495	4479	4479
q9	16903	16732	16720	16720
q10	4211	4262	4242	4242
q11	758	692	694	692
q12	1018	852	845	845
q13	7190	3771	3795	3771
q14	451	434	426	426
q15	508	456	465	456
q16	743	681	700	681
q17	3885	3889	3919	3889
q18	8836	8788	8882	8788
q19	1756	1736	1721	1721
q20	2390	2179	2124	2124
q21	8670	8666	8542	8542
q22	1099	1008	1026	1008
Total cold run time: 85168 ms
Total hot run time: 79825 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.74% (8102/21466)
Line Coverage: 29.38% (66350/225837)
Region Coverage: 28.89% (34239/118516)
Branch Coverage: 24.77% (17593/71012)
Coverage Report: http://coverage.selectdb-in.cc/coverage/8607c51a109442043106c192f859359a5892e771_8607c51a109442043106c192f859359a5892e771/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 204148 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8607c51a109442043106c192f859359a5892e771, data reload: false

query1	929	388	406	388
query2	6602	2927	2819	2819
query3	7214	226	218	218
query4	21837	18338	17995	17995
query5	19921	6560	6525	6525
query6	424	220	230	220
query7	5244	305	309	305
query8	469	395	442	395
query9	3076	2630	2591	2591
query10	452	295	309	295
query11	11363	10820	10809	10809
query12	121	79	79	79
query13	5678	721	693	693
query14	19270	13772	13270	13270
query15	369	252	249	249
query16	6413	292	266	266
query17	2860	910	880	880
query18	2252	418	420	418
query19	208	152	155	152
query20	79	77	84	77
query21	188	103	92	92
query22	5006	5034	4950	4950
query23	32390	32135	31887	31887
query24	6738	6556	6503	6503
query25	530	442	423	423
query26	530	164	160	160
query27	1713	299	298	298
query28	6084	2388	2313	2313
query29	2918	2824	2782	2782
query30	245	169	168	168
query31	911	729	776	729
query32	73	62	61	61
query33	402	273	262	262
query34	852	476	466	466
query35	1127	914	908	908
query36	1474	1246	1368	1246
query37	92	60	59	59
query38	3076	2923	2959	2923
query39	1382	1335	1310	1310
query40	208	95	89	89
query41	48	47	44	44
query42	86	86	82	82
query43	806	737	756	737
query44	1124	712	721	712
query45	249	234	240	234
query46	1248	946	974	946
query47	1802	1771	1718	1718
query48	1022	712	733	712
query49	627	378	371	371
query50	890	627	587	587
query51	4710	4675	4597	4597
query52	102	76	92	76
query53	456	321	351	321
query54	2635	2462	2455	2455
query55	90	90	87	87
query56	226	223	213	213
query57	1199	1213	1208	1208
query58	223	206	203	203
query59	4370	4135	4359	4135
query60	218	211	197	197
query61	96	92	93	92
query62	797	474	509	474
query63	497	349	349	349
query64	2526	1502	1388	1388
query65	3661	3567	3551	3551
query66	779	373	377	373
query67	17371	15051	16464	15051
query68	6617	658	667	658
query69	575	342	350	342
query70	1458	1353	1494	1353
query71	413	303	319	303
query72	6548	3499	3516	3499
query73	739	322	320	320
query74	6311	5854	5854	5854
query75	4680	3751	3726	3726
query76	4355	1172	1221	1172
query77	532	251	262	251
query78	12589	11740	11905	11740
query79	7297	672	620	620
query80	1935	404	406	404
query81	517	239	236	236
query82	1636	99	96	96
query83	186	134	131	131
query84	261	70	71	70
query85	1387	332	335	332
query86	351	304	341	304
query87	3220	3070	3045	3045
query88	5035	2293	2282	2282
query89	345	302	305	302
query90	1704	206	201	201
query91	177	151	154	151
query92	58	53	61	53
query93	2696	599	562	562
query94	875	213	210	210
query95	1117	1072	1050	1050
query96	639	322	325	322
query97	6418	6337	6411	6337
query98	190	175	176	175
query99	2987	861	919	861
Total cold run time: 312426 ms
Total hot run time: 204148 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.54 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8607c51a109442043106c192f859359a5892e771, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.25	0.05	0.05
query4	1.80	0.06	0.06
query5	0.52	0.53	0.52
query6	1.30	0.62	0.61
query7	0.01	0.01	0.01
query8	0.03	0.02	0.03
query9	0.51	0.49	0.48
query10	0.54	0.53	0.53
query11	0.12	0.09	0.09
query12	0.12	0.09	0.09
query13	0.63	0.62	0.61
query14	0.78	0.78	0.78
query15	0.78	0.76	0.78
query16	0.36	0.39	0.38
query17	1.03	0.99	1.03
query18	0.22	0.26	0.25
query19	1.94	1.86	1.87
query20	0.01	0.02	0.01
query21	15.52	0.58	0.56
query22	2.08	2.46	1.56
query23	17.05	1.14	0.84
query24	4.65	0.85	1.46
query25	0.34	0.10	0.06
query26	0.60	0.16	0.18
query27	0.05	0.03	0.04
query28	8.10	0.78	0.75
query29	12.61	2.30	2.24
query30	0.58	0.53	0.54
query31	2.81	0.40	0.38
query32	3.35	0.49	0.51
query33	3.12	3.05	3.08
query34	15.24	4.80	4.78
query35	4.84	4.86	4.84
query36	1.06	1.03	1.02
query37	0.05	0.05	0.05
query38	0.04	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.13	0.14
query41	0.06	0.02	0.02
query42	0.03	0.01	0.01
query43	0.02	0.02	0.02
Total cold run time: 103.42 s
Total hot run time: 30.54 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 8607c51a109442043106c192f859359a5892e771 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.7 seconds inserted 10000000 Rows, about 460K ops/s

@xiaokang xiaokang merged commit e90d615 into apache:branch-2.0 Aug 2, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants