Skip to content

Conversation

@hubgeter
Copy link
Contributor

Proposed changes

bp #35583
Issue Number: close #xxx

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@hubgeter
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49679 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2c02d5f3da08c978574d1f0f2de2d21635e35b28, data reload: false

------ Round 1 ----------------------------------
q1	18239	4413	4382	4382
q2	2039	157	186	157
q3	10418	1919	1955	1919
q4	10360	1245	1324	1245
q5	8665	3881	3895	3881
q6	232	128	127	127
q7	2060	1640	1593	1593
q8	9525	2739	2684	2684
q9	13933	10263	10171	10171
q10	8649	3538	3526	3526
q11	415	249	253	249
q12	476	292	302	292
q13	18330	4001	4049	4001
q14	357	339	321	321
q15	528	464	467	464
q16	671	577	573	573
q17	1130	943	904	904
q18	7318	6891	6872	6872
q19	1740	1535	1539	1535
q20	531	321	296	296
q21	4388	4169	4102	4102
q22	488	385	395	385
Total cold run time: 120492 ms
Total hot run time: 49679 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4346	4280	4330	4280
q2	327	228	222	222
q3	4145	4188	4146	4146
q4	2772	2744	2767	2744
q5	7141	7061	7115	7061
q6	238	120	121	120
q7	3275	2833	2822	2822
q8	4385	4505	4482	4482
q9	16873	16730	16668	16668
q10	4258	4288	4271	4271
q11	762	678	686	678
q12	1024	842	873	842
q13	6715	3754	3715	3715
q14	453	435	415	415
q15	517	453	463	453
q16	748	682	685	682
q17	3777	4005	3885	3885
q18	8852	8798	8728	8728
q19	1717	1677	1639	1639
q20	2360	2102	2120	2102
q21	8586	8512	8453	8453
q22	987	937	927	927
Total cold run time: 84258 ms
Total hot run time: 79335 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.82% (8101/21421)
Line Coverage: 29.48% (66158/224450)
Region Coverage: 28.97% (34104/117741)
Branch Coverage: 24.82% (17504/70528)
Coverage Report: http://coverage.selectdb-in.cc/coverage/2c02d5f3da08c978574d1f0f2de2d21635e35b28_2c02d5f3da08c978574d1f0f2de2d21635e35b28/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 204255 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2c02d5f3da08c978574d1f0f2de2d21635e35b28, data reload: false

query1	940	390	381	381
query2	6584	2820	2918	2820
query3	6927	209	211	209
query4	20405	18215	18063	18063
query5	19739	6472	6478	6472
query6	297	226	234	226
query7	4338	320	317	317
query8	251	255	236	236
query9	3140	2719	2665	2665
query10	437	300	299	299
query11	11407	10708	10812	10708
query12	123	81	76	76
query13	5584	696	678	678
query14	17930	13240	13348	13240
query15	388	234	233	233
query16	6448	285	263	263
query17	1486	1496	879	879
query18	2263	422	417	417
query19	205	150	154	150
query20	87	80	80	80
query21	190	94	96	94
query22	5180	4790	5075	4790
query23	32624	32090	31911	31911
query24	6855	6589	6539	6539
query25	541	432	444	432
query26	533	171	169	169
query27	1879	303	300	300
query28	6187	2363	2317	2317
query29	2891	2822	2910	2822
query30	240	166	170	166
query31	910	735	746	735
query32	65	69	62	62
query33	400	279	267	267
query34	863	474	495	474
query35	1110	895	936	895
query36	1458	1244	1075	1075
query37	96	63	60	60
query38	3076	2907	2930	2907
query39	1401	1329	1319	1319
query40	214	97	102	97
query41	41	38	38	38
query42	85	84	82	82
query43	815	707	609	609
query44	1140	721	728	721
query45	247	241	235	235
query46	1218	975	991	975
query47	2246	1728	1746	1728
query48	1027	724	717	717
query49	635	382	375	375
query50	860	586	584	584
query51	4822	4658	4657	4657
query52	99	71	87	71
query53	456	315	319	315
query54	2663	2438	2456	2438
query55	96	90	79	79
query56	218	214	208	208
query57	1237	1233	1070	1070
query58	221	208	208	208
query59	4495	4383	4050	4050
query60	221	215	230	215
query61	101	95	101	95
query62	834	512	491	491
query63	494	353	343	343
query64	2314	1540	1537	1537
query65	3652	3599	3528	3528
query66	848	385	398	385
query67	16426	15594	15446	15446
query68	7676	666	665	665
query69	566	357	351	351
query70	1662	1516	1674	1516
query71	408	322	326	322
query72	6576	3520	3513	3513
query73	747	332	327	327
query74	6309	5810	5860	5810
query75	4647	3712	3708	3708
query76	4503	1179	1161	1161
query77	548	259	267	259
query78	12399	11788	11684	11684
query79	8354	639	656	639
query80	1511	409	407	407
query81	499	243	233	233
query82	1595	105	101	101
query83	188	138	139	138
query84	256	72	72	72
query85	1032	320	324	320
query86	360	288	314	288
query87	3254	3074	3035	3035
query88	5194	2363	2348	2348
query89	380	291	297	291
query90	1859	215	219	215
query91	177	140	139	139
query92	58	54	53	53
query93	4966	601	570	570
query94	880	212	222	212
query95	1107	1057	1061	1057
query96	632	339	342	339
query97	6440	6391	6343	6343
query98	206	184	171	171
query99	2896	974	925	925
Total cold run time: 311088 ms
Total hot run time: 204255 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.5 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2c02d5f3da08c978574d1f0f2de2d21635e35b28, data reload: false

query1	0.03	0.03	0.02
query2	0.07	0.02	0.02
query3	0.24	0.04	0.04
query4	1.78	0.07	0.08
query5	0.53	0.52	0.53
query6	1.24	0.64	0.62
query7	0.02	0.01	0.02
query8	0.04	0.03	0.03
query9	0.51	0.48	0.48
query10	0.53	0.53	0.54
query11	0.12	0.09	0.09
query12	0.12	0.09	0.09
query13	0.63	0.61	0.60
query14	0.78	0.80	0.80
query15	0.78	0.76	0.76
query16	0.37	0.36	0.35
query17	1.02	1.02	1.03
query18	0.20	0.27	0.23
query19	1.86	1.86	1.85
query20	0.02	0.01	0.01
query21	15.48	0.60	0.55
query22	2.43	1.73	1.45
query23	17.29	1.00	0.96
query24	5.12	0.82	1.35
query25	0.39	0.12	0.04
query26	0.49	0.17	0.16
query27	0.05	0.04	0.04
query28	7.81	0.82	0.71
query29	12.67	2.42	2.32
query30	0.65	0.54	0.56
query31	2.82	0.40	0.37
query32	3.37	0.49	0.49
query33	3.12	3.09	3.07
query34	15.26	4.82	4.78
query35	4.85	4.82	4.81
query36	1.05	1.01	1.01
query37	0.05	0.05	0.04
query38	0.04	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.14	0.13
query41	0.07	0.02	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 104.12 s
Total hot run time: 30.5 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 2c02d5f3da08c978574d1f0f2de2d21635e35b28 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.3 seconds inserted 10000000 Rows, about 469K ops/s

@morningman
Copy link
Contributor

run buildall

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.81% (8099/21421)
Line Coverage: 29.47% (66145/224450)
Region Coverage: 28.96% (34093/117741)
Branch Coverage: 24.81% (17496/70528)
Coverage Report: http://coverage.selectdb-in.cc/coverage/6c5f74293e44b5c73eb82d4fb40ecf74740c0689_6c5f74293e44b5c73eb82d4fb40ecf74740c0689/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 49693 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6c5f74293e44b5c73eb82d4fb40ecf74740c0689, data reload: false

------ Round 1 ----------------------------------
q1	18032	4361	4318	4318
q2	2047	183	142	142
q3	10419	1915	1954	1915
q4	10275	1262	1324	1262
q5	8541	3919	3921	3919
q6	230	124	124	124
q7	2040	1616	1601	1601
q8	9302	2733	2718	2718
q9	10763	10318	10164	10164
q10	8648	3515	3525	3515
q11	420	237	257	237
q12	464	310	308	308
q13	18374	3975	4016	3975
q14	367	328	331	328
q15	512	447	451	447
q16	673	572	570	570
q17	1124	956	977	956
q18	7282	6926	6881	6881
q19	1691	1535	1509	1509
q20	543	320	313	313
q21	4430	4095	4107	4095
q22	480	397	396	396
Total cold run time: 116657 ms
Total hot run time: 49693 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4342	4282	4300	4282
q2	323	230	232	230
q3	4177	4163	4178	4163
q4	2772	2768	2891	2768
q5	7149	7136	7055	7055
q6	242	119	120	119
q7	3260	2824	2828	2824
q8	4369	4465	4492	4465
q9	16858	16791	16853	16791
q10	4248	4280	4324	4280
q11	764	709	655	655
q12	1040	865	858	858
q13	7221	3740	3802	3740
q14	462	428	445	428
q15	502	468	469	468
q16	738	691	686	686
q17	3845	3856	3874	3856
q18	8842	8773	8833	8773
q19	1712	1727	1648	1648
q20	2441	2188	2092	2092
q21	8702	8748	8932	8748
q22	1084	1003	1084	1003
Total cold run time: 85093 ms
Total hot run time: 79932 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204297 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6c5f74293e44b5c73eb82d4fb40ecf74740c0689, data reload: false

query1	2341	403	410	403
query2	9630	2877	2591	2591
query3	6928	208	212	208
query4	19949	18061	18091	18061
query5	19730	6542	6570	6542
query6	403	220	238	220
query7	5153	304	302	302
query8	259	287	251	251
query9	3079	2660	2608	2608
query10	413	297	302	297
query11	11266	10721	10777	10721
query12	120	82	76	76
query13	5616	690	684	684
query14	19358	13232	13163	13163
query15	363	221	240	221
query16	6429	288	279	279
query17	1385	1454	882	882
query18	2257	422	415	415
query19	208	150	151	150
query20	83	79	81	79
query21	187	93	96	93
query22	5326	5118	5128	5118
query23	32586	32054	31941	31941
query24	6805	6575	6500	6500
query25	533	426	417	417
query26	524	165	167	165
query27	1724	292	296	292
query28	6141	2361	2321	2321
query29	2885	2888	2661	2661
query30	245	165	171	165
query31	918	776	717	717
query32	75	61	63	61
query33	401	247	247	247
query34	866	473	499	473
query35	1119	927	953	927
query36	1303	1358	1219	1219
query37	90	69	60	60
query38	3114	2884	2941	2884
query39	1375	1349	1313	1313
query40	213	96	95	95
query41	40	41	38	38
query42	95	90	85	85
query43	708	676	653	653
query44	1135	722	722	722
query45	246	233	226	226
query46	1232	979	975	975
query47	1824	1701	1665	1665
query48	1013	736	740	736
query49	614	375	369	369
query50	854	599	583	583
query51	4852	4688	4729	4688
query52	90	84	80	80
query53	449	323	328	323
query54	2657	2450	2470	2450
query55	80	89	89	89
query56	223	209	214	209
query57	1294	1068	1044	1044
query58	213	196	199	196
query59	4160	4365	3943	3943
query60	220	194	195	194
query61	105	93	92	92
query62	866	541	502	502
query63	498	342	340	340
query64	2481	1516	1513	1513
query65	3647	3549	3551	3549
query66	768	383	379	379
query67	15545	15979	15826	15826
query68	9573	670	648	648
query69	577	347	351	347
query70	1597	1427	1308	1308
query71	424	305	304	304
query72	6579	3473	3488	3473
query73	743	321	336	321
query74	6285	5834	5886	5834
query75	5556	3731	3705	3705
query76	5924	1145	1219	1145
query77	1018	260	252	252
query78	12899	11802	11862	11802
query79	8082	632	661	632
query80	870	402	408	402
query81	493	238	239	238
query82	1485	99	95	95
query83	172	132	128	128
query84	265	70	72	70
query85	889	315	314	314
query86	331	311	292	292
query87	3314	3012	3023	3012
query88	4643	2346	2359	2346
query89	371	286	275	275
query90	2041	217	212	212
query91	173	141	152	141
query92	56	52	52	52
query93	5772	599	576	576
query94	717	210	212	210
query95	1096	1066	1055	1055
query96	658	332	333	332
query97	6447	6450	6386	6386
query98	182	176	174	174
query99	2965	939	925	925
Total cold run time: 319506 ms
Total hot run time: 204297 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.42 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6c5f74293e44b5c73eb82d4fb40ecf74740c0689, data reload: false

query1	0.03	0.03	0.02
query2	0.07	0.02	0.02
query3	0.25	0.05	0.04
query4	1.81	0.05	0.06
query5	0.56	0.52	0.53
query6	1.24	0.61	0.66
query7	0.01	0.01	0.02
query8	0.03	0.02	0.03
query9	0.53	0.50	0.49
query10	0.53	0.53	0.52
query11	0.12	0.09	0.09
query12	0.11	0.09	0.09
query13	0.63	0.61	0.62
query14	0.81	0.77	0.78
query15	0.80	0.76	0.77
query16	0.36	0.37	0.36
query17	1.01	1.05	1.00
query18	0.24	0.25	0.25
query19	1.94	1.85	1.88
query20	0.01	0.01	0.01
query21	15.47	0.55	0.55
query22	2.38	2.42	1.45
query23	17.16	1.12	0.91
query24	8.33	0.70	0.88
query25	0.40	0.15	0.05
query26	0.76	0.16	0.16
query27	0.04	0.03	0.03
query28	5.28	0.75	0.76
query29	12.68	2.30	2.42
query30	0.61	0.54	0.54
query31	2.81	0.39	0.38
query32	3.37	0.50	0.50
query33	3.07	3.09	3.10
query34	15.24	4.81	4.81
query35	4.90	4.87	4.85
query36	1.05	1.02	1.02
query37	0.06	0.04	0.04
query38	0.04	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.13	0.15
query41	0.07	0.02	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 105.03 s
Total hot run time: 30.42 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 6c5f74293e44b5c73eb82d4fb40ecf74740c0689 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.5 seconds inserted 10000000 Rows, about 465K ops/s

@morningman morningman merged commit 5468df6 into apache:branch-2.0 May 31, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants