Skip to content

Conversation

@csun5285
Copy link
Contributor

@csun5285 csun5285 commented Aug 1, 2024

Proposed changes

pick from master #38218

Issue Number: close #xxx

fix

add comment
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@csun5285 csun5285 changed the base branch from master to branch-2.0 August 1, 2024 11:18
@csun5285
Copy link
Contributor Author

csun5285 commented Aug 1, 2024

run buildall

@github-actions github-actions bot added the doing label Aug 1, 2024
@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.74% (8102/21468)
Line Coverage: 29.38% (66342/225825)
Region Coverage: 28.89% (34234/118494)
Branch Coverage: 24.78% (17590/70994)
Coverage Report: http://coverage.selectdb-in.cc/coverage/e8844a8fd248dcf1177963d4be86bc351a3dac7f_e8844a8fd248dcf1177963d4be86bc351a3dac7f/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 49756 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e8844a8fd248dcf1177963d4be86bc351a3dac7f, data reload: false

------ Round 1 ----------------------------------
q1	17623	4387	4342	4342
q2	2083	162	143	143
q3	10425	1917	1935	1917
q4	10353	1236	1321	1236
q5	8590	3882	3880	3880
q6	257	146	125	125
q7	2059	1584	1583	1583
q8	9295	2723	2682	2682
q9	10536	10277	10228	10228
q10	8652	3540	3471	3471
q11	410	252	246	246
q12	467	303	301	301
q13	18314	3935	3981	3935
q14	348	325	324	324
q15	502	451	465	451
q16	681	561	584	561
q17	1123	978	993	978
q18	7245	6908	6953	6908
q19	1780	1670	1624	1624
q20	537	315	316	315
q21	4435	4136	4071	4071
q22	523	455	435	435
Total cold run time: 116238 ms
Total hot run time: 49756 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4333	4345	4313	4313
q2	321	224	226	224
q3	4158	4161	4112	4112
q4	2761	2748	2780	2748
q5	7172	7162	7151	7151
q6	239	122	122	122
q7	3221	2822	2843	2822
q8	4328	4430	4539	4430
q9	16900	16752	16770	16752
q10	4200	4237	4252	4237
q11	757	690	690	690
q12	1034	871	838	838
q13	7825	3712	3752	3712
q14	453	431	432	431
q15	497	459	460	459
q16	723	689	673	673
q17	3862	3881	3868	3868
q18	8769	8750	8755	8750
q19	1709	1715	1640	1640
q20	2349	2155	2104	2104
q21	8430	8449	8428	8428
q22	1091	988	1000	988
Total cold run time: 85132 ms
Total hot run time: 79492 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 205266 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e8844a8fd248dcf1177963d4be86bc351a3dac7f, data reload: false

query1	948	389	419	389
query2	6527	2886	2868	2868
query3	6920	212	201	201
query4	19895	17986	17981	17981
query5	19737	6443	6543	6443
query6	279	225	225	225
query7	4160	296	320	296
query8	450	421	390	390
query9	3098	2687	2632	2632
query10	413	310	287	287
query11	11298	10723	10720	10720
query12	129	79	73	73
query13	5603	705	702	702
query14	17737	13155	13727	13155
query15	365	246	256	246
query16	6453	286	270	270
query17	1681	1465	880	880
query18	2314	412	416	412
query19	210	155	155	155
query20	83	79	80	79
query21	192	100	97	97
query22	5237	5048	4994	4994
query23	32447	32092	31873	31873
query24	7002	6498	6536	6498
query25	523	434	417	417
query26	529	167	166	166
query27	1843	302	294	294
query28	6152	2406	2357	2357
query29	2908	2873	2702	2702
query30	237	169	168	168
query31	919	781	740	740
query32	69	63	63	63
query33	409	248	254	248
query34	834	468	485	468
query35	1107	911	947	911
query36	1305	1104	1251	1104
query37	89	62	63	62
query38	3072	2934	2959	2934
query39	1383	1338	1314	1314
query40	200	99	93	93
query41	46	44	43	43
query42	92	82	80	80
query43	656	649	733	649
query44	1137	721	717	717
query45	248	240	238	238
query46	1227	954	969	954
query47	1946	1714	1665	1665
query48	1025	712	683	683
query49	620	375	362	362
query50	867	594	568	568
query51	4728	4671	4659	4659
query52	95	84	81	81
query53	447	321	315	315
query54	2663	2478	2504	2478
query55	98	83	90	83
query56	253	225	222	222
query57	1164	1151	1063	1063
query58	209	193	219	193
query59	4212	4201	3927	3927
query60	217	206	238	206
query61	101	102	99	99
query62	909	521	478	478
query63	485	340	340	340
query64	2596	1543	1375	1375
query65	3641	3594	3563	3563
query66	800	378	382	378
query67	17388	17124	17373	17124
query68	5694	654	639	639
query69	563	349	336	336
query70	1438	1434	1333	1333
query71	388	314	325	314
query72	6301	3492	3541	3492
query73	721	318	311	311
query74	6232	5821	5888	5821
query75	4275	3808	3680	3680
query76	3053	1136	1149	1136
query77	474	256	256	256
query78	12455	11792	11736	11736
query79	6981	634	641	634
query80	2629	411	411	411
query81	528	235	234	234
query82	1391	104	98	98
query83	248	139	128	128
query84	256	74	74	74
query85	1488	331	335	331
query86	345	327	284	284
query87	3192	3115	3001	3001
query88	4784	2322	2317	2317
query89	340	281	302	281
query90	1699	210	207	207
query91	178	156	142	142
query92	60	54	51	51
query93	2167	597	573	573
query94	876	212	213	212
query95	1125	1085	1072	1072
query96	647	322	322	322
query97	6522	6325	6350	6325
query98	197	177	172	172
query99	2864	926	893	893
Total cold run time: 302738 ms
Total hot run time: 205266 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.15 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e8844a8fd248dcf1177963d4be86bc351a3dac7f, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.02
query3	0.25	0.05	0.06
query4	1.78	0.09	0.08
query5	0.53	0.52	0.52
query6	1.23	0.61	0.62
query7	0.01	0.00	0.01
query8	0.04	0.02	0.02
query9	0.52	0.48	0.47
query10	0.54	0.54	0.53
query11	0.12	0.09	0.08
query12	0.11	0.09	0.10
query13	0.62	0.61	0.61
query14	0.78	0.79	0.76
query15	0.77	0.76	0.76
query16	0.37	0.37	0.36
query17	1.00	1.00	1.01
query18	0.24	0.24	0.25
query19	1.86	1.81	1.83
query20	0.02	0.01	0.01
query21	15.47	0.56	0.56
query22	1.94	2.02	1.68
query23	17.15	0.99	1.12
query24	6.05	1.74	0.45
query25	0.36	0.08	0.06
query26	0.67	0.15	0.16
query27	0.04	0.05	0.03
query28	7.19	0.74	0.70
query29	12.72	2.32	2.14
query30	0.56	0.53	0.50
query31	2.83	0.39	0.38
query32	3.39	0.50	0.50
query33	3.05	3.12	3.09
query34	15.22	4.76	4.79
query35	4.84	4.84	4.84
query36	1.04	1.02	1.02
query37	0.06	0.04	0.05
query38	0.03	0.02	0.02
query39	0.02	0.01	0.02
query40	0.17	0.14	0.14
query41	0.07	0.02	0.02
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 103.79 s
Total hot run time: 30.15 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit e8844a8fd248dcf1177963d4be86bc351a3dac7f with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.5 seconds inserted 10000000 Rows, about 465K ops/s

@csun5285
Copy link
Contributor Author

csun5285 commented Aug 1, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 50331 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit fe52685ce297b853a0e7022cb328d77d9ee17e39, data reload: false

------ Round 1 ----------------------------------
q1	17542	4469	4335	4335
q2	2071	161	161	161
q3	10267	1919	1965	1919
q4	10109	1248	1362	1248
q5	8519	3880	3910	3880
q6	242	131	128	128
q7	2086	1597	1625	1597
q8	9295	2738	2741	2738
q9	10653	10850	10613	10613
q10	8738	3511	3472	3472
q11	433	251	244	244
q12	482	308	309	308
q13	18355	4031	4037	4031
q14	358	333	340	333
q15	513	461	460	460
q16	704	576	577	576
q17	1153	950	974	950
q18	7349	6854	7024	6854
q19	1790	1630	1662	1630
q20	534	311	296	296
q21	4498	4176	4113	4113
q22	537	455	445	445
Total cold run time: 116228 ms
Total hot run time: 50331 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4340	4307	4365	4307
q2	320	228	224	224
q3	4181	4191	4145	4145
q4	2768	2770	2758	2758
q5	7187	7172	7125	7125
q6	243	125	122	122
q7	3283	2852	2882	2852
q8	4376	4473	4525	4473
q9	16953	16913	16880	16880
q10	4221	4294	4277	4277
q11	765	691	699	691
q12	1047	843	873	843
q13	6281	3767	3739	3739
q14	449	436	427	427
q15	501	452	457	452
q16	740	675	682	675
q17	3932	3863	3817	3817
q18	8900	8710	8748	8710
q19	1757	1746	1671	1671
q20	2422	2170	2180	2170
q21	8619	8657	8538	8538
q22	1096	1013	986	986
Total cold run time: 84381 ms
Total hot run time: 79882 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.73% (8100/21468)
Line Coverage: 29.37% (66325/225826)
Region Coverage: 28.88% (34222/118494)
Branch Coverage: 24.77% (17588/70994)
Coverage Report: http://coverage.selectdb-in.cc/coverage/fe52685ce297b853a0e7022cb328d77d9ee17e39_fe52685ce297b853a0e7022cb328d77d9ee17e39/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 204267 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit fe52685ce297b853a0e7022cb328d77d9ee17e39, data reload: false

query1	956	429	385	385
query2	6525	2851	2610	2610
query3	6922	212	202	202
query4	20162	18154	17967	17967
query5	19726	6460	6483	6460
query6	284	214	233	214
query7	4165	302	325	302
query8	428	472	402	402
query9	3196	2713	2653	2653
query10	412	312	294	294
query11	11250	10747	10666	10666
query12	124	80	73	73
query13	5605	723	712	712
query14	17377	13256	13423	13256
query15	365	236	247	236
query16	6492	307	262	262
query17	1559	1470	865	865
query18	2327	408	412	408
query19	208	150	143	143
query20	80	78	80	78
query21	198	100	91	91
query22	5358	5119	5122	5119
query23	32419	31978	31804	31804
query24	7341	6568	6569	6568
query25	529	434	425	425
query26	665	164	165	164
query27	2086	297	290	290
query28	6107	2433	2382	2382
query29	2926	2798	2727	2727
query30	244	167	169	167
query31	920	727	742	727
query32	71	65	62	62
query33	404	261	255	255
query34	881	470	470	470
query35	1111	906	897	897
query36	1320	1291	1208	1208
query37	91	61	61	61
query38	3093	2939	2971	2939
query39	1366	1321	1323	1321
query40	305	91	105	91
query41	46	44	45	44
query42	84	78	82	78
query43	824	743	788	743
query44	1149	721	731	721
query45	252	231	238	231
query46	1227	969	991	969
query47	1869	1837	1821	1821
query48	1033	722	726	722
query49	660	392	371	371
query50	872	618	623	618
query51	4738	4703	4697	4697
query52	90	90	83	83
query53	453	321	331	321
query54	2644	2495	2468	2468
query55	95	81	80	80
query56	242	227	198	198
query57	1188	1157	1090	1090
query58	223	212	216	212
query59	4551	3952	4030	3952
query60	217	205	209	205
query61	95	94	106	94
query62	794	525	487	487
query63	499	342	341	341
query64	2816	1569	1497	1497
query65	3656	3551	3584	3551
query66	798	373	376	373
query67	15919	15456	15477	15456
query68	10145	680	653	653
query69	562	349	360	349
query70	1796	1473	1514	1473
query71	417	313	322	313
query72	6569	3493	3521	3493
query73	739	318	321	318
query74	6385	5875	5886	5875
query75	5291	3660	3706	3660
query76	6493	1126	1203	1126
query77	1131	263	255	255
query78	12470	11740	11626	11626
query79	7705	650	633	633
query80	1271	400	402	400
query81	496	234	235	234
query82	1548	98	94	94
query83	188	130	131	130
query84	265	71	74	71
query85	888	331	324	324
query86	341	293	299	293
query87	3217	3066	3036	3036
query88	4690	2304	2308	2304
query89	388	307	299	299
query90	1951	201	203	201
query91	175	140	150	140
query92	63	55	51	51
query93	6275	610	592	592
query94	702	203	211	203
query95	1126	1067	1047	1047
query96	644	333	318	318
query97	6597	6349	6351	6349
query98	184	177	175	175
query99	3028	860	853	853
Total cold run time: 316372 ms
Total hot run time: 204267 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.43 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit fe52685ce297b853a0e7022cb328d77d9ee17e39, data reload: false

query1	0.02	0.03	0.02
query2	0.07	0.02	0.02
query3	0.25	0.06	0.05
query4	1.77	0.11	0.11
query5	0.55	0.54	0.51
query6	1.23	0.63	0.60
query7	0.01	0.01	0.01
query8	0.03	0.02	0.02
query9	0.53	0.48	0.49
query10	0.54	0.53	0.53
query11	0.13	0.09	0.09
query12	0.11	0.09	0.10
query13	0.63	0.62	0.60
query14	0.80	0.80	0.79
query15	0.80	0.78	0.78
query16	0.37	0.38	0.37
query17	1.03	1.00	1.00
query18	0.21	0.26	0.24
query19	1.94	1.84	1.88
query20	0.02	0.01	0.00
query21	15.49	0.56	0.56
query22	1.93	1.98	2.16
query23	17.28	1.04	0.82
query24	5.06	1.58	1.10
query25	0.38	0.12	0.06
query26	0.58	0.16	0.15
query27	0.05	0.03	0.03
query28	7.80	0.76	0.74
query29	12.59	2.29	2.34
query30	0.61	0.51	0.53
query31	2.82	0.39	0.40
query32	3.35	0.52	0.51
query33	3.20	3.17	3.14
query34	15.26	4.87	4.85
query35	4.90	4.89	4.89
query36	1.05	1.02	1.03
query37	0.06	0.05	0.04
query38	0.04	0.02	0.02
query39	0.02	0.02	0.01
query40	0.15	0.15	0.14
query41	0.07	0.01	0.01
query42	0.02	0.01	0.02
query43	0.03	0.01	0.01
Total cold run time: 103.78 s
Total hot run time: 31.43 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit fe52685ce297b853a0e7022cb328d77d9ee17e39 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s

@github-actions
Copy link
Contributor

github-actions bot commented Aug 1, 2024

clang-tidy review says "All clean, LGTM! 👍"

@xiaokang xiaokang merged commit 5cb03e9 into apache:branch-2.0 Aug 1, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants