Skip to content

Conversation

@qidaye
Copy link
Contributor

@qidaye qidaye commented Aug 2, 2024

Proposed changes

backport #38732

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@qidaye
Copy link
Contributor Author

qidaye commented Aug 2, 2024

run buildall

@github-actions
Copy link
Contributor

github-actions bot commented Aug 2, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 49559 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a9c94b3c9c5fc304192a820c8900bbd2cc3294e4, data reload: false

------ Round 1 ----------------------------------
q1	18129	4361	4311	4311
q2	2037	188	150	150
q3	10419	1883	1925	1883
q4	10319	1272	1301	1272
q5	8461	3866	3854	3854
q6	229	125	142	125
q7	2054	1628	1614	1614
q8	9279	2716	2686	2686
q9	10431	10268	10140	10140
q10	8630	3513	3479	3479
q11	428	250	264	250
q12	471	303	310	303
q13	18469	3987	4071	3987
q14	364	323	321	321
q15	506	465	473	465
q16	686	568	575	568
q17	1128	968	970	968
q18	7282	6803	6966	6803
q19	2243	1544	1572	1544
q20	560	324	301	301
q21	4440	4106	4098	4098
q22	538	437	449	437
Total cold run time: 117103 ms
Total hot run time: 49559 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4344	4331	4369	4331
q2	322	243	219	219
q3	4204	4141	4158	4141
q4	2739	2769	2820	2769
q5	7407	7348	7328	7328
q6	240	123	125	123
q7	3366	2994	2934	2934
q8	4502	4468	4492	4468
q9	17037	16628	16761	16628
q10	4219	4269	4269	4269
q11	742	686	684	684
q12	1026	856	854	854
q13	6626	3731	3709	3709
q14	453	420	426	420
q15	499	460	461	460
q16	736	679	689	679
q17	3854	3801	3824	3801
q18	8710	8799	8802	8799
q19	1703	1717	1636	1636
q20	2386	2119	2071	2071
q21	8396	8459	8460	8459
q22	1066	960	968	960
Total cold run time: 84577 ms
Total hot run time: 79742 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203480 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a9c94b3c9c5fc304192a820c8900bbd2cc3294e4, data reload: false

query1	925	414	375	375
query2	6523	2751	2666	2666
query3	6921	209	200	200
query4	20355	18022	17815	17815
query5	19741	6551	6523	6523
query6	297	215	225	215
query7	4154	298	310	298
query8	432	429	397	397
query9	3062	2632	2578	2578
query10	427	313	301	301
query11	11250	10613	10592	10592
query12	127	78	76	76
query13	5598	703	723	703
query14	18092	13487	13467	13467
query15	362	239	260	239
query16	6458	286	258	258
query17	1707	1466	893	893
query18	2287	425	416	416
query19	221	154	149	149
query20	84	76	79	76
query21	191	102	92	92
query22	5114	4959	5000	4959
query23	32626	31795	31839	31795
query24	6917	6518	6559	6518
query25	524	453	415	415
query26	527	168	160	160
query27	1888	292	295	292
query28	6118	2343	2302	2302
query29	2987	2719	2767	2719
query30	242	165	164	164
query31	912	747	772	747
query32	73	55	64	55
query33	383	259	246	246
query34	850	466	461	461
query35	1112	916	905	905
query36	1339	1054	1091	1054
query37	91	59	59	59
query38	3065	2872	2878	2872
query39	1395	1309	1323	1309
query40	207	95	94	94
query41	48	46	43	43
query42	88	85	101	85
query43	671	733	669	669
query44	1144	714	710	710
query45	244	237	232	232
query46	1240	968	970	968
query47	1832	1699	1764	1699
query48	1031	735	716	716
query49	632	384	359	359
query50	886	658	646	646
query51	4747	4639	4669	4639
query52	86	87	80	80
query53	460	322	329	322
query54	2663	2455	2419	2419
query55	87	81	81	81
query56	215	214	208	208
query57	1228	1075	1138	1075
query58	220	210	200	200
query59	4325	4114	3912	3912
query60	202	214	220	214
query61	95	93	95	93
query62	859	529	455	455
query63	502	346	356	346
query64	2589	1537	1393	1393
query65	3636	3554	3553	3553
query66	804	378	387	378
query67	15751	15177	15397	15177
query68	10337	643	667	643
query69	564	352	337	337
query70	2214	1449	1446	1446
query71	413	303	316	303
query72	6537	3449	3492	3449
query73	741	330	321	321
query74	6212	5786	5914	5786
query75	5428	3814	3683	3683
query76	6879	1157	1156	1156
query77	1188	254	263	254
query78	12596	12218	12333	12218
query79	11096	669	643	643
query80	692	391	402	391
query81	486	235	232	232
query82	604	96	100	96
query83	170	133	128	128
query84	255	69	71	69
query85	878	331	340	331
query86	331	297	276	276
query87	3308	3062	3068	3062
query88	5290	2311	2295	2295
query89	360	302	286	286
query90	2002	213	214	213
query91	189	138	138	138
query92	59	54	59	54
query93	5112	555	608	555
query94	739	208	206	206
query95	1098	1042	1050	1042
query96	641	335	327	327
query97	6405	6371	6385	6371
query98	204	177	188	177
query99	2933	896	865	865
Total cold run time: 317830 ms
Total hot run time: 203480 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.78 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a9c94b3c9c5fc304192a820c8900bbd2cc3294e4, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.03
query3	0.25	0.04	0.05
query4	1.79	0.06	0.06
query5	0.54	0.52	0.53
query6	1.23	0.62	0.63
query7	0.01	0.02	0.01
query8	0.03	0.03	0.02
query9	0.53	0.48	0.47
query10	0.54	0.54	0.53
query11	0.12	0.09	0.09
query12	0.12	0.09	0.09
query13	0.62	0.61	0.61
query14	0.79	0.80	0.78
query15	0.78	0.76	0.75
query16	0.36	0.39	0.38
query17	0.98	0.97	0.99
query18	0.23	0.25	0.25
query19	1.88	1.82	1.86
query20	0.01	0.02	0.02
query21	15.50	0.57	0.55
query22	2.27	2.24	1.84
query23	17.11	1.00	0.92
query24	4.02	0.81	2.84
query25	0.37	0.13	0.05
query26	0.63	0.17	0.16
query27	0.03	0.04	0.04
query28	7.44	0.74	0.72
query29	12.66	2.31	2.31
query30	0.55	0.53	0.52
query31	2.80	0.39	0.37
query32	3.38	0.50	0.50
query33	3.07	3.08	3.10
query34	15.26	4.80	4.77
query35	4.84	4.85	4.82
query36	1.04	1.01	1.00
query37	0.05	0.04	0.05
query38	0.03	0.02	0.02
query39	0.02	0.02	0.01
query40	0.16	0.14	0.14
query41	0.06	0.01	0.02
query42	0.02	0.02	0.01
query43	0.02	0.01	0.02
Total cold run time: 102.23 s
Total hot run time: 30.78 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit a9c94b3c9c5fc304192a820c8900bbd2cc3294e4 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.3 seconds inserted 10000000 Rows, about 469K ops/s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.74% (8102/21468)
Line Coverage: 29.38% (66349/225855)
Region Coverage: 28.89% (34244/118519)
Branch Coverage: 24.78% (17597/71012)
Coverage Report: http://coverage.selectdb-in.cc/coverage/a9c94b3c9c5fc304192a820c8900bbd2cc3294e4_a9c94b3c9c5fc304192a820c8900bbd2cc3294e4/report/index.html

@xiaokang xiaokang merged commit af7a285 into apache:branch-2.0 Aug 2, 2024
@qidaye qidaye deleted the pick_index_compaction_error_2.0 branch August 2, 2024 09:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants