Skip to content

Conversation

@DarvenDuan
Copy link
Contributor

Proposed changes

Issue Number: close #xxx
cherry-pick #35511

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@dataroaring
Copy link
Contributor

run buildall

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.86% (8107/21415)
Line Coverage: 29.53% (66352/224726)
Region Coverage: 28.99% (34193/117936)
Branch Coverage: 24.86% (17553/70608)
Coverage Report: http://coverage.selectdb-in.cc/coverage/63c541ebd2791a2e80828d35ee482d3c268b4f79_63c541ebd2791a2e80828d35ee482d3c268b4f79/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 50018 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 63c541ebd2791a2e80828d35ee482d3c268b4f79, data reload: false

------ Round 1 ----------------------------------
q1	17898	4367	4407	4367
q2	2040	159	148	148
q3	10511	1913	1900	1900
q4	10330	1237	1320	1237
q5	8450	3935	3897	3897
q6	227	125	127	125
q7	2053	1594	1632	1594
q8	9513	2709	2703	2703
q9	14197	10475	10599	10475
q10	8633	3576	3490	3490
q11	410	252	243	243
q12	475	301	304	301
q13	18331	3975	4035	3975
q14	354	336	336	336
q15	508	463	457	457
q16	664	570	575	570
q17	1132	947	911	911
q18	7289	6948	6877	6877
q19	1777	1615	1620	1615
q20	557	303	295	295
q21	4422	4106	4079	4079
q22	528	423	429	423
Total cold run time: 120299 ms
Total hot run time: 50018 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4316	4326	4331	4326
q2	319	242	231	231
q3	4191	4162	4137	4137
q4	2754	2730	2741	2730
q5	7216	7157	7161	7157
q6	238	122	125	122
q7	3222	2829	2904	2829
q8	4402	4467	4497	4467
q9	17452	17162	16971	16971
q10	4208	4258	4263	4258
q11	757	707	701	701
q12	1040	833	873	833
q13	6910	3742	3727	3727
q14	462	431	436	431
q15	506	454	456	454
q16	731	675	683	675
q17	3849	3847	3787	3787
q18	8790	8795	8751	8751
q19	1725	1687	1694	1687
q20	2396	2112	2125	2112
q21	8459	8467	8491	8467
q22	1040	987	949	949
Total cold run time: 84983 ms
Total hot run time: 79802 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203284 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 63c541ebd2791a2e80828d35ee482d3c268b4f79, data reload: false

query1	922	427	376	376
query2	6551	2772	2658	2658
query3	6927	203	206	203
query4	21118	18129	17997	17997
query5	19738	6550	6563	6550
query6	297	221	230	221
query7	4155	308	308	308
query8	402	395	405	395
query9	3056	2641	2563	2563
query10	429	306	302	302
query11	11334	10689	10596	10596
query12	127	78	75	75
query13	5599	684	689	684
query14	17821	13651	13522	13522
query15	364	232	255	232
query16	6461	279	270	270
query17	1734	1449	893	893
query18	2293	426	406	406
query19	211	148	156	148
query20	80	81	81	81
query21	189	94	95	94
query22	5220	4955	4737	4737
query23	32540	32040	32149	32040
query24	6901	6576	6503	6503
query25	544	431	424	424
query26	529	160	159	159
query27	1901	298	295	295
query28	6101	2321	2295	2295
query29	2992	2622	2767	2622
query30	241	164	168	164
query31	906	741	733	733
query32	69	63	60	60
query33	409	255	261	255
query34	849	465	471	465
query35	1128	937	934	934
query36	1233	1270	1133	1133
query37	90	62	63	62
query38	3067	2943	2964	2943
query39	1366	1336	1315	1315
query40	206	95	100	95
query41	46	43	43	43
query42	83	87	85	85
query43	698	697	722	697
query44	1114	720	715	715
query45	246	236	232	232
query46	1219	956	967	956
query47	1873	1959	1722	1722
query48	1017	711	701	701
query49	615	367	375	367
query50	864	593	566	566
query51	4808	4648	4638	4638
query52	97	78	84	78
query53	440	329	317	317
query54	2668	2417	2450	2417
query55	94	86	84	84
query56	244	217	229	217
query57	1242	1060	1169	1060
query58	219	191	197	191
query59	4065	4141	3775	3775
query60	205	200	211	200
query61	97	96	106	96
query62	705	548	490	490
query63	490	345	344	344
query64	2412	1551	1468	1468
query65	3625	3551	3564	3551
query66	780	386	376	376
query67	15544	15387	15581	15387
query68	10040	654	647	647
query69	570	347	350	347
query70	1647	1450	1469	1450
query71	418	321	322	321
query72	6553	3491	3531	3491
query73	750	322	318	318
query74	6467	5788	5824	5788
query75	5240	3736	3779	3736
query76	6334	1114	1121	1114
query77	1091	259	258	258
query78	12730	11680	12001	11680
query79	7189	636	624	624
query80	1034	409	409	409
query81	490	242	240	240
query82	1739	99	96	96
query83	182	136	131	131
query84	262	73	69	69
query85	890	320	324	320
query86	337	316	294	294
query87	3293	3004	3057	3004
query88	4675	2287	2292	2287
query89	381	270	273	270
query90	1952	214	209	209
query91	186	138	152	138
query92	59	54	51	51
query93	5585	572	568	568
query94	717	219	213	213
query95	1112	1038	1063	1038
query96	641	324	317	317
query97	6531	6271	6515	6271
query98	172	177	169	169
query99	2945	835	861	835
Total cold run time: 313822 ms
Total hot run time: 203284 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 63c541ebd2791a2e80828d35ee482d3c268b4f79, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.25	0.05	0.04
query4	1.79	0.07	0.07
query5	0.54	0.53	0.52
query6	1.24	0.63	0.62
query7	0.01	0.01	0.01
query8	0.03	0.02	0.02
query9	0.53	0.50	0.49
query10	0.54	0.54	0.53
query11	0.12	0.09	0.09
query12	0.12	0.09	0.09
query13	0.62	0.61	0.61
query14	0.78	0.79	0.78
query15	0.78	0.76	0.76
query16	0.37	0.39	0.36
query17	1.01	1.00	1.03
query18	0.23	0.26	0.23
query19	1.94	1.89	1.87
query20	0.01	0.02	0.02
query21	15.46	0.58	0.53
query22	1.99	1.81	1.63
query23	17.26	0.96	1.04
query24	4.86	1.28	1.53
query25	0.33	0.13	0.05
query26	0.60	0.16	0.14
query27	0.05	0.04	0.04
query28	7.77	0.75	0.71
query29	12.60	2.31	2.18
query30	0.53	0.54	0.49
query31	2.81	0.39	0.37
query32	3.44	0.50	0.50
query33	3.08	3.08	3.07
query34	15.29	4.83	4.79
query35	4.90	4.87	4.86
query36	1.08	1.01	1.02
query37	0.06	0.05	0.04
query38	0.04	0.02	0.02
query39	0.02	0.01	0.01
query40	0.15	0.14	0.14
query41	0.07	0.01	0.01
query42	0.03	0.01	0.02
query43	0.02	0.01	0.01
Total cold run time: 103.44 s
Total hot run time: 31 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 63c541ebd2791a2e80828d35ee482d3c268b4f79 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.6 seconds inserted 10000000 Rows, about 462K ops/s

@GoGoWen GoGoWen merged commit e9f604e into apache:branch-2.0 Jul 9, 2024
Copy link
Contributor

@GoGoWen GoGoWen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants