Skip to content

Conversation

@DarvenDuan
Copy link
Contributor

@DarvenDuan DarvenDuan commented Nov 7, 2024

What problem does this PR solve?

Issue Number: close #xxx

Cherry-pick #41815

Related PR: #xxx

Problem Summary:

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No colde files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.
  • Release note

    None

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@DarvenDuan
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40691 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4048be76dbc63761234f4de4d7918a8235a11d24, data reload: false

------ Round 1 ----------------------------------
q1	17559	7512	7275	7275
q2	2057	187	167	167
q3	10538	1108	1164	1108
q4	10228	776	738	738
q5	7746	2845	2700	2700
q6	237	148	147	147
q7	977	612	633	612
q8	9409	2022	1994	1994
q9	8202	6433	6394	6394
q10	7081	2306	2303	2303
q11	466	259	258	258
q12	530	214	211	211
q13	17783	2990	2980	2980
q14	238	217	210	210
q15	559	523	500	500
q16	688	599	611	599
q17	978	585	513	513
q18	7380	6658	6720	6658
q19	1368	1108	1132	1108
q20	466	188	196	188
q21	3930	3087	3042	3042
q22	1105	986	1029	986
Total cold run time: 109525 ms
Total hot run time: 40691 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7290	7276	7292	7276
q2	417	324	299	299
q3	2913	2687	2723	2687
q4	1869	1697	1633	1633
q5	5410	5415	5416	5415
q6	220	136	139	136
q7	2055	1662	1636	1636
q8	3205	3403	3412	3403
q9	8490	8562	8493	8493
q10	3464	3372	3402	3372
q11	581	492	489	489
q12	753	576	579	576
q13	16897	2983	2964	2964
q14	307	267	261	261
q15	581	539	539	539
q16	682	651	653	651
q17	1816	1595	1566	1566
q18	7621	7394	7200	7200
q19	1633	1555	1437	1437
q20	1981	1789	1784	1784
q21	5209	5102	4925	4925
q22	1121	1006	991	991
Total cold run time: 74515 ms
Total hot run time: 57733 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190957 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4048be76dbc63761234f4de4d7918a8235a11d24, data reload: false

query1	977	394	373	373
query2	6400	2116	2140	2116
query3	6475	218	231	218
query4	33946	23261	23298	23261
query5	4213	456	419	419
query6	266	196	175	175
query7	4503	301	302	301
query8	292	232	241	232
query9	9440	2681	2673	2673
query10	461	266	260	260
query11	17960	15064	15161	15064
query12	150	110	102	102
query13	1601	429	418	418
query14	9809	6899	6943	6899
query15	224	167	177	167
query16	7895	520	465	465
query17	1562	570	550	550
query18	2353	598	561	561
query19	264	181	173	173
query20	115	107	105	105
query21	213	107	102	102
query22	4512	4320	4375	4320
query23	36581	33943	33896	33896
query24	12238	3422	3297	3297
query25	604	418	405	405
query26	1331	179	181	179
query27	2726	288	304	288
query28	7941	2509	2456	2456
query29	702	441	448	441
query30	459	309	303	303
query31	1123	781	825	781
query32	90	59	58	58
query33	769	297	282	282
query34	938	502	509	502
query35	860	732	712	712
query36	1082	947	943	943
query37	215	71	75	71
query38	3979	3795	3904	3795
query39	1501	1432	1417	1417
query40	279	101	101	101
query41	54	53	50	50
query42	104	104	102	102
query43	542	490	490	490
query44	1267	779	798	779
query45	184	173	166	166
query46	1155	706	710	706
query47	1915	1860	1851	1851
query48	451	364	364	364
query49	1233	391	397	391
query50	803	409	424	409
query51	7159	7084	7129	7084
query52	98	92	91	91
query53	259	183	189	183
query54	1212	464	451	451
query55	82	77	78	77
query56	251	242	233	233
query57	1211	1133	1114	1114
query58	232	203	210	203
query59	3235	2821	2850	2821
query60	266	243	237	237
query61	107	105	104	104
query62	861	657	667	657
query63	213	181	182	181
query64	5190	650	607	607
query65	3277	3157	3151	3151
query66	1331	307	299	299
query67	16039	15446	15149	15149
query68	5703	585	550	550
query69	423	246	260	246
query70	1145	1130	1129	1129
query71	396	256	259	256
query72	6085	3887	3907	3887
query73	766	341	342	341
query74	10412	8891	8816	8816
query75	3465	2787	2624	2624
query76	3364	976	963	963
query77	518	260	260	260
query78	10637	9732	10120	9732
query79	6248	582	581	581
query80	2122	408	414	408
query81	574	239	241	239
query82	832	119	112	112
query83	273	159	160	159
query84	293	79	85	79
query85	2212	302	276	276
query86	484	293	288	288
query87	4416	4210	4222	4210
query88	5422	2369	2382	2369
query89	436	291	283	283
query90	2173	178	179	178
query91	177	147	145	145
query92	67	49	48	48
query93	5216	549	525	525
query94	1078	280	298	280
query95	341	244	253	244
query96	616	280	276	276
query97	3337	3178	3141	3141
query98	218	197	193	193
query99	1901	1308	1288	1288
Total cold run time: 317130 ms
Total hot run time: 190957 ms

@DarvenDuan
Copy link
Contributor Author

run p0

@DarvenDuan
Copy link
Contributor Author

run performance

@doris-robot
Copy link

TPC-H: Total hot run time: 40174 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4048be76dbc63761234f4de4d7918a8235a11d24, data reload: false

------ Round 1 ----------------------------------
q1	17571	7380	7265	7265
q2	2065	165	159	159
q3	10829	1057	1132	1057
q4	10547	754	695	695
q5	7759	2817	2716	2716
q6	229	147	148	147
q7	964	610	594	594
q8	9375	1939	1977	1939
q9	6567	6390	6358	6358
q10	6990	2260	2309	2260
q11	459	263	256	256
q12	405	205	209	205
q13	17787	2973	2956	2956
q14	255	204	213	204
q15	558	517	514	514
q16	647	588	600	588
q17	942	601	510	510
q18	7192	6468	6469	6468
q19	2044	1038	945	945
q20	482	198	195	195
q21	3966	3133	3232	3133
q22	1075	1017	1010	1010
Total cold run time: 108708 ms
Total hot run time: 40174 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7320	7221	7529	7221
q2	421	321	311	311
q3	2837	2860	2829	2829
q4	1984	1715	1749	1715
q5	5587	5682	5694	5682
q6	222	141	140	140
q7	2193	1789	1761	1761
q8	3367	3513	3500	3500
q9	8697	8732	8798	8732
q10	3537	3474	3525	3474
q11	604	488	494	488
q12	769	608	592	592
q13	16578	3126	3150	3126
q14	301	293	271	271
q15	594	557	548	548
q16	718	663	680	663
q17	1819	1668	1599	1599
q18	8204	7657	7465	7465
q19	6905	1584	1528	1528
q20	2076	1851	1822	1822
q21	5365	5272	5329	5272
q22	1156	1020	998	998
Total cold run time: 81254 ms
Total hot run time: 59737 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193503 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4048be76dbc63761234f4de4d7918a8235a11d24, data reload: false

query1	2558	2412	2237	2237
query2	6243	2171	2110	2110
query3	14855	10046	236	236
query4	33996	23274	23401	23274
query5	5142	469	448	448
query6	286	193	171	171
query7	3967	305	306	305
query8	283	226	227	226
query9	9512	2695	2692	2692
query10	462	254	281	254
query11	18215	15112	15258	15112
query12	147	100	105	100
query13	1567	431	421	421
query14	9655	7448	7417	7417
query15	242	178	176	176
query16	7895	586	505	505
query17	1491	592	608	592
query18	2386	653	638	638
query19	244	198	202	198
query20	125	116	108	108
query21	204	107	112	107
query22	4752	4436	4042	4042
query23	34450	33761	33691	33691
query24	8932	3439	3441	3439
query25	597	420	419	419
query26	741	181	186	181
query27	2004	293	301	293
query28	6361	2541	2503	2503
query29	762	446	452	446
query30	382	301	319	301
query31	1024	800	806	800
query32	83	58	58	58
query33	566	288	283	283
query34	908	518	507	507
query35	813	716	724	716
query36	1090	933	938	933
query37	112	73	73	73
query38	3996	3875	3965	3875
query39	1495	1437	1406	1406
query40	203	101	100	100
query41	53	52	50	50
query42	110	99	99	99
query43	523	502	494	494
query44	1159	791	790	790
query45	182	168	166	166
query46	1147	727	730	727
query47	1939	1806	1810	1806
query48	464	378	376	376
query49	899	425	394	394
query50	784	420	424	420
query51	7325	7072	6949	6949
query52	102	94	89	89
query53	260	185	187	185
query54	633	457	474	457
query55	77	77	75	75
query56	251	238	228	228
query57	1191	1099	1084	1084
query58	234	203	210	203
query59	3073	3008	2898	2898
query60	277	249	261	249
query61	109	104	104	104
query62	819	672	657	657
query63	220	187	187	187
query64	3700	650	625	625
query65	3250	3176	3190	3176
query66	769	298	302	298
query67	16253	15149	15380	15149
query68	4630	582	579	579
query69	426	263	260	260
query70	1192	1150	1084	1084
query71	351	246	261	246
query72	6442	3871	4043	3871
query73	759	348	336	336
query74	10254	8901	8915	8901
query75	3405	2645	2648	2645
query76	2364	1007	1004	1004
query77	394	287	305	287
query78	10623	9522	9457	9457
query79	9637	588	596	588
query80	2381	422	430	422
query81	578	247	244	244
query82	1487	114	118	114
query83	296	159	159	159
query84	295	83	76	76
query85	1964	314	302	302
query86	464	310	307	307
query87	4359	4252	4300	4252
query88	5510	2419	2434	2419
query89	560	302	287	287
query90	2102	183	190	183
query91	185	147	147	147
query92	62	49	50	49
query93	8015	542	540	540
query94	971	299	285	285
query95	360	250	248	248
query96	636	279	293	279
query97	3305	3109	3151	3109
query98	224	195	191	191
query99	1730	1304	1304	1304
Total cold run time: 320510 ms
Total hot run time: 193503 ms

@dataroaring dataroaring merged commit a572247 into apache:branch-3.0 Nov 7, 2024
@DarvenDuan DarvenDuan deleted the branch-3.0-cherry-41815 branch December 10, 2024 11:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants