Skip to content

[Enhancement](nereids)implement TruncateTableCommand in nereids #50196

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
starocean999 merged 1 commit into from
May 12, 2025
Merged

[Enhancement](nereids)implement TruncateTableCommand in nereids #50196

starocean999 merged 1 commit into from
May 12, 2025

Conversation

@codeDing18
Copy link
Contributor

@codeDing18 codeDing18 commented Apr 19, 2025 •
edited
Loading

What problem does this PR solve?

Issue Number: close #42584

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Apr 19, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@codeDing18
Copy link
Contributor Author

codeDing18 commented Apr 19, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Apr 19, 2025

TPC-H: Total hot run time: 34120 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f275934849a6394c29f9ec5cedc85ff14e9fbf96, data reload: false

------ Round 1 ----------------------------------
q1	25980	4999	5038	4999
q2	2071	278	191	191
q3	10390	1224	703	703
q4	10244	1032	540	540
q5	7502	2401	2347	2347
q6	182	161	133	133
q7	894	737	604	604
q8	9324	1285	1053	1053
q9	6910	5209	5169	5169
q10	6801	2314	1886	1886
q11	463	290	266	266
q12	345	359	215	215
q13	17800	3678	3099	3099
q14	235	230	211	211
q15	546	486	485	485
q16	447	445	399	399
q17	599	858	352	352
q18	7791	7221	7250	7221
q19	1221	947	553	553
q20	329	337	222	222
q21	3906	3292	2482	2482
q22	1078	1026	990	990
Total cold run time: 115058 ms
Total hot run time: 34120 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5116	5114	5054	5054
q2	232	326	235	235
q3	2144	2618	2268	2268
q4	1408	1836	1393	1393
q5	4513	4450	4401	4401
q6	216	169	127	127
q7	1945	1891	1747	1747
q8	2592	2466	2431	2431
q9	7140	7149	7329	7149
q10	3003	3183	2730	2730
q11	567	510	501	501
q12	658	767	592	592
q13	3437	3823	3295	3295
q14	291	308	270	270
q15	531	473	466	466
q16	465	501	450	450
q17	1178	1598	1357	1357
q18	7679	7396	7319	7319
q19	790	819	925	819
q20	1956	2013	1865	1865
q21	5197	4622	4710	4622
q22	1094	1075	965	965
Total cold run time: 52152 ms
Total hot run time: 50056 ms

@doris-robot
Copy link

doris-robot commented Apr 19, 2025

TPC-DS: Total hot run time: 184947 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f275934849a6394c29f9ec5cedc85ff14e9fbf96, data reload: false

query1	1021	485	534	485
query2	6588	1778	1752	1752
query3	6762	219	217	217
query4	26830	23890	22917	22917
query5	4333	618	482	482
query6	301	218	198	198
query7	4640	486	283	283
query8	296	256	252	252
query9	8642	2505	2518	2505
query10	478	339	287	287
query11	15656	15206	14924	14924
query12	163	115	115	115
query13	1668	503	410	410
query14	9309	6121	6050	6050
query15	202	184	184	184
query16	7257	624	497	497
query17	1194	731	568	568
query18	1975	405	305	305
query19	196	190	157	157
query20	125	125	119	119
query21	211	123	103	103
query22	4154	4212	4019	4019
query23	34018	32973	33173	32973
query24	8448	2361	2389	2361
query25	536	445	393	393
query26	1233	265	149	149
query27	2759	491	322	322
query28	4335	2079	2070	2070
query29	770	557	415	415
query30	288	221	188	188
query31	968	843	760	760
query32	73	66	61	61
query33	550	374	320	320
query34	795	860	507	507
query35	797	800	724	724
query36	975	986	905	905
query37	120	102	72	72
query38	4068	4158	4028	4028
query39	1463	1406	1397	1397
query40	210	121	107	107
query41	68	58	60	58
query42	121	106	102	102
query43	491	501	450	450
query44	1252	800	786	786
query45	178	178	169	169
query46	831	1006	615	615
query47	1779	1835	1742	1742
query48	362	400	290	290
query49	758	517	411	411
query50	647	661	394	394
query51	4241	4308	4073	4073
query52	114	111	108	108
query53	228	259	181	181
query54	562	561	497	497
query55	81	81	82	81
query56	292	293	278	278
query57	1162	1159	1082	1082
query58	262	262	249	249
query59	2546	2643	2602	2602
query60	338	308	301	301
query61	130	130	128	128
query62	781	723	694	694
query63	223	184	186	184
query64	4406	1031	676	676
query65	4368	4201	4285	4201
query66	1145	414	312	312
query67	15651	15622	15461	15461
query68	7969	872	509	509
query69	451	303	257	257
query70	1206	1129	1101	1101
query71	457	311	302	302
query72	5273	4701	4738	4701
query73	696	579	339	339
query74	9012	9100	8625	8625
query75	3849	3229	2645	2645
query76	3675	1185	742	742
query77	791	381	288	288
query78	10143	10015	9380	9380
query79	2285	796	562	562
query80	575	497	442	442
query81	478	257	220	220
query82	469	129	101	101
query83	285	247	234	234
query84	296	103	82	82
query85	785	349	311	311
query86	403	309	280	280
query87	4379	4391	4257	4257
query88	3653	2178	2178	2178
query89	382	307	275	275
query90	1866	213	210	210
query91	143	145	110	110
query92	84	63	56	56
query93	1679	949	573	573
query94	680	420	273	273
query95	374	292	278	278
query96	487	558	270	270
query97	3182	3246	3137	3137
query98	231	207	208	207
query99	1427	1442	1296	1296
Total cold run time: 275089 ms
Total hot run time: 184947 ms

@doris-robot
Copy link

doris-robot commented Apr 19, 2025

ClickBench: Total hot run time: 29.2 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f275934849a6394c29f9ec5cedc85ff14e9fbf96, data reload: false

query1	0.04	0.04	0.03
query2	0.11	0.11	0.10
query3	0.25	0.19	0.19
query4	1.59	0.19	0.19
query5	0.60	0.58	0.58
query6	1.18	0.71	0.72
query7	0.03	0.02	0.02
query8	0.04	0.04	0.04
query9	0.58	0.53	0.50
query10	0.57	0.56	0.56
query11	0.15	0.11	0.10
query12	0.14	0.11	0.11
query13	0.61	0.60	0.59
query14	1.16	1.15	1.19
query15	0.88	0.86	0.87
query16	0.39	0.37	0.37
query17	1.03	1.03	1.04
query18	0.22	0.21	0.19
query19	1.97	1.76	1.81
query20	0.02	0.01	0.01
query21	15.41	0.94	0.56
query22	0.75	1.20	0.64
query23	14.93	1.39	0.62
query24	7.98	0.99	0.33
query25	0.47	0.11	0.14
query26	0.68	0.16	0.14
query27	0.05	0.06	0.05
query28	9.71	0.88	0.45
query29	12.61	4.04	3.35
query30	0.25	0.09	0.06
query31	2.83	0.60	0.40
query32	3.22	0.54	0.47
query33	3.00	3.08	3.13
query34	15.81	5.13	4.51
query35	4.63	4.53	4.53
query36	0.66	0.51	0.49
query37	0.08	0.06	0.06
query38	0.06	0.04	0.04
query39	0.03	0.02	0.02
query40	0.16	0.14	0.13
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 105.04 s
Total hot run time: 29.2 s

@codeDing18 codeDing18 force-pushed the truncate-table-nereids branch from f275934 to b12efe8 Compare April 23, 2025 02:04
@codeDing18
Copy link
Contributor Author

codeDing18 commented Apr 23, 2025

run buildall

@codeDing18
Copy link
Contributor Author

codeDing18 commented Apr 23, 2025

@starocean999 PTAL Thanks

@doris-robot
Copy link

doris-robot commented Apr 23, 2025

TPC-H: Total hot run time: 33936 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b12efe85ebf673eb84b7988ce3ceb188b09fbed6, data reload: false

------ Round 1 ----------------------------------
q1	26282	5032	5011	5011
q2	2068	270	182	182
q3	10400	1272	717	717
q4	10243	1002	531	531
q5	7541	2395	2352	2352
q6	187	166	133	133
q7	924	742	614	614
q8	9324	1268	1115	1115
q9	6770	5117	5123	5117
q10	6871	2319	1902	1902
q11	482	275	270	270
q12	357	352	222	222
q13	17786	3718	3070	3070
q14	237	224	203	203
q15	550	480	478	478
q16	452	452	402	402
q17	587	846	360	360
q18	7834	7147	7089	7089
q19	2274	1082	555	555
q20	339	325	217	217
q21	4271	3389	2425	2425
q22	1068	1051	971	971
Total cold run time: 116847 ms
Total hot run time: 33936 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5484	5047	5120	5047
q2	241	327	231	231
q3	2145	2653	2260	2260
q4	1387	1778	1479	1479
q5	4470	4436	4388	4388
q6	215	174	135	135
q7	2041	1948	1803	1803
q8	2618	2562	2583	2562
q9	7319	7055	7177	7055
q10	3004	3158	2751	2751
q11	602	524	487	487
q12	675	777	623	623
q13	3491	3912	3360	3360
q14	272	292	271	271
q15	538	489	494	489
q16	473	523	463	463
q17	1161	1619	1363	1363
q18	7717	7636	7560	7560
q19	798	853	929	853
q20	1923	1996	1840	1840
q21	5219	4901	4796	4796
q22	1052	1068	1022	1022
Total cold run time: 52845 ms
Total hot run time: 50838 ms

@doris-robot
Copy link

doris-robot commented Apr 23, 2025

TPC-DS: Total hot run time: 192191 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b12efe85ebf673eb84b7988ce3ceb188b09fbed6, data reload: false

query1	1402	1070	1067	1067
query2	6237	1765	1762	1762
query3	11019	4476	4556	4476
query4	53703	25830	22960	22960
query5	5142	507	457	457
query6	334	193	192	192
query7	4873	490	286	286
query8	313	262	245	245
query9	5939	2569	2583	2569
query10	429	320	253	253
query11	15126	15019	14890	14890
query12	165	107	102	102
query13	1042	494	373	373
query14	10055	6503	6415	6415
query15	216	200	174	174
query16	7094	633	487	487
query17	1107	750	590	590
query18	1537	412	329	329
query19	209	199	166	166
query20	134	130	130	130
query21	209	130	115	115
query22	4429	4557	4401	4401
query23	34168	33521	33405	33405
query24	6670	2491	2446	2446
query25	456	470	399	399
query26	699	284	159	159
query27	2321	494	342	342
query28	3229	2172	2170	2170
query29	585	560	435	435
query30	275	217	190	190
query31	847	912	804	804
query32	79	61	61	61
query33	446	362	304	304
query34	793	859	510	510
query35	801	848	788	788
query36	948	1001	897	897
query37	115	106	78	78
query38	4115	4258	4210	4210
query39	1534	1445	1444	1444
query40	216	125	105	105
query41	61	56	55	55
query42	124	108	105	105
query43	509	513	480	480
query44	1351	866	841	841
query45	189	177	168	168
query46	855	1034	633	633
query47	1829	1867	1753	1753
query48	385	427	310	310
query49	683	506	443	443
query50	650	685	413	413
query51	4263	4325	4144	4144
query52	114	104	100	100
query53	229	272	186	186
query54	561	566	519	519
query55	85	85	88	85
query56	304	309	291	291
query57	1215	1189	1118	1118
query58	270	250	270	250
query59	2687	2772	2650	2650
query60	322	317	308	308
query61	144	127	151	127
query62	752	716	667	667
query63	233	190	191	190
query64	1738	1059	709	709
query65	4466	4335	4325	4325
query66	721	394	300	300
query67	15723	15500	15420	15420
query68	7418	899	557	557
query69	528	287	268	268
query70	1200	1076	1122	1076
query71	490	328	298	298
query72	6025	4842	5068	4842
query73	1444	668	346	346
query74	9257	8816	8658	8658
query75	3836	3193	2719	2719
query76	4204	1187	777	777
query77	631	369	281	281
query78	10078	10310	9205	9205
query79	2208	805	572	572
query80	572	504	453	453
query81	487	260	215	215
query82	440	179	99	99
query83	242	249	223	223
query84	288	111	83	83
query85	788	362	316	316
query86	390	313	299	299
query87	4341	4489	4283	4283
query88	3533	2235	2208	2208
query89	400	312	279	279
query90	1765	207	214	207
query91	143	205	116	116
query92	71	57	52	52
query93	1812	943	576	576
query94	645	423	298	298
query95	367	294	279	279
query96	483	558	275	275
query97	3155	3239	3107	3107
query98	231	212	195	195
query99	1386	1391	1253	1253
Total cold run time: 298332 ms
Total hot run time: 192191 ms

@doris-robot
Copy link

doris-robot commented Apr 23, 2025

ClickBench: Total hot run time: 29.27 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b12efe85ebf673eb84b7988ce3ceb188b09fbed6, data reload: false

query1	0.03	0.04	0.04
query2	0.12	0.10	0.11
query3	0.25	0.20	0.20
query4	1.58	0.20	0.20
query5	0.60	0.63	0.59
query6	1.18	0.73	0.72
query7	0.02	0.02	0.02
query8	0.04	0.04	0.03
query9	0.56	0.51	0.50
query10	0.57	0.57	0.56
query11	0.15	0.11	0.10
query12	0.14	0.11	0.12
query13	0.61	0.59	0.60
query14	1.13	1.21	1.16
query15	0.89	0.85	0.84
query16	0.37	0.37	0.37
query17	1.01	1.01	1.02
query18	0.21	0.21	0.20
query19	1.86	1.80	1.78
query20	0.01	0.02	0.01
query21	15.39	0.89	0.54
query22	0.75	1.04	0.73
query23	15.00	1.37	0.63
query24	7.31	0.97	0.53
query25	0.53	0.27	0.08
query26	0.57	0.15	0.13
query27	0.05	0.05	0.05
query28	9.40	0.87	0.43
query29	12.53	3.97	3.30
query30	0.25	0.08	0.07
query31	2.84	0.59	0.38
query32	3.22	0.55	0.46
query33	3.04	3.04	3.11
query34	15.75	5.05	4.48
query35	4.52	4.53	4.48
query36	0.65	0.49	0.48
query37	0.08	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.19	0.14	0.14
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 103.63 s
Total hot run time: 29.27 s

@codeDing18 codeDing18 force-pushed the truncate-table-nereids branch from b12efe8 to e79ad1e Compare May 7, 2025 13:03
@codeDing18
Copy link
Contributor Author

codeDing18 commented May 7, 2025

run buildall

@codeDing18 codeDing18 force-pushed the truncate-table-nereids branch 2 times, most recently from 4649251 to ff78ead Compare May 7, 2025 13:30
@codeDing18
Copy link
Contributor Author

codeDing18 commented May 7, 2025

run buildall

@doris-robot
Copy link

doris-robot commented May 7, 2025

TPC-H: Total hot run time: 33940 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ff78eadecdc32209303fa6e86c04cc99082d3648, data reload: false

------ Round 1 ----------------------------------
q1	26444	5042	5033	5033
q2	2079	276	189	189
q3	10572	1253	686	686
q4	10284	983	547	547
q5	9242	2399	2394	2394
q6	275	160	134	134
q7	896	741	597	597
q8	9305	1260	1068	1068
q9	6783	5083	5045	5045
q10	6807	2295	1886	1886
q11	500	291	271	271
q12	351	346	210	210
q13	17803	3665	3069	3069
q14	223	225	206	206
q15	537	490	500	490
q16	432	428	369	369
q17	593	861	364	364
q18	7589	7227	7159	7159
q19	1398	956	552	552
q20	343	348	233	233
q21	4087	3400	2486	2486
q22	1047	1022	952	952
Total cold run time: 117590 ms
Total hot run time: 33940 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5092	5063	5126	5063
q2	243	325	232	232
q3	2167	2664	2323	2323
q4	1404	1879	1601	1601
q5	4536	4462	4351	4351
q6	207	164	122	122
q7	1940	1924	1739	1739
q8	2563	2489	2513	2489
q9	7099	7084	7068	7068
q10	3005	3199	2733	2733
q11	569	499	515	499
q12	676	747	620	620
q13	3610	3837	3283	3283
q14	273	289	276	276
q15	510	465	470	465
q16	450	489	445	445
q17	1150	1495	1391	1391
q18	7574	7463	7389	7389
q19	801	786	828	786
q20	2006	2012	1854	1854
q21	5068	4653	4593	4593
q22	1074	1051	988	988
Total cold run time: 52017 ms
Total hot run time: 50310 ms

@doris-robot
Copy link

doris-robot commented May 7, 2025

TPC-DS: Total hot run time: 182583 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ff78eadecdc32209303fa6e86c04cc99082d3648, data reload: false

query1	1018	471	506	471
query2	6594	1812	1808	1808
query3	6751	229	217	217
query4	26614	23826	22892	22892
query5	4308	621	469	469
query6	279	212	189	189
query7	4619	492	289	289
query8	298	251	235	235
query9	8611	2522	2545	2522
query10	476	307	264	264
query11	15684	15375	14890	14890
query12	171	110	107	107
query13	1659	540	413	413
query14	9553	6174	6128	6128
query15	199	200	177	177
query16	7246	643	469	469
query17	1197	740	604	604
query18	1983	423	319	319
query19	197	185	159	159
query20	122	116	119	116
query21	217	124	108	108
query22	4028	4149	3948	3948
query23	33842	32858	32947	32858
query24	8525	2398	2386	2386
query25	569	482	429	429
query26	1277	274	153	153
query27	2734	488	333	333
query28	4326	2053	2039	2039
query29	743	546	419	419
query30	271	211	179	179
query31	938	850	768	768
query32	71	65	61	61
query33	550	381	302	302
query34	829	833	523	523
query35	787	809	727	727
query36	968	975	879	879
query37	108	97	74	74
query38	4255	4217	4126	4126
query39	1442	1383	1414	1383
query40	210	129	106	106
query41	67	52	58	52
query42	116	109	112	109
query43	488	499	457	457
query44	1303	783	786	783
query45	183	176	170	170
query46	829	1026	626	626
query47	1738	1805	1692	1692
query48	360	407	290	290
query49	787	483	435	435
query50	648	666	394	394
query51	4152	4079	4096	4079
query52	117	106	98	98
query53	222	257	188	188
query54	577	575	507	507
query55	86	83	86	83
query56	292	278	277	277
query57	1135	1133	1116	1116
query58	264	256	262	256
query59	2482	2694	2553	2553
query60	317	315	295	295
query61	130	148	124	124
query62	790	718	663	663
query63	224	184	177	177
query64	4372	1017	703	703
query65	4328	4205	4285	4205
query66	1140	403	311	311
query67	15698	15664	15274	15274
query68	8267	883	511	511
query69	470	305	269	269
query70	1180	1116	1034	1034
query71	470	308	343	308
query72	5341	4646	2355	2355
query73	712	576	348	348
query74	9223	9290	8794	8794
query75	3954	3184	2691	2691
query76	3703	1155	760	760
query77	784	351	283	283
query78	9924	10039	9248	9248
query79	4169	798	534	534
query80	645	510	441	441
query81	474	251	212	212
query82	572	127	97	97
query83	291	250	235	235
query84	290	111	82	82
query85	794	362	312	312
query86	335	304	369	304
query87	4440	4494	4300	4300
query88	3154	2213	2217	2213
query89	449	315	289	289
query90	1981	210	204	204
query91	139	142	112	112
query92	72	55	61	55
query93	2434	958	568	568
query94	684	404	308	308
query95	378	298	293	293
query96	474	557	273	273
query97	3145	3225	3141	3141
query98	243	211	209	209
query99	1442	1420	1344	1344
Total cold run time: 277747 ms
Total hot run time: 182583 ms

@doris-robot
Copy link

doris-robot commented May 7, 2025

ClickBench: Total hot run time: 28.74 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ff78eadecdc32209303fa6e86c04cc99082d3648, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.11	0.11
query3	0.26	0.20	0.20
query4	1.60	0.20	0.19
query5	0.61	0.59	0.59
query6	1.19	0.72	0.71
query7	0.02	0.02	0.02
query8	0.05	0.04	0.04
query9	0.57	0.51	0.51
query10	0.57	0.58	0.56
query11	0.16	0.10	0.11
query12	0.14	0.11	0.12
query13	0.62	0.60	0.60
query14	0.79	0.80	0.81
query15	0.90	0.86	0.86
query16	0.38	0.38	0.40
query17	1.05	1.01	1.06
query18	0.20	0.19	0.19
query19	1.97	1.77	1.75
query20	0.02	0.01	0.01
query21	15.42	0.92	0.55
query22	0.76	1.18	0.77
query23	14.83	1.36	0.62
query24	7.30	1.07	0.44
query25	0.48	0.07	0.08
query26	0.67	0.17	0.12
query27	0.05	0.05	0.05
query28	9.35	0.89	0.44
query29	12.55	3.88	3.22
query30	0.27	0.09	0.07
query31	2.83	0.60	0.39
query32	3.23	0.55	0.47
query33	3.08	3.01	2.98
query34	15.76	5.11	4.48
query35	4.59	4.56	4.52
query36	0.68	0.50	0.48
query37	0.08	0.07	0.06
query38	0.05	0.03	0.04
query39	0.04	0.03	0.02
query40	0.18	0.12	0.12
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.61 s
Total hot run time: 28.74 s

@codeDing18
Copy link
Contributor Author

codeDing18 commented May 8, 2025

run cloud_p0

@codeDing18 codeDing18 force-pushed the truncate-table-nereids branch from ff78ead to e6a303a Compare May 8, 2025 01:35
@codeDing18
Copy link
Contributor Author

codeDing18 commented May 8, 2025

run buildall

@doris-robot
Copy link

doris-robot commented May 8, 2025

TPC-H: Total hot run time: 33844 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e6a303afd5e0464bc318d3df66247da2f148fb69, data reload: false

------ Round 1 ----------------------------------
q1	25746	4993	4998	4993
q2	2057	272	182	182
q3	10418	1230	692	692
q4	10215	996	507	507
q5	7551	2275	2311	2275
q6	180	160	136	136
q7	898	754	607	607
q8	9316	1288	1118	1118
q9	6765	5082	5231	5082
q10	7031	2367	1951	1951
q11	475	289	274	274
q12	351	354	218	218
q13	17788	3643	3085	3085
q14	231	230	219	219
q15	525	492	504	492
q16	409	429	373	373
q17	585	851	359	359
q18	7333	7127	6973	6973
q19	1713	950	557	557
q20	332	311	225	225
q21	3995	2588	3089	2588
q22	1025	996	938	938
Total cold run time: 114939 ms
Total hot run time: 33844 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5084	5046	5028	5028
q2	241	318	224	224
q3	2105	2609	2286	2286
q4	1351	1770	1383	1383
q5	4351	4307	4379	4307
q6	220	167	129	129
q7	2011	1897	1758	1758
q8	2552	2528	2473	2473
q9	7304	7144	6837	6837
q10	2987	3163	2719	2719
q11	570	511	491	491
q12	671	775	595	595
q13	3505	3899	3251	3251
q14	291	310	272	272
q15	524	479	483	479
q16	445	469	420	420
q17	1116	1554	1354	1354
q18	7666	7474	7400	7400
q19	779	753	810	753
q20	1969	2020	1849	1849
q21	4942	4673	4620	4620
q22	1092	1019	1024	1019
Total cold run time: 51776 ms
Total hot run time: 49647 ms

@doris-robot
Copy link

doris-robot commented May 8, 2025

TPC-DS: Total hot run time: 191292 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e6a303afd5e0464bc318d3df66247da2f148fb69, data reload: false

query1	1435	1063	1062	1062
query2	6117	1799	1826	1799
query3	11027	4486	4490	4486
query4	56130	25439	22981	22981
query5	4943	525	442	442
query6	334	212	200	200
query7	4876	497	289	289
query8	324	254	225	225
query9	5220	2542	2551	2542
query10	421	313	260	260
query11	15134	15041	14802	14802
query12	158	109	100	100
query13	1009	505	383	383
query14	10123	6114	6179	6114
query15	231	196	176	176
query16	7090	661	509	509
query17	1060	734	565	565
query18	1548	418	308	308
query19	196	198	171	171
query20	127	129	153	129
query21	206	126	107	107
query22	4489	4446	4331	4331
query23	33908	33345	33525	33345
query24	6595	2406	2399	2399
query25	473	482	407	407
query26	686	281	151	151
query27	2398	507	345	345
query28	2897	2091	2096	2091
query29	601	589	452	452
query30	274	218	194	194
query31	856	864	792	792
query32	78	68	67	67
query33	448	371	317	317
query34	764	861	521	521
query35	789	833	744	744
query36	947	1000	897	897
query37	111	100	75	75
query38	4135	4306	4203	4203
query39	1493	1472	1472	1472
query40	213	125	113	113
query41	62	57	57	57
query42	119	112	105	105
query43	530	500	470	470
query44	1272	808	793	793
query45	177	175	171	171
query46	829	1027	664	664
query47	1865	1890	1813	1813
query48	378	421	318	318
query49	695	499	393	393
query50	646	687	415	415
query51	4217	4154	4234	4154
query52	114	101	97	97
query53	226	265	182	182
query54	577	577	506	506
query55	87	82	81	81
query56	293	304	299	299
query57	1173	1220	1105	1105
query58	261	259	280	259
query59	2666	2802	2604	2604
query60	330	336	310	310
query61	128	129	126	126
query62	717	740	682	682
query63	223	187	193	187
query64	1439	1020	708	708
query65	4355	4223	4247	4223
query66	733	396	328	328
query67	15739	15571	15351	15351
query68	8157	879	495	495
query69	532	301	253	253
query70	1178	1086	1138	1086
query71	488	319	312	312
query72	5825	4799	4828	4799
query73	1223	635	339	339
query74	9047	9137	8652	8652
query75	3891	3206	2701	2701
query76	4279	1200	742	742
query77	643	356	280	280
query78	9909	10106	9345	9345
query79	2028	813	548	548
query80	654	518	421	421
query81	470	261	216	216
query82	408	126	93	93
query83	360	248	237	237
query84	289	117	94	94
query85	779	359	318	318
query86	361	321	298	298
query87	4346	4451	4228	4228
query88	3465	2193	2249	2193
query89	399	333	278	278
query90	1945	206	206	206
query91	146	140	114	114
query92	73	57	53	53
query93	1748	962	568	568
query94	666	412	304	304
query95	372	287	281	281
query96	477	573	270	270
query97	3151	3233	3108	3108
query98	223	210	202	202
query99	1414	1372	1291	1291
Total cold run time: 298661 ms
Total hot run time: 191292 ms

@doris-robot
Copy link

doris-robot commented May 8, 2025

ClickBench: Total hot run time: 29.02 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e6a303afd5e0464bc318d3df66247da2f148fb69, data reload: false

query1	0.03	0.04	0.03
query2	0.13	0.11	0.11
query3	0.25	0.19	0.20
query4	1.59	0.20	0.20
query5	0.59	0.58	0.58
query6	1.20	0.71	0.73
query7	0.02	0.02	0.01
query8	0.04	0.04	0.04
query9	0.57	0.51	0.52
query10	0.56	0.58	0.57
query11	0.15	0.10	0.10
query12	0.14	0.10	0.11
query13	0.60	0.59	0.60
query14	0.79	0.81	0.81
query15	0.87	0.86	0.85
query16	0.40	0.38	0.39
query17	1.01	1.04	1.01
query18	0.21	0.19	0.19
query19	1.89	1.79	1.79
query20	0.01	0.01	0.02
query21	15.39	0.91	0.54
query22	0.75	1.20	0.70
query23	14.90	1.40	0.64
query24	6.85	2.01	0.60
query25	0.47	0.20	0.13
query26	0.54	0.16	0.13
query27	0.05	0.05	0.05
query28	9.50	0.88	0.44
query29	12.53	3.93	3.24
query30	0.26	0.09	0.06
query31	2.83	0.59	0.40
query32	3.23	0.54	0.46
query33	3.07	3.08	3.07
query34	16.10	5.11	4.51
query35	4.51	4.48	4.49
query36	0.66	0.51	0.48
query37	0.08	0.07	0.06
query38	0.05	0.05	0.04
query39	0.03	0.02	0.02
query40	0.16	0.14	0.13
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 103.15 s
Total hot run time: 29.02 s

@codeDing18
Copy link
Contributor Author

codeDing18 commented May 8, 2025

run cloud_p0

@codeDing18
Copy link
Contributor Author

codeDing18 commented May 8, 2025

run external

@codeDing18
Copy link
Contributor Author

codeDing18 commented May 9, 2025

run p0

@codeDing18
Copy link
Contributor Author

codeDing18 commented May 9, 2025

run feut

1 similar comment
@codeDing18
Copy link
Contributor Author

codeDing18 commented May 9, 2025

run feut

@codeDing18
Copy link
Contributor Author

codeDing18 commented May 9, 2025

run p0

@codeDing18
Copy link
Contributor Author

codeDing18 commented May 9, 2025

run cloud_p0

@codeDing18
Copy link
Contributor Author

codeDing18 commented May 9, 2025

run feut

1 similar comment
@codeDing18
Copy link
Contributor Author

codeDing18 commented May 9, 2025

run feut

@codeDing18
Copy link
Contributor Author

codeDing18 commented May 9, 2025

run cloud_p0

@codeDing18
Copy link
Contributor Author

codeDing18 commented May 10, 2025

run feut

@codeDing18
Copy link
Contributor Author

codeDing18 commented May 10, 2025

run cloud_p0

@codeDing18
Copy link
Contributor Author

codeDing18 commented May 10, 2025

run feut

starocean999
starocean999 approved these changes May 12, 2025
View reviewed changes
Copy link
Contributor

@starocean999 starocean999 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label May 12, 2025
@github-actions
Copy link
Contributor

github-actions bot commented May 12, 2025

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented May 12, 2025

PR approved by anyone and no changes requested.

dataroaring
dataroaring approved these changes May 12, 2025
View reviewed changes
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@starocean999 starocean999 changed the title [Enhancement] (nereids)implement TruncateTableCommand in nereids [Enhancement](nereids)implement TruncateTableCommand in nereids May 12, 2025
@starocean999 starocean999 merged commit c554b53 into apache:master May 12, 2025
24 of 27 checks passed
@codeDing18 codeDing18 deleted the truncate-table-nereids branch May 14, 2025 09:16
@wuwenchi wuwenchi mentioned this pull request May 15, 2025
Merged
16 tasks
hello-stephen pushed a commit that referenced this pull request May 15, 2025
@wuwenchi
[fix](iceberg)Table operations are not supported for catalogs of the …
345cbd2 
…dlf type for nereids (#50936)

### What problem does this PR solve?

followUp: #50696

Problem Summary:

conflict with #50196

Table operations are not supported for catalogs of the dlf type for
nereids.
koarz pushed a commit to koarz/doris that referenced this pull request Jun 4, 2025
@codeDing18 @koarz
[Enhancement](nereids)implement TruncateTableCommand in nereids (apac…
e5e0922 
…he#50196)

Issue Number: close
[apache#42584](apache#42584)
koarz pushed a commit to koarz/doris that referenced this pull request Jun 4, 2025
@wuwenchi @koarz
[fix](iceberg)Table operations are not supported for catalogs of the …
140caef 
…dlf type for nereids (apache#50936)

### What problem does this PR solve?

followUp: apache#50696

Problem Summary:

conflict with apache#50196

Table operations are not supported for catalogs of the dlf type for
nereids.
morningman pushed a commit to morningman/doris that referenced this pull request Jul 1, 2025
@codeDing18 @morningman
[Enhancement](nereids)implement TruncateTableCommand in nereids (apac…
424f0bc 
…he#50196)

Issue Number: close
[apache#42584](apache#42584)
morningman pushed a commit to morningman/doris that referenced this pull request Jul 1, 2025
@wuwenchi @morningman
[fix](iceberg)Table operations are not supported for catalogs of the …
2f68bc4 
…dlf type for nereids (apache#50936)

followUp: apache#50696

Problem Summary:

conflict with apache#50196

Table operations are not supported for catalogs of the dlf type for
nereids.
@morningman morningman mentioned this pull request Jul 1, 2025
Merged
morningman pushed a commit to morningman/doris that referenced this pull request Jul 1, 2025
@wuwenchi @morningman
[fix](iceberg)Table operations are not supported for catalogs of the …
2d11e21 
…dlf type for nereids (apache#50936)

followUp: apache#50696

Problem Summary:

conflict with apache#50196

Table operations are not supported for catalogs of the dlf type for
nereids.
morningman pushed a commit to morningman/doris that referenced this pull request Jul 3, 2025
@codeDing18 @morningman
[Enhancement](nereids)implement TruncateTableCommand in nereids (apac…
7df76e7 
…he#50196)

Issue Number: close
[apache#42584](apache#42584)
morningman pushed a commit to morningman/doris that referenced this pull request Jul 3, 2025
@wuwenchi @morningman
[fix](iceberg)Table operations are not supported for catalogs of the …
b027049 
…dlf type for nereids (apache#50936)

followUp: apache#50696

Problem Summary:

conflict with apache#50196

Table operations are not supported for catalogs of the dlf type for
nereids.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@starocean999 starocean999 starocean999 approved these changes

@dataroaring dataroaring dataroaring approved these changes

@CalvinKirs CalvinKirs Awaiting requested review from CalvinKirs CalvinKirs is a code owner

@morningman morningman Awaiting requested review from morningman morningman is a code owner

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

[Enhancement] (nereids)implement TruncateTableCommand in nereids

5 participants

@codeDing18 @Thearas @doris-robot @starocean999 @dataroaring