Skip to content

[Enhancement] reject schema change on hidden columns #53376

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
starocean999 merged 1 commit into from
Jul 24, 2025
Merged

[Enhancement] reject schema change on hidden columns #53376

starocean999 merged 1 commit into from
Jul 24, 2025

Conversation

@codeDing18
Copy link
Contributor

@codeDing18 codeDing18 commented Jul 16, 2025

What problem does this PR solve?

Issue Number: close #53019

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

hello-stephen commented Jul 16, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@codeDing18
Copy link
Contributor Author

codeDing18 commented Jul 16, 2025

run buildall

@codeDing18
Copy link
Contributor Author

codeDing18 commented Jul 16, 2025

run buildall

@codeDing18
Copy link
Contributor Author

codeDing18 commented Jul 16, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Jul 16, 2025

TPC-H: Total hot run time: 35504 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b13e4268a30a1a698fdaee49c32fa4b28dd14685, data reload: false

------ Round 1 ----------------------------------
q1	17597	5412	5227	5227
q2	1936	286	179	179
q3	10302	1385	734	734
q4	10231	1054	554	554
q5	7524	2541	2594	2541
q6	208	178	131	131
q7	1008	775	622	622
q8	9328	1532	1219	1219
q9	6848	5288	5259	5259
q10	7013	2434	1981	1981
q11	493	294	278	278
q12	355	388	217	217
q13	17768	3793	3159	3159
q14	240	229	222	222
q15	566	482	469	469
q16	430	443	371	371
q17	629	922	361	361
q18	7410	7249	7189	7189
q19	1315	1105	604	604
q20	335	379	222	222
q21	4214	3326	3006	3006
q22	1073	1009	959	959
Total cold run time: 106823 ms
Total hot run time: 35504 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5523	5352	5343	5343
q2	260	329	217	217
q3	2216	2700	2335	2335
q4	1369	1798	1335	1335
q5	4656	4615	4451	4451
q6	259	182	124	124
q7	2106	1929	1762	1762
q8	2846	2722	2829	2722
q9	7323	7330	7212	7212
q10	3193	3430	2957	2957
q11	643	533	496	496
q12	731	807	609	609
q13	3734	4037	3401	3401
q14	294	314	290	290
q15	542	479	468	468
q16	495	497	438	438
q17	1236	1784	1442	1442
q18	7914	7835	7563	7563
q19	849	877	1141	877
q20	1993	1987	1833	1833
q21	4838	4465	4365	4365
q22	1083	1051	955	955
Total cold run time: 54103 ms
Total hot run time: 51195 ms

@doris-robot
Copy link

doris-robot commented Jul 16, 2025

TPC-DS: Total hot run time: 187248 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b13e4268a30a1a698fdaee49c32fa4b28dd14685, data reload: false

query1	992	395	408	395
query2	6498	1690	1724	1690
query3	6744	213	211	211
query4	26090	23436	23044	23044
query5	4389	585	425	425
query6	299	204	196	196
query7	4617	498	275	275
query8	270	227	200	200
query9	8608	2643	2619	2619
query10	474	347	290	290
query11	15617	15166	14787	14787
query12	152	108	105	105
query13	1641	525	404	404
query14	8692	5939	5987	5939
query15	227	202	182	182
query16	7342	637	470	470
query17	1215	718	611	611
query18	2006	408	308	308
query19	203	192	166	166
query20	124	112	110	110
query21	214	123	106	106
query22	4298	4242	4392	4242
query23	34300	33247	33328	33247
query24	8491	2415	2354	2354
query25	527	453	382	382
query26	1221	269	145	145
query27	2757	505	329	329
query28	4324	2171	2107	2107
query29	804	559	478	478
query30	287	231	184	184
query31	901	819	763	763
query32	71	64	63	63
query33	577	361	313	313
query34	795	833	523	523
query35	820	840	763	763
query36	974	1007	899	899
query37	113	102	79	79
query38	4242	4159	4182	4159
query39	1499	1447	1628	1447
query40	209	114	102	102
query41	55	57	51	51
query42	119	102	105	102
query43	513	525	477	477
query44	1317	822	812	812
query45	176	170	164	164
query46	844	1004	618	618
query47	1770	1843	1744	1744
query48	380	417	302	302
query49	729	470	369	369
query50	655	692	424	424
query51	5583	5499	5594	5499
query52	112	107	99	99
query53	223	260	182	182
query54	565	561	485	485
query55	85	82	80	80
query56	297	308	299	299
query57	1202	1205	1130	1130
query58	281	256	275	256
query59	2596	2677	2651	2651
query60	332	315	314	314
query61	161	119	118	118
query62	799	724	648	648
query63	225	194	184	184
query64	4345	1001	713	713
query65	4283	4252	4244	4244
query66	1150	424	308	308
query67	15990	15606	15488	15488
query68	8020	891	535	535
query69	477	310	271	271
query70	1198	1163	1129	1129
query71	463	314	296	296
query72	5609	4894	4944	4894
query73	742	669	360	360
query74	9181	8862	8684	8684
query75	3931	3147	2701	2701
query76	3742	1148	728	728
query77	776	388	284	284
query78	9952	10232	9362	9362
query79	2470	830	589	589
query80	610	493	435	435
query81	474	268	230	230
query82	419	128	100	100
query83	281	244	226	226
query84	293	100	82	82
query85	782	352	365	352
query86	335	327	256	256
query87	4398	4438	4309	4309
query88	3320	2259	2260	2259
query89	391	317	287	287
query90	1937	206	206	206
query91	139	143	107	107
query92	77	61	58	58
query93	1214	924	596	596
query94	678	404	297	297
query95	376	288	280	280
query96	500	565	276	276
query97	2726	2761	2698	2698
query98	235	207	210	207
query99	1457	1410	1281	1281
Total cold run time: 275614 ms
Total hot run time: 187248 ms

@doris-robot
Copy link

doris-robot commented Jul 16, 2025

ClickBench: Total hot run time: 32.79 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b13e4268a30a1a698fdaee49c32fa4b28dd14685, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.05
query3	0.24	0.08	0.07
query4	1.62	0.11	0.11
query5	0.45	0.43	0.41
query6	1.15	0.67	0.67
query7	0.02	0.01	0.02
query8	0.05	0.03	0.04
query9	0.59	0.50	0.51
query10	0.57	0.56	0.56
query11	0.16	0.11	0.11
query12	0.14	0.12	0.11
query13	0.63	0.61	0.61
query14	0.80	0.81	0.83
query15	0.90	0.88	0.87
query16	0.40	0.38	0.40
query17	1.09	1.09	1.06
query18	0.23	0.21	0.20
query19	1.95	1.90	1.86
query20	0.01	0.01	0.01
query21	15.40	0.86	0.54
query22	0.73	1.23	0.74
query23	14.81	1.40	0.60
query24	6.56	0.99	1.49
query25	0.48	0.18	0.06
query26	0.56	0.17	0.14
query27	0.06	0.05	0.06
query28	10.36	0.96	0.46
query29	12.58	3.94	3.33
query30	3.04	3.03	2.95
query31	2.81	0.58	0.38
query32	3.23	0.56	0.47
query33	3.15	3.19	3.23
query34	16.08	5.39	4.77
query35	4.73	4.82	4.87
query36	0.70	0.51	0.50
query37	0.09	0.06	0.07
query38	0.05	0.04	0.04
query39	0.03	0.03	0.03
query40	0.17	0.14	0.14
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.9 s
Total hot run time: 32.79 s

@codeDing18
Copy link
Contributor Author

codeDing18 commented Jul 16, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Jul 16, 2025

TPC-H: Total hot run time: 33908 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 747413bff98832d95bcde9edf29be090614511e9, data reload: false

------ Round 1 ----------------------------------
q1	17632	5223	5125	5125
q2	1924	277	181	181
q3	10318	1356	760	760
q4	10210	1012	510	510
q5	7530	2374	2297	2297
q6	183	164	126	126
q7	890	734	594	594
q8	9291	1292	1073	1073
q9	6807	5095	5179	5095
q10	6887	2383	1941	1941
q11	470	275	275	275
q12	345	349	215	215
q13	17771	3694	3076	3076
q14	227	227	208	208
q15	556	489	488	488
q16	426	439	376	376
q17	585	843	343	343
q18	7486	7202	7151	7151
q19	1230	929	542	542
q20	342	325	216	216
q21	3965	2566	2315	2315
q22	1043	1052	1001	1001
Total cold run time: 106118 ms
Total hot run time: 33908 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5172	5070	5095	5070
q2	242	328	227	227
q3	2194	2690	2309	2309
q4	1362	1800	1329	1329
q5	4260	4412	4576	4412
q6	218	165	123	123
q7	2032	1964	1775	1775
q8	2643	2700	2659	2659
q9	7315	7373	7224	7224
q10	3080	3284	2931	2931
q11	567	503	516	503
q12	687	789	630	630
q13	3715	4207	3312	3312
q14	288	304	263	263
q15	508	459	466	459
q16	469	512	471	471
q17	1184	1568	1395	1395
q18	7896	7649	7646	7646
q19	790	889	1051	889
q20	1996	2147	1979	1979
q21	5025	4706	4493	4493
q22	1071	1121	1033	1033
Total cold run time: 52714 ms
Total hot run time: 51132 ms

@doris-robot
Copy link

doris-robot commented Jul 16, 2025

TPC-DS: Total hot run time: 188015 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 747413bff98832d95bcde9edf29be090614511e9, data reload: false

query1	972	406	389	389
query2	6499	1733	1748	1733
query3	6749	210	211	210
query4	26459	23733	23362	23362
query5	4373	587	415	415
query6	298	211	217	211
query7	4621	499	285	285
query8	284	223	214	214
query9	8610	2626	2619	2619
query10	484	330	270	270
query11	15489	15103	14908	14908
query12	152	107	103	103
query13	1657	515	411	411
query14	9264	5914	5957	5914
query15	206	207	165	165
query16	7287	645	445	445
query17	1216	752	606	606
query18	2017	405	312	312
query19	201	200	165	165
query20	133	120	113	113
query21	217	125	106	106
query22	4340	4373	4684	4373
query23	34884	34042	33684	33684
query24	8416	2322	2353	2322
query25	532	467	391	391
query26	1214	268	142	142
query27	2719	505	340	340
query28	4257	2140	2113	2113
query29	747	566	428	428
query30	284	224	188	188
query31	948	836	757	757
query32	65	62	58	58
query33	542	344	326	326
query34	790	836	522	522
query35	787	814	742	742
query36	973	982	907	907
query37	98	96	71	71
query38	4235	4235	4121	4121
query39	1554	1438	1423	1423
query40	205	115	104	104
query41	55	55	53	53
query42	118	105	105	105
query43	502	512	472	472
query44	1351	823	823	823
query45	176	170	164	164
query46	832	989	623	623
query47	1779	1842	1762	1762
query48	392	409	318	318
query49	724	458	385	385
query50	641	687	395	395
query51	5664	5640	5397	5397
query52	110	99	93	93
query53	220	258	182	182
query54	557	556	484	484
query55	78	82	82	82
query56	303	308	294	294
query57	1180	1209	1140	1140
query58	267	270	252	252
query59	2673	2685	2536	2536
query60	329	319	295	295
query61	128	124	125	124
query62	794	719	657	657
query63	223	193	178	178
query64	4254	988	722	722
query65	4289	4210	4170	4170
query66	1119	398	303	303
query67	15980	16022	15598	15598
query68	8524	892	532	532
query69	463	315	266	266
query70	1214	1160	1099	1099
query71	449	319	281	281
query72	5652	4867	4962	4867
query73	737	663	346	346
query74	9238	9239	8683	8683
query75	3962	3216	2725	2725
query76	3695	1167	721	721
query77	803	381	279	279
query78	10027	10340	9401	9401
query79	2143	773	582	582
query80	625	498	466	466
query81	500	256	215	215
query82	449	124	94	94
query83	280	238	226	226
query84	288	108	95	95
query85	820	357	321	321
query86	384	305	299	299
query87	4469	4454	4435	4435
query88	3461	2263	2238	2238
query89	394	313	292	292
query90	1882	203	198	198
query91	131	148	111	111
query92	73	63	55	55
query93	1677	935	586	586
query94	678	423	304	304
query95	371	290	288	288
query96	500	584	281	281
query97	2736	2740	2664	2664
query98	225	204	212	204
query99	1442	1430	1286	1286
Total cold run time: 277808 ms
Total hot run time: 188015 ms

@doris-robot
Copy link

doris-robot commented Jul 16, 2025

ClickBench: Total hot run time: 32.45 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 747413bff98832d95bcde9edf29be090614511e9, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.05
query3	0.24	0.07	0.07
query4	1.62	0.10	0.11
query5	0.46	0.41	0.41
query6	1.15	0.65	0.68
query7	0.02	0.02	0.02
query8	0.05	0.04	0.03
query9	0.58	0.53	0.52
query10	0.58	0.56	0.57
query11	0.16	0.10	0.10
query12	0.15	0.12	0.12
query13	0.63	0.63	0.61
query14	0.82	0.81	0.82
query15	0.89	0.87	0.89
query16	0.39	0.39	0.39
query17	1.06	1.10	1.04
query18	0.23	0.22	0.21
query19	1.98	1.83	1.81
query20	0.01	0.01	0.02
query21	15.39	0.87	0.53
query22	0.75	1.18	0.69
query23	14.94	1.41	0.61
query24	7.27	1.11	0.82
query25	0.45	0.23	0.22
query26	0.56	0.17	0.15
query27	0.07	0.05	0.05
query28	9.59	0.89	0.46
query29	12.54	3.99	3.25
query30	3.09	2.95	2.94
query31	2.83	0.57	0.39
query32	3.23	0.56	0.46
query33	3.11	3.12	3.12
query34	16.16	5.38	4.77
query35	4.83	4.85	4.79
query36	0.67	0.50	0.49
query37	0.09	0.07	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.17	0.14	0.14
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.02
Total cold run time: 107.1 s
Total hot run time: 32.45 s

@hello-stephen
Copy link
Contributor

hello-stephen commented Jul 16, 2025

FE UT Coverage Report

Increment line coverage 0.00% (0/8) 🎉
Increment coverage report
Complete coverage report

@codeDing18
Copy link
Contributor Author

codeDing18 commented Jul 17, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Jul 17, 2025

TPC-H: Total hot run time: 34386 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit aaa19c7c391d963913e2cf7690aa810f3fb107ac, data reload: false

------ Round 1 ----------------------------------
q1	17592	5246	5223	5223
q2	1940	268	179	179
q3	10326	1333	704	704
q4	10211	1016	542	542
q5	7558	2446	2372	2372
q6	174	161	126	126
q7	909	765	610	610
q8	9321	1328	1145	1145
q9	7001	5145	5120	5120
q10	6883	2363	1986	1986
q11	475	293	272	272
q12	335	351	217	217
q13	17762	3781	3096	3096
q14	227	238	220	220
q15	554	485	483	483
q16	419	451	372	372
q17	596	894	348	348
q18	7588	7307	7251	7251
q19	1228	959	569	569
q20	337	346	223	223
q21	3904	2541	2392	2392
q22	1029	983	936	936
Total cold run time: 106369 ms
Total hot run time: 34386 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5158	5110	5119	5110
q2	247	332	222	222
q3	2206	2644	2340	2340
q4	1365	1857	1344	1344
q5	4243	4558	4549	4549
q6	219	168	129	129
q7	2044	1953	1824	1824
q8	2710	2787	2615	2615
q9	7331	7289	7574	7289
q10	3057	3300	2831	2831
q11	582	517	497	497
q12	705	772	629	629
q13	3668	4060	3446	3446
q14	307	311	292	292
q15	538	495	486	486
q16	485	512	448	448
q17	1243	1612	1401	1401
q18	7961	7863	7589	7589
q19	822	826	873	826
q20	2064	2165	2011	2011
q21	4954	4726	4566	4566
q22	1093	1073	1048	1048
Total cold run time: 53002 ms
Total hot run time: 51492 ms

@doris-robot
Copy link

doris-robot commented Jul 17, 2025

TPC-DS: Total hot run time: 187366 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit aaa19c7c391d963913e2cf7690aa810f3fb107ac, data reload: false

query1	996	389	429	389
query2	6514	1663	1704	1663
query3	6737	211	218	211
query4	26369	24027	23066	23066
query5	4358	579	442	442
query6	308	213	196	196
query7	4620	487	283	283
query8	251	222	205	205
query9	8614	2590	2593	2590
query10	484	325	266	266
query11	15283	15052	14888	14888
query12	147	108	103	103
query13	1638	528	384	384
query14	8655	5879	5876	5876
query15	208	204	166	166
query16	7128	644	478	478
query17	934	749	602	602
query18	1987	419	309	309
query19	200	193	162	162
query20	127	119	122	119
query21	210	124	109	109
query22	4397	4902	4628	4628
query23	35300	34059	33415	33415
query24	8239	2357	2389	2357
query25	605	460	401	401
query26	1228	260	142	142
query27	2641	497	343	343
query28	4368	2110	2089	2089
query29	793	564	421	421
query30	280	224	187	187
query31	927	829	773	773
query32	71	65	62	62
query33	551	353	304	304
query34	804	829	516	516
query35	774	815	727	727
query36	959	986	909	909
query37	108	97	75	75
query38	4144	4205	4095	4095
query39	1479	1446	1469	1446
query40	212	114	102	102
query41	57	54	50	50
query42	119	105	105	105
query43	469	515	481	481
query44	1310	828	818	818
query45	171	164	162	162
query46	828	1004	614	614
query47	1751	1794	1760	1760
query48	382	420	302	302
query49	722	441	383	383
query50	637	679	400	400
query51	5603	5562	5461	5461
query52	106	102	93	93
query53	219	253	191	191
query54	556	562	490	490
query55	84	80	79	79
query56	283	287	288	287
query57	1168	1203	1134	1134
query58	259	249	253	249
query59	2515	2616	2489	2489
query60	318	312	300	300
query61	124	118	122	118
query62	798	698	675	675
query63	212	182	180	180
query64	4352	983	701	701
query65	4302	4176	4172	4172
query66	1187	403	298	298
query67	16232	15683	15423	15423
query68	9436	889	506	506
query69	489	301	265	265
query70	1260	1119	1129	1119
query71	472	315	300	300
query72	5370	4865	4994	4865
query73	745	665	353	353
query74	9252	8910	8889	8889
query75	4427	3212	2673	2673
query76	3920	1150	726	726
query77	972	383	288	288
query78	10076	10303	9407	9407
query79	3410	783	555	555
query80	625	526	423	423
query81	457	256	222	222
query82	482	121	94	94
query83	284	258	245	245
query84	293	103	82	82
query85	772	390	313	313
query86	336	302	286	286
query87	4540	4620	4378	4378
query88	3031	2290	2243	2243
query89	431	317	284	284
query90	1955	207	201	201
query91	135	140	109	109
query92	68	60	57	57
query93	1938	915	567	567
query94	674	401	269	269
query95	376	288	293	288
query96	494	569	280	280
query97	2730	2736	2696	2696
query98	251	211	211	211
query99	1482	1403	1258	1258
Total cold run time: 279595 ms
Total hot run time: 187366 ms

@doris-robot
Copy link

doris-robot commented Jul 17, 2025

ClickBench: Total hot run time: 33.53 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit aaa19c7c391d963913e2cf7690aa810f3fb107ac, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.05	0.04
query3	0.25	0.08	0.07
query4	1.62	0.11	0.11
query5	0.43	0.43	0.42
query6	1.14	0.65	0.67
query7	0.02	0.01	0.02
query8	0.04	0.04	0.03
query9	0.61	0.52	0.51
query10	0.58	0.56	0.57
query11	0.16	0.12	0.10
query12	0.15	0.12	0.12
query13	0.64	0.61	0.60
query14	0.81	0.81	0.82
query15	0.91	0.88	0.87
query16	0.38	0.41	0.40
query17	1.04	1.04	1.11
query18	0.22	0.22	0.21
query19	1.92	1.82	1.88
query20	0.01	0.02	0.02
query21	15.38	0.88	0.54
query22	0.79	1.07	1.05
query23	14.66	1.34	0.62
query24	6.83	1.46	1.60
query25	0.54	0.14	0.14
query26	0.58	0.17	0.13
query27	0.07	0.06	0.06
query28	10.39	0.90	0.45
query29	12.61	3.99	3.29
query30	3.02	3.01	2.92
query31	2.81	0.59	0.40
query32	3.23	0.57	0.49
query33	3.06	3.14	3.18
query34	16.14	5.33	4.76
query35	4.91	4.83	4.91
query36	0.71	0.51	0.49
query37	0.09	0.07	0.07
query38	0.05	0.05	0.04
query39	0.04	0.03	0.02
query40	0.18	0.15	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 107.3 s
Total hot run time: 33.53 s

@codeDing18
Copy link
Contributor Author

codeDing18 commented Jul 17, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Jul 17, 2025

TPC-H: Total hot run time: 33592 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 20be5cdf40d96bd033fdc2950727aac9f1ac8a85, data reload: false

------ Round 1 ----------------------------------
q1	17557	5195	5065	5065
q2	1969	274	185	185
q3	10305	1250	721	721
q4	10242	995	525	525
q5	8061	2332	2273	2273
q6	177	155	132	132
q7	912	727	596	596
q8	9324	1230	1073	1073
q9	6946	5024	5054	5024
q10	6897	2352	1975	1975
q11	472	287	271	271
q12	336	344	218	218
q13	17755	3629	3064	3064
q14	223	227	218	218
q15	546	480	472	472
q16	423	443	369	369
q17	602	851	355	355
q18	7390	7146	6987	6987
q19	1358	950	556	556
q20	320	324	209	209
q21	3964	3177	2353	2353
q22	1047	1027	951	951
Total cold run time: 106826 ms
Total hot run time: 33592 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5161	5099	5080	5080
q2	242	317	218	218
q3	2199	2669	2248	2248
q4	1382	1766	1301	1301
q5	4175	4488	4428	4428
q6	201	166	126	126
q7	2000	2025	1753	1753
q8	2615	2583	2460	2460
q9	7200	7152	7308	7152
q10	3097	3271	2874	2874
q11	574	511	477	477
q12	656	795	645	645
q13	3573	3938	3312	3312
q14	303	304	281	281
q15	522	468	479	468
q16	681	489	449	449
q17	1149	1551	1385	1385
q18	7839	7866	7354	7354
q19	786	837	929	837
q20	2073	2125	1922	1922
q21	4958	4364	4226	4226
q22	1055	1028	968	968
Total cold run time: 52441 ms
Total hot run time: 49964 ms

@doris-robot
Copy link

doris-robot commented Jul 17, 2025

TPC-DS: Total hot run time: 185794 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 20be5cdf40d96bd033fdc2950727aac9f1ac8a85, data reload: false

query1	1015	374	396	374
query2	6531	1815	1774	1774
query3	6740	220	222	220
query4	26517	23333	22894	22894
query5	4367	567	432	432
query6	307	219	214	214
query7	4627	498	288	288
query8	312	224	219	219
query9	8611	2607	2615	2607
query10	492	367	264	264
query11	15884	14940	14777	14777
query12	152	108	99	99
query13	1634	509	399	399
query14	9429	5788	5784	5784
query15	202	202	170	170
query16	7590	629	473	473
query17	1194	702	585	585
query18	2021	395	300	300
query19	187	185	154	154
query20	122	113	118	113
query21	214	125	110	110
query22	4090	4257	4123	4123
query23	33867	32964	33020	32964
query24	8474	2360	2325	2325
query25	527	470	423	423
query26	1229	269	146	146
query27	2765	501	330	330
query28	4305	2129	2099	2099
query29	723	533	426	426
query30	281	214	180	180
query31	940	814	758	758
query32	71	63	63	63
query33	562	353	324	324
query34	792	845	511	511
query35	797	821	735	735
query36	963	985	929	929
query37	108	96	72	72
query38	4175	4175	4084	4084
query39	1491	1446	1417	1417
query40	215	124	108	108
query41	62	61	62	61
query42	124	107	104	104
query43	521	511	497	497
query44	1295	820	821	820
query45	185	175	166	166
query46	844	1028	636	636
query47	1777	1864	1774	1774
query48	379	414	314	314
query49	732	466	385	385
query50	621	686	470	470
query51	5578	5465	5337	5337
query52	115	107	93	93
query53	219	250	177	177
query54	576	575	508	508
query55	81	79	85	79
query56	308	308	293	293
query57	1190	1192	1146	1146
query58	265	253	256	253
query59	2670	2718	2583	2583
query60	330	325	300	300
query61	134	125	127	125
query62	804	728	661	661
query63	227	190	188	188
query64	4340	968	650	650
query65	4243	4157	4184	4157
query66	1062	411	319	319
query67	15761	15509	15699	15509
query68	7926	872	523	523
query69	473	311	275	275
query70	1235	1137	1151	1137
query71	405	326	316	316
query72	5543	4600	4672	4600
query73	641	572	349	349
query74	9243	9084	8644	8644
query75	3192	3191	2672	2672
query76	3275	1126	720	720
query77	497	369	302	302
query78	10002	10234	9338	9338
query79	1853	826	583	583
query80	660	520	442	442
query81	509	258	218	218
query82	185	118	92	92
query83	310	259	235	235
query84	265	111	89	89
query85	789	357	324	324
query86	379	333	295	295
query87	4389	4414	4282	4282
query88	2878	2273	2235	2235
query89	385	324	295	295
query90	1930	210	208	208
query91	147	138	111	111
query92	69	62	59	59
query93	1689	950	589	589
query94	690	418	295	295
query95	372	300	281	281
query96	493	559	282	282
query97	2687	2715	2629	2629
query98	226	219	228	219
query99	1323	1447	1283	1283
Total cold run time: 273626 ms
Total hot run time: 185794 ms

@codeDing18
Copy link
Contributor Author

codeDing18 commented Jul 17, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Jul 17, 2025

TPC-H: Total hot run time: 34355 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6b0ef6ca4a16415064092c72b627c11329145c73, data reload: false

------ Round 1 ----------------------------------
q1	17612	5304	5100	5100
q2	1929	281	185	185
q3	10320	1310	738	738
q4	10212	1016	523	523
q5	7553	2382	2375	2375
q6	187	162	136	136
q7	939	760	623	623
q8	9320	1378	1287	1287
q9	6763	5085	5125	5085
q10	6902	2382	1953	1953
q11	485	310	269	269
q12	360	355	223	223
q13	17763	3687	3136	3136
q14	231	231	212	212
q15	550	479	481	479
q16	428	449	370	370
q17	605	876	354	354
q18	7659	7138	7130	7130
q19	1203	982	568	568
q20	347	336	219	219
q21	3673	3195	2423	2423
q22	1056	988	967	967
Total cold run time: 106097 ms
Total hot run time: 34355 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5233	5162	5174	5162
q2	242	338	226	226
q3	2184	2671	2285	2285
q4	1394	1835	1379	1379
q5	4270	4650	4573	4573
q6	232	177	162	162
q7	2053	2011	1866	1866
q8	2711	2653	2615	2615
q9	7410	7259	7307	7259
q10	3161	3295	2916	2916
q11	575	517	520	517
q12	698	817	636	636
q13	3588	4036	3538	3538
q14	280	317	302	302
q15	530	513	482	482
q16	459	518	453	453
q17	1179	1633	1389	1389
q18	8122	7808	7559	7559
q19	833	836	843	836
q20	2072	2125	1957	1957
q21	5132	4607	4560	4560
q22	1176	1121	1048	1048
Total cold run time: 53534 ms
Total hot run time: 51720 ms

@doris-robot
Copy link

doris-robot commented Jul 17, 2025

TPC-DS: Total hot run time: 187918 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6b0ef6ca4a16415064092c72b627c11329145c73, data reload: false

query1	990	395	415	395
query2	6524	1697	1686	1686
query3	6748	216	218	216
query4	26359	23883	23134	23134
query5	4374	599	437	437
query6	294	203	191	191
query7	4629	522	284	284
query8	277	230	215	215
query9	8642	2626	2620	2620
query10	482	331	265	265
query11	15669	15169	14852	14852
query12	149	104	100	100
query13	1636	524	387	387
query14	8605	5945	5905	5905
query15	199	193	177	177
query16	7133	630	470	470
query17	964	715	611	611
query18	1987	397	312	312
query19	215	198	167	167
query20	126	119	120	119
query21	213	130	108	108
query22	4545	4829	4678	4678
query23	34959	34006	33199	33199
query24	8574	2366	2391	2366
query25	530	439	391	391
query26	1226	274	147	147
query27	2778	508	344	344
query28	4282	2154	2131	2131
query29	775	633	432	432
query30	285	216	181	181
query31	925	834	778	778
query32	71	67	61	61
query33	558	371	300	300
query34	815	834	518	518
query35	797	819	732	732
query36	967	1011	911	911
query37	113	99	75	75
query38	4212	4239	4148	4148
query39	1486	1458	1434	1434
query40	212	116	105	105
query41	55	55	50	50
query42	119	109	111	109
query43	498	490	476	476
query44	1334	828	830	828
query45	177	175	165	165
query46	832	1003	634	634
query47	1789	1808	1745	1745
query48	399	411	313	313
query49	705	473	382	382
query50	644	685	397	397
query51	5532	5559	5400	5400
query52	108	104	95	95
query53	214	248	190	190
query54	570	566	504	504
query55	86	79	81	79
query56	304	286	294	286
query57	1195	1183	1113	1113
query58	260	259	255	255
query59	2523	2670	2517	2517
query60	320	307	313	307
query61	129	123	157	123
query62	792	699	654	654
query63	223	186	188	186
query64	4380	984	653	653
query65	4354	4186	4176	4176
query66	1168	413	312	312
query67	16027	15633	15823	15633
query68	8267	886	528	528
query69	487	311	273	273
query70	1256	1156	1145	1145
query71	489	324	290	290
query72	5667	4897	4938	4897
query73	741	666	350	350
query74	9448	9158	8887	8887
query75	4026	3193	2716	2716
query76	3770	1169	727	727
query77	801	391	298	298
query78	10171	10133	9461	9461
query79	2963	804	578	578
query80	624	495	450	450
query81	499	251	223	223
query82	491	123	97	97
query83	288	256	228	228
query84	295	107	94	94
query85	880	353	316	316
query86	378	306	282	282
query87	4564	4596	4422	4422
query88	3452	2287	2233	2233
query89	398	316	285	285
query90	1838	216	210	210
query91	142	154	120	120
query92	77	62	58	58
query93	2312	938	591	591
query94	671	417	314	314
query95	379	295	279	279
query96	500	579	284	284
query97	2738	2794	2659	2659
query98	234	223	202	202
query99	1480	1420	1257	1257
Total cold run time: 279388 ms
Total hot run time: 187918 ms

@doris-robot
Copy link

doris-robot commented Jul 17, 2025

ClickBench: Total hot run time: 32.58 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6b0ef6ca4a16415064092c72b627c11329145c73, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.24	0.07	0.08
query4	1.62	0.11	0.10
query5	0.42	0.43	0.42
query6	1.15	0.66	0.67
query7	0.03	0.02	0.02
query8	0.04	0.03	0.04
query9	0.59	0.52	0.52
query10	0.58	0.57	0.57
query11	0.16	0.10	0.10
query12	0.15	0.11	0.12
query13	0.63	0.62	0.60
query14	0.82	0.83	0.83
query15	0.91	0.87	0.89
query16	0.39	0.39	0.39
query17	1.05	1.08	1.07
query18	0.23	0.22	0.21
query19	1.94	1.85	1.88
query20	0.01	0.01	0.02
query21	15.39	0.87	0.55
query22	0.77	1.18	0.70
query23	14.91	1.34	0.64
query24	6.60	2.06	0.83
query25	0.45	0.21	0.09
query26	0.67	0.16	0.13
query27	0.08	0.05	0.06
query28	9.61	0.91	0.44
query29	12.54	4.00	3.35
query30	3.07	2.98	2.92
query31	2.82	0.59	0.39
query32	3.24	0.55	0.49
query33	3.13	3.09	3.23
query34	16.09	5.39	4.78
query35	4.87	4.87	4.80
query36	0.69	0.52	0.49
query37	0.10	0.07	0.07
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.15	0.14
query41	0.08	0.02	0.02
query42	0.03	0.03	0.02
query43	0.03	0.04	0.03
Total cold run time: 106.5 s
Total hot run time: 32.58 s

codeDing18 added a commit to codeDing18/doris that referenced this pull request Aug 27, 2025
@codeDing18
branch-3.1: [Enhancement] reject schema change on hidden columns (apa…
9997b10 
…che#53376)

Issue Number: close apache#53019

picked from apache#53376
codeDing18 added a commit to codeDing18/doris that referenced this pull request Aug 27, 2025
@codeDing18
branch-3.0: [Enhancement] reject schema change on hidden columns (apa…
f69b59b 
…che#53376)

Issue Number: close apache#53019

picked from apache#53376
This was referenced Aug 27, 2025
Merged
Merged
codeDing18 added a commit to codeDing18/doris that referenced this pull request Aug 28, 2025
@codeDing18
branch-2.1: [Enhancement] reject schema change on hidden columns (apa…
64a5db8 
…che#53376)

Issue Number: close apache#53019

picked from apache#53376
codeDing18 added a commit to codeDing18/doris that referenced this pull request Aug 28, 2025
@codeDing18
branch-3.0: [Enhancement] reject schema change on hidden columns (apa…
270db46 
…che#53376)

Issue Number: close apache#53019

picked from apache#53376
codeDing18 added a commit to codeDing18/doris that referenced this pull request Aug 28, 2025
@codeDing18
branch-3.1: [Enhancement] reject schema change on hidden columns (apa…
b15e95d 
…che#53376)

Issue Number: close apache#53019

picked from apache#53376
codeDing18 added a commit to codeDing18/doris that referenced this pull request Aug 29, 2025
@codeDing18
branch-2.1: [Enhancement] reject schema change on hidden columns (apa…
69b6ccb 
…che#53376)

Issue Number: close apache#53019

picked from apache#53376
codeDing18 added a commit to codeDing18/doris that referenced this pull request Aug 29, 2025
@codeDing18
branch-3.1: [Enhancement] reject schema change on hidden columns (apa…
540f0d8 
…che#53376)

Issue Number: close apache#53019

picked from apache#53376
codeDing18 added a commit to codeDing18/doris that referenced this pull request Aug 29, 2025
@codeDing18
branch-3.0: [Enhancement] reject schema change on hidden columns (apa…
e196da3 
…che#53376)

Issue Number: close apache#53019

picked from apache#53376
codeDing18 added a commit to codeDing18/doris that referenced this pull request Aug 29, 2025
@codeDing18
branch-3.1: [Enhancement] reject schema change on hidden columns (apa…
2fcadbd 
…che#53376)

Issue Number: close apache#53019

picked from apache#53376
codeDing18 added a commit to codeDing18/doris that referenced this pull request Aug 29, 2025
@codeDing18
branch-3.0: [Enhancement] reject schema change on hidden columns (apa…
d1422b1 
…che#53376)

Issue Number: close apache#53019

picked from apache#53376
codeDing18 added a commit to codeDing18/doris that referenced this pull request Aug 29, 2025
@codeDing18
branch-2.1: [Enhancement] reject schema change on hidden columns (apa…
0fe0350 
…che#53376)

Issue Number: close apache#53019

picked from apache#53376
codeDing18 added a commit to codeDing18/doris that referenced this pull request Aug 29, 2025
@codeDing18
branch-3.1: [Enhancement] reject schema change on hidden columns (apa…
a891d3b 
…che#53376)

Issue Number: close apache#53019

picked from apache#53376
codeDing18 added a commit to codeDing18/doris that referenced this pull request Aug 29, 2025
@codeDing18
branch-3.0: [Enhancement] reject schema change on hidden columns (apa…
09ff624 
…che#53376)

Issue Number: close apache#53019

picked from apache#53376
codeDing18 added a commit to codeDing18/doris that referenced this pull request Aug 29, 2025
@codeDing18
branch-2.1: [Enhancement] reject schema change on hidden columns (apa…
5708caa 
…che#53376)

Issue Number: close apache#53019

picked from apache#53376
codeDing18 added a commit to codeDing18/doris that referenced this pull request Aug 30, 2025
@codeDing18
branch-3.1: [Enhancement] reject schema change on hidden columns (apa…
f95d23e 
…che#53376)

Issue Number: close apache#53019

picked from apache#53376
yiguolei pushed a commit that referenced this pull request Sep 3, 2025
@codeDing18
branch-2.1: [Enhancement] reject schema change on hidden columns (#53… (
f7e844b 
#55387)

Issue Number: close #53019

picked from #53376

### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [ ] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
apache/doris-website#1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
morrySnow pushed a commit that referenced this pull request Sep 4, 2025
@codeDing18
branch-3.1: [Enhancement] reject schema change on hidden columns #53376…
2623282 
… (#55385)

picked from #53376
dataroaring pushed a commit that referenced this pull request Sep 5, 2025
@codeDing18
branch-3.0: [Enhancement] reject schema change on hidden columns (#53… (
746b8c9 
#55386)

Issue Number: close #53019

picked from #53376
@morrySnow morrySnow mentioned this pull request Sep 22, 2025
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@starocean999 starocean999 starocean999 approved these changes

@morrySnow morrySnow Awaiting requested review from morrySnow

+1 more reviewer

@zddr zddr zddr approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.12-merged dev/3.0.9-merged dev/3.1.1-merged reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

[Enhancement] reject schema change on hidden columns

8 participants

@codeDing18 @hello-stephen @doris-robot @zddr @starocean999 @morrySnow @yiguolei @dataroaring