[improve](schema-change) support nested type with varchar type to support length growing #48025

amorynan · 2025-02-18T10:59:16Z

What problem does this PR solve?

cherry-pick from #46639
#48607
#49452 should be picked soon to resovle problem introduced by the pr
Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

hello-stephen · 2025-02-18T10:59:32Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

amorynan · 2025-02-18T10:59:35Z

run buildall

doris-robot · 2025-02-18T11:23:49Z

TPC-H: Total hot run time: 41443 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 87d516ff273e0d770aa9df67a085a0a6baca0284, data reload: false

------ Round 1 ----------------------------------
q1	17577	7340	7286	7286
q2	2058	175	162	162
q3	10542	1135	1211	1135
q4	10358	769	789	769
q5	7995	2975	2902	2902
q6	243	154	156	154
q7	1003	637	627	627
q8	10438	2017	2021	2017
q9	6789	6482	6460	6460
q10	7474	2345	2387	2345
q11	522	275	284	275
q12	409	213	206	206
q13	17767	2995	2998	2995
q14	237	208	208	208
q15	563	535	515	515
q16	693	594	590	590
q17	982	558	626	558
q18	7315	6705	6706	6705
q19	1487	1092	1093	1092
q20	476	212	203	203
q21	3959	3310	3268	3268
q22	1102	1017	971	971
Total cold run time: 109989 ms
Total hot run time: 41443 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7265	7195	7364	7195
q2	327	227	225	225
q3	3210	2968	2987	2968
q4	2052	1851	1832	1832
q5	5695	5650	5653	5650
q6	220	138	140	138
q7	2179	1842	1793	1793
q8	3328	3535	3468	3468
q9	8854	8853	8870	8853
q10	3649	3631	3592	3592
q11	581	493	515	493
q12	797	623	572	572
q13	3913	3204	3170	3170
q14	295	258	279	258
q15	571	520	524	520
q16	698	613	641	613
q17	1857	1631	1587	1587
q18	8137	7760	7582	7582
q19	1680	1556	1428	1428
q20	2072	1803	1824	1803
q21	5580	5118	5085	5085
q22	1126	1012	1004	1004
Total cold run time: 64086 ms
Total hot run time: 59829 ms

doris-robot · 2025-02-18T11:35:57Z

TPC-DS: Total hot run time: 192319 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 87d516ff273e0d770aa9df67a085a0a6baca0284, data reload: false

query1	986	371	375	371
query2	6531	2156	2089	2089
query3	6701	215	227	215
query4	34151	23511	23803	23511
query5	4332	466	459	459
query6	267	172	176	172
query7	4629	311	302	302
query8	270	219	217	217
query9	9822	2714	2693	2693
query10	483	255	252	252
query11	18056	15181	15197	15181
query12	154	103	101	101
query13	1638	431	417	417
query14	10034	7411	7383	7383
query15	259	181	181	181
query16	8139	424	471	424
query17	1614	578	559	559
query18	2154	319	311	311
query19	321	158	155	155
query20	120	108	109	108
query21	207	104	103	103
query22	4308	4333	4312	4312
query23	34398	33479	33706	33479
query24	11797	2821	2924	2821
query25	717	407	418	407
query26	1841	173	171	171
query27	2840	346	341	341
query28	7594	2425	2423	2423
query29	1077	464	445	445
query30	335	165	163	163
query31	1030	773	829	773
query32	104	60	61	60
query33	808	290	291	290
query34	966	498	520	498
query35	896	743	717	717
query36	1125	941	987	941
query37	182	79	75	75
query38	3984	3891	4002	3891
query39	1648	1446	1446	1446
query40	296	103	104	103
query41	54	53	50	50
query42	117	102	101	101
query43	550	495	468	468
query44	1300	822	812	812
query45	191	173	178	173
query46	1160	713	713	713
query47	1921	1825	1805	1805
query48	482	383	387	383
query49	1307	409	408	408
query50	835	411	403	403
query51	7259	7215	7018	7018
query52	112	96	93	93
query53	260	186	186	186
query54	1309	471	485	471
query55	82	78	82	78
query56	278	249	263	249
query57	1246	1127	1115	1115
query58	249	224	228	224
query59	3384	3228	3143	3143
query60	278	269	250	250
query61	109	119	113	113
query62	949	738	765	738
query63	220	188	184	184
query64	5183	673	635	635
query65	3293	3188	3205	3188
query66	1440	321	324	321
query67	16083	15597	15572	15572
query68	4647	567	564	564
query69	455	301	262	262
query70	1204	1123	1119	1119
query71	416	257	252	252
query72	6553	4239	4058	4058
query73	778	344	344	344
query74	10496	8992	9095	8992
query75	3350	2652	2664	2652
query76	2934	1056	1046	1046
query77	431	276	262	262
query78	10506	9715	9646	9646
query79	1486	604	583	583
query80	1084	443	415	415
query81	558	240	240	240
query82	941	135	116	116
query83	214	137	143	137
query84	237	81	86	81
query85	1321	300	284	284
query86	371	282	307	282
query87	4525	4272	4351	4272
query88	3566	2438	2402	2402
query89	409	289	299	289
query90	1978	190	181	181
query91	183	152	150	150
query92	67	51	56	51
query93	1077	549	548	548
query94	950	301	304	301
query95	357	263	260	260
query96	617	282	287	282
query97	3293	3195	3228	3195
query98	219	203	195	195
query99	1662	1449	1404	1404
Total cold run time: 303350 ms
Total hot run time: 192319 ms

doris-robot · 2025-02-18T11:41:28Z

ClickBench: Total hot run time: 33.07 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 87d516ff273e0d770aa9df67a085a0a6baca0284, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.02
query3	0.23	0.06	0.06
query4	1.62	0.10	0.10
query5	0.53	0.52	0.52
query6	1.14	0.72	0.72
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.55	0.50	0.52
query10	0.55	0.57	0.56
query11	0.16	0.11	0.10
query12	0.14	0.13	0.11
query13	0.61	0.61	0.60
query14	2.74	2.76	2.86
query15	0.89	0.82	0.82
query16	0.41	0.41	0.38
query17	1.05	1.06	1.05
query18	0.23	0.22	0.22
query19	1.83	1.84	2.04
query20	0.02	0.01	0.01
query21	15.35	0.60	0.57
query22	2.46	2.95	2.27
query23	17.08	0.99	0.80
query24	2.91	1.92	0.57
query25	0.36	0.18	0.14
query26	0.30	0.14	0.13
query27	0.06	0.05	0.04
query28	10.57	1.10	1.07
query29	12.59	3.28	3.20
query30	0.25	0.06	0.06
query31	2.85	0.38	0.40
query32	3.26	0.46	0.47
query33	3.00	2.99	3.01
query34	17.13	4.59	4.58
query35	4.55	4.55	4.56
query36	0.67	0.50	0.51
query37	0.10	0.06	0.07
query38	0.06	0.04	0.04
query39	0.03	0.03	0.03
query40	0.17	0.12	0.12
query41	0.07	0.02	0.02
query42	0.04	0.02	0.02
query43	0.03	0.02	0.03
Total cold run time: 106.76 s
Total hot run time: 33.07 s

amorynan · 2025-02-26T09:51:06Z

run buildall

doris-robot · 2025-02-26T10:32:53Z

TPC-H: Total hot run time: 40111 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6f3ca18c40f05f5ebbaabac1f985a431ea67ec3c, data reload: false

------ Round 1 ----------------------------------
q1	17578	6824	6653	6653
q2	2117	172	191	172
q3	10873	1099	1141	1099
q4	10558	795	804	795
q5	7759	2843	2792	2792
q6	222	137	134	134
q7	971	614	604	604
q8	9353	1927	1991	1927
q9	6654	6449	6406	6406
q10	7052	2263	2273	2263
q11	471	250	251	250
q12	401	215	211	211
q13	17827	3017	2995	2995
q14	235	221	205	205
q15	517	487	469	469
q16	659	599	575	575
q17	958	555	557	555
q18	7310	6681	6534	6534
q19	1404	1071	1016	1016
q20	495	206	198	198
q21	4131	3284	3270	3270
q22	1120	1026	988	988
Total cold run time: 108665 ms
Total hot run time: 40111 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6633	6662	6634	6634
q2	333	230	231	230
q3	2901	2796	2943	2796
q4	2043	1851	1820	1820
q5	5750	5695	5765	5695
q6	212	132	129	129
q7	2243	1910	1826	1826
q8	3388	3560	3523	3523
q9	8813	8881	8900	8881
q10	3593	3576	3557	3557
q11	583	492	510	492
q12	822	593	604	593
q13	8432	3244	3142	3142
q14	300	281	278	278
q15	508	462	467	462
q16	691	677	638	638
q17	1839	1634	1605	1605
q18	8295	7784	7654	7654
q19	1672	1534	1548	1534
q20	2052	1862	1870	1862
q21	5544	5382	5212	5212
q22	1163	1095	1006	1006
Total cold run time: 67810 ms
Total hot run time: 59569 ms

doris-robot · 2025-02-26T10:45:29Z

TPC-DS: Total hot run time: 197702 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6f3ca18c40f05f5ebbaabac1f985a431ea67ec3c, data reload: false

query1	1298	920	893	893
query2	6304	1964	1973	1964
query3	10954	4486	4328	4328
query4	60830	28778	23308	23308
query5	5197	458	461	458
query6	391	182	169	169
query7	5429	316	317	316
query8	312	229	225	225
query9	8514	2647	2624	2624
query10	457	269	257	257
query11	17808	15148	15924	15148
query12	156	108	108	108
query13	1474	439	446	439
query14	10408	7626	7294	7294
query15	203	181	182	181
query16	7119	475	502	475
query17	1168	614	602	602
query18	1971	355	325	325
query19	213	158	164	158
query20	116	111	110	110
query21	208	107	105	105
query22	4820	4633	4611	4611
query23	34470	33942	34276	33942
query24	6330	2967	2958	2958
query25	547	431	443	431
query26	665	172	173	172
query27	1836	354	361	354
query28	4097	2508	2441	2441
query29	722	485	441	441
query30	237	163	164	163
query31	970	824	818	818
query32	69	56	57	56
query33	470	301	290	290
query34	924	501	530	501
query35	858	753	713	713
query36	1096	954	951	951
query37	118	69	66	66
query38	4116	3988	3987	3987
query39	1515	1452	1480	1452
query40	208	101	101	101
query41	49	49	51	49
query42	119	105	101	101
query43	528	489	493	489
query44	1191	829	829	829
query45	190	164	167	164
query46	1128	736	734	734
query47	2035	1918	1935	1918
query48	499	379	400	379
query49	736	411	417	411
query50	836	446	453	446
query51	7129	7233	7149	7149
query52	107	94	101	94
query53	275	185	187	185
query54	579	486	476	476
query55	82	79	77	77
query56	269	247	255	247
query57	1299	1238	1194	1194
query58	226	204	221	204
query59	3219	2932	2917	2917
query60	274	257	254	254
query61	109	161	106	106
query62	759	668	685	668
query63	220	195	193	193
query64	1407	668	662	662
query65	3283	3199	3178	3178
query66	689	305	295	295
query67	15936	15561	15611	15561
query68	4342	601	582	582
query69	427	273	273	273
query70	1183	1075	1075	1075
query71	352	275	272	272
query72	6308	4147	3964	3964
query73	762	345	358	345
query74	10476	9184	9228	9184
query75	3393	2657	2642	2642
query76	1944	1086	1075	1075
query77	476	280	281	280
query78	10698	9638	9512	9512
query79	1990	604	615	604
query80	1270	426	423	423
query81	535	244	239	239
query82	1141	88	87	87
query83	167	148	142	142
query84	284	77	79	77
query85	988	313	284	284
query86	395	297	286	286
query87	4439	4354	4344	4344
query88	3686	2404	2371	2371
query89	419	289	292	289
query90	1970	189	195	189
query91	184	148	151	148
query92	65	51	51	51
query93	2650	560	548	548
query94	777	313	287	287
query95	356	260	262	260
query96	627	279	281	279
query97	3333	3184	3180	3180
query98	211	206	203	203
query99	1579	1306	1292	1292
Total cold run time: 315198 ms
Total hot run time: 197702 ms

doris-robot · 2025-02-26T10:50:57Z

ClickBench: Total hot run time: 31.64 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6f3ca18c40f05f5ebbaabac1f985a431ea67ec3c, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.03	0.03
query3	0.23	0.06	0.06
query4	1.63	0.11	0.11
query5	0.49	0.50	0.50
query6	1.13	0.73	0.73
query7	0.02	0.02	0.01
query8	0.04	0.04	0.03
query9	0.57	0.51	0.50
query10	0.55	0.54	0.56
query11	0.14	0.10	0.11
query12	0.14	0.12	0.11
query13	0.61	0.60	0.59
query14	2.86	2.78	2.77
query15	0.87	0.82	0.82
query16	0.39	0.38	0.40
query17	0.97	1.03	1.05
query18	0.23	0.23	0.22
query19	1.88	1.88	2.00
query20	0.02	0.01	0.01
query21	15.40	0.56	0.59
query22	2.65	2.86	1.14
query23	16.93	1.04	0.89
query24	3.00	1.38	0.90
query25	0.29	0.06	0.09
query26	0.49	0.14	0.13
query27	0.04	0.04	0.05
query28	10.20	0.49	0.52
query29	12.53	3.28	3.26
query30	0.25	0.06	0.06
query31	2.85	0.39	0.38
query32	3.25	0.46	0.45
query33	3.04	3.01	3.00
query34	17.02	4.55	4.49
query35	4.58	4.53	4.58
query36	0.67	0.51	0.52
query37	0.09	0.06	0.07
query38	0.05	0.03	0.04
query39	0.03	0.02	0.02
query40	0.16	0.12	0.12
query41	0.08	0.02	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.53 s
Total hot run time: 31.64 s

amorynan · 2025-02-26T13:29:55Z

run cloud_p0

amorynan · 2025-03-03T08:21:35Z

run buildall

amorynan · 2025-03-03T10:00:21Z

run p0

amorynan · 2025-03-05T14:43:03Z

run buildall

amorynan · 2025-03-10T03:27:13Z

run buildall

doris-robot · 2025-03-10T03:46:39Z

TPC-H: Total hot run time: 40817 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 274c64633dbf2f49bfb033cd381dfc717d9d4c7a, data reload: false

------ Round 1 ----------------------------------
q1	17651	6940	6608	6608
q2	2046	176	176	176
q3	10692	1148	1178	1148
q4	10664	771	715	715
q5	7865	2980	2854	2854
q6	225	134	133	133
q7	1009	636	607	607
q8	9701	1997	2081	1997
q9	6827	6588	6514	6514
q10	8675	2320	2311	2311
q11	475	266	276	266
q12	406	221	211	211
q13	18664	3050	3007	3007
q14	249	208	207	207
q15	509	465	488	465
q16	683	611	580	580
q17	986	627	543	543
q18	7402	6692	6696	6692
q19	1398	1104	1124	1104
q20	485	202	199	199
q21	4077	3536	3496	3496
q22	1089	993	984	984
Total cold run time: 111778 ms
Total hot run time: 40817 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6644	6602	6568	6568
q2	327	233	229	229
q3	3035	3068	2973	2973
q4	2070	1787	1860	1787
q5	5712	5770	5726	5726
q6	211	127	132	127
q7	2229	1833	1816	1816
q8	3376	3555	3477	3477
q9	8925	8986	8944	8944
q10	3615	3543	3552	3543
q11	584	491	490	490
q12	803	654	609	609
q13	3949	3186	3136	3136
q14	307	273	265	265
q15	509	472	477	472
q16	688	650	656	650
q17	1832	1612	1603	1603
q18	8387	7816	7569	7569
q19	1653	1572	1562	1562
q20	2045	1811	1826	1811
q21	5315	5188	5169	5169
q22	1110	1046	1008	1008
Total cold run time: 63326 ms
Total hot run time: 59534 ms

doris-robot · 2025-03-10T03:58:43Z

TPC-DS: Total hot run time: 191062 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 274c64633dbf2f49bfb033cd381dfc717d9d4c7a, data reload: false

query1	980	375	365	365
query2	6499	2058	1998	1998
query3	6701	213	217	213
query4	33514	23472	23710	23472
query5	4390	455	440	440
query6	273	177	172	172
query7	4624	306	317	306
query8	278	224	230	224
query9	9640	2597	2618	2597
query10	491	255	256	255
query11	18189	15264	15077	15077
query12	155	100	101	100
query13	1659	434	423	423
query14	9038	7353	7039	7039
query15	255	167	176	167
query16	8094	486	486	486
query17	1629	588	575	575
query18	2120	331	323	323
query19	255	160	160	160
query20	117	108	113	108
query21	205	102	103	102
query22	4428	4362	4393	4362
query23	34773	33789	33596	33596
query24	11740	2872	2826	2826
query25	671	415	416	415
query26	1643	169	169	169
query27	2938	342	343	342
query28	8070	2426	2397	2397
query29	863	451	450	450
query30	340	169	174	169
query31	1129	815	834	815
query32	101	66	61	61
query33	823	307	298	298
query34	930	501	530	501
query35	921	711	713	711
query36	1130	933	967	933
query37	168	71	70	70
query38	4035	3847	3860	3847
query39	1483	1430	1453	1430
query40	294	107	102	102
query41	50	50	50	50
query42	115	107	103	103
query43	523	492	493	492
query44	1287	798	805	798
query45	185	173	168	168
query46	1121	726	711	711
query47	1955	1828	1826	1826
query48	471	390	391	390
query49	1313	417	418	417
query50	811	422	413	413
query51	7164	7133	7064	7064
query52	107	92	91	91
query53	260	190	184	184
query54	1256	463	468	463
query55	80	79	82	79
query56	268	260	258	258
query57	1223	1129	1115	1115
query58	247	216	223	216
query59	3168	3008	2976	2976
query60	303	253	254	253
query61	149	106	121	106
query62	870	680	661	661
query63	220	197	190	190
query64	5227	657	632	632
query65	3298	3216	3165	3165
query66	1382	331	307	307
query67	16113	16087	15598	15598
query68	4721	565	571	565
query69	468	268	267	267
query70	1200	1050	1120	1050
query71	396	252	261	252
query72	6589	3757	4021	3757
query73	772	341	350	341
query74	10503	9138	9028	9028
query75	3506	2653	2631	2631
query76	2931	1156	1076	1076
query77	420	279	275	275
query78	10356	9728	9544	9544
query79	1340	597	592	592
query80	951	440	421	421
query81	550	234	241	234
query82	1174	90	91	90
query83	231	148	154	148
query84	242	82	82	82
query85	1297	307	288	288
query86	347	274	258	258
query87	4651	4305	4271	4271
query88	3551	2393	2348	2348
query89	409	294	298	294
query90	1924	197	187	187
query91	183	154	154	154
query92	59	51	50	50
query93	1057	552	547	547
query94	919	305	293	293
query95	370	250	261	250
query96	623	283	280	280
query97	3305	3207	3177	3177
query98	216	208	204	204
query99	1529	1302	1286	1286
Total cold run time: 301542 ms
Total hot run time: 191062 ms

doris-robot · 2025-03-10T04:04:10Z

ClickBench: Total hot run time: 31.77 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 274c64633dbf2f49bfb033cd381dfc717d9d4c7a, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.02	0.03
query3	0.23	0.07	0.07
query4	1.63	0.10	0.10
query5	0.52	0.49	0.53
query6	1.14	0.73	0.72
query7	0.02	0.02	0.02
query8	0.04	0.04	0.03
query9	0.58	0.51	0.50
query10	0.55	0.55	0.56
query11	0.14	0.10	0.11
query12	0.14	0.11	0.11
query13	0.62	0.60	0.60
query14	2.70	2.76	2.72
query15	0.89	0.83	0.83
query16	0.38	0.39	0.38
query17	0.96	1.04	1.00
query18	0.23	0.22	0.22
query19	1.98	1.89	1.97
query20	0.02	0.00	0.01
query21	15.35	0.60	0.61
query22	2.43	1.80	1.62
query23	16.94	1.22	0.77
query24	2.71	0.74	0.72
query25	0.28	0.15	0.14
query26	0.31	0.13	0.14
query27	0.05	0.05	0.05
query28	11.44	0.53	0.44
query29	12.55	3.21	3.24
query30	0.25	0.06	0.06
query31	2.87	0.39	0.38
query32	3.24	0.45	0.45
query33	3.01	3.00	3.05
query34	17.06	4.52	4.48
query35	4.56	4.58	4.54
query36	0.66	0.50	0.48
query37	0.09	0.07	0.06
query38	0.05	0.04	0.04
query39	0.04	0.02	0.02
query40	0.16	0.13	0.13
query41	0.08	0.03	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 107.07 s
Total hot run time: 31.77 s

…ache#48607) Related PR: introduce apache#46639 Problem Summary: After the change of apache#46639, shorten length for CHAR type escapes from checking of schema change. Fix in this PR and add some regression test cases to verify it.

amorynan · 2025-03-25T04:07:34Z

run buildall

fe/fe-core/src/main/java/org/apache/doris/catalog/ColumnType.java

amorynan · 2025-03-26T06:24:05Z

run buildall

doris-robot · 2025-03-26T07:03:11Z

TPC-H: Total hot run time: 40229 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cb6774aa49e8e62cfb6fd6301bdf5bc24879af12, data reload: false

------ Round 1 ----------------------------------
q1	17564	6987	6638	6638
q2	2057	176	180	176
q3	10561	1082	1181	1082
q4	10568	755	772	755
q5	7714	2872	2854	2854
q6	223	138	136	136
q7	960	629	607	607
q8	9357	1971	2037	1971
q9	6528	6377	6385	6377
q10	7015	2252	2264	2252
q11	479	267	262	262
q12	406	213	207	207
q13	17769	3014	3003	3003
q14	252	211	200	200
q15	491	457	459	457
q16	667	587	574	574
q17	967	565	574	565
q18	7126	6651	6688	6651
q19	1515	1060	981	981
q20	489	211	215	211
q21	4063	3273	3265	3265
q22	1127	1047	1005	1005
Total cold run time: 107898 ms
Total hot run time: 40229 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6696	6620	6564	6564
q2	333	239	234	234
q3	2996	2819	2969	2819
q4	2027	1764	1754	1754
q5	5772	5771	5786	5771
q6	213	130	131	130
q7	2223	1852	1813	1813
q8	3375	3558	3533	3533
q9	8815	8873	8802	8802
q10	3581	3526	3526	3526
q11	598	500	490	490
q12	850	614	595	595
q13	9230	3192	3207	3192
q14	320	277	262	262
q15	513	479	469	469
q16	689	652	636	636
q17	1850	1600	1598	1598
q18	8230	7944	7589	7589
q19	1686	1524	1492	1492
q20	2105	1842	1866	1842
q21	5556	5362	5321	5321
q22	1130	1069	1048	1048
Total cold run time: 68788 ms
Total hot run time: 59480 ms

amorynan · 2025-03-26T07:08:12Z

run buildall

doris-robot · 2025-03-26T07:41:04Z

TPC-H: Total hot run time: 39745 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a3405dd0f57e30849a5eeac73c2938ad8a083caf, data reload: false

------ Round 1 ----------------------------------
q1	17567	6711	6548	6548
q2	2056	186	179	179
q3	10618	1030	1150	1030
q4	10575	737	736	736
q5	7757	2879	2804	2804
q6	222	138	135	135
q7	993	609	593	593
q8	9500	1958	2009	1958
q9	6601	6425	6381	6381
q10	6986	2232	2308	2232
q11	474	270	260	260
q12	416	214	205	205
q13	17779	3023	2982	2982
q14	223	208	204	204
q15	500	469	479	469
q16	655	618	587	587
q17	962	682	559	559
q18	7135	6773	6584	6584
q19	1406	1061	1002	1002
q20	500	206	194	194
q21	3978	3225	3119	3119
q22	1081	984	1001	984
Total cold run time: 107984 ms
Total hot run time: 39745 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6559	6555	6556	6555
q2	327	234	235	234
q3	2877	2735	2855	2735
q4	2006	1869	1820	1820
q5	5866	5820	5799	5799
q6	213	131	128	128
q7	2256	1886	1868	1868
q8	3449	3585	3536	3536
q9	8926	8974	8986	8974
q10	3600	3571	3517	3517
q11	605	498	490	490
q12	812	606	606	606
q13	9039	3256	3200	3200
q14	297	267	265	265
q15	522	470	475	470
q16	688	640	669	640
q17	1823	1612	1624	1612
q18	8275	7724	7636	7636
q19	1669	1600	1629	1600
q20	2088	1879	1911	1879
q21	5525	5350	5192	5192
q22	1121	1087	1033	1033
Total cold run time: 68543 ms
Total hot run time: 59789 ms

doris-robot · 2025-03-26T07:53:39Z

TPC-DS: Total hot run time: 196567 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a3405dd0f57e30849a5eeac73c2938ad8a083caf, data reload: false

query1	1326	940	931	931
query2	6236	1971	2039	1971
query3	10964	4397	4491	4397
query4	65296	28671	23218	23218
query5	4984	451	428	428
query6	409	168	172	168
query7	5576	312	297	297
query8	293	218	224	218
query9	8900	2584	2559	2559
query10	463	265	259	259
query11	17509	15443	15860	15443
query12	154	108	104	104
query13	1506	423	426	423
query14	10415	7120	7376	7120
query15	198	184	177	177
query16	7199	477	499	477
query17	1103	585	579	579
query18	2145	314	304	304
query19	211	153	154	153
query20	117	110	107	107
query21	210	103	105	103
query22	4957	4526	4416	4416
query23	34117	34020	34218	34020
query24	6111	2884	2872	2872
query25	521	404	417	404
query26	659	165	161	161
query27	1842	343	345	343
query28	4752	2413	2425	2413
query29	686	455	430	430
query30	246	172	161	161
query31	1012	822	840	822
query32	64	54	57	54
query33	471	292	295	292
query34	917	519	508	508
query35	852	745	722	722
query36	1102	954	967	954
query37	112	67	70	67
query38	4020	4027	4073	4027
query39	1516	1659	1475	1475
query40	204	96	97	96
query41	48	49	54	49
query42	116	99	98	98
query43	515	480	485	480
query44	1180	807	803	803
query45	187	170	167	167
query46	1118	710	710	710
query47	1998	1921	1916	1916
query48	466	377	381	377
query49	757	388	377	377
query50	842	423	421	421
query51	7537	7305	6984	6984
query52	101	87	87	87
query53	256	176	180	176
query54	542	441	443	441
query55	76	78	73	73
query56	259	246	231	231
query57	1251	1117	1078	1078
query58	208	200	204	200
query59	3295	3047	2833	2833
query60	283	261	243	243
query61	122	118	104	104
query62	768	674	653	653
query63	220	186	183	183
query64	1374	681	634	634
query65	3263	3176	3160	3160
query66	704	300	298	298
query67	15808	15609	15480	15480
query68	3643	578	571	571
query69	446	263	260	260
query70	1194	1120	1124	1120
query71	360	250	257	250
query72	6227	3929	3963	3929
query73	747	354	350	350
query74	10139	9224	9246	9224
query75	3313	2606	2621	2606
query76	2122	1085	1187	1085
query77	486	283	268	268
query78	10534	9547	9605	9547
query79	1148	576	602	576
query80	830	421	424	421
query81	505	243	250	243
query82	1319	86	87	86
query83	247	149	151	149
query84	280	81	86	81
query85	909	365	360	360
query86	330	291	269	269
query87	4548	4264	4316	4264
query88	3589	2367	2336	2336
query89	409	293	289	289
query90	2039	185	188	185
query91	198	194	149	149
query92	65	48	48	48
query93	1319	531	537	531
query94	788	303	301	301
query95	355	257	246	246
query96	601	275	274	274
query97	3347	3157	3158	3157
query98	214	201	199	199
query99	1606	1264	1277	1264
Total cold run time: 316526 ms
Total hot run time: 196567 ms

doris-robot · 2025-03-26T07:59:08Z

ClickBench: Total hot run time: 32.39 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a3405dd0f57e30849a5eeac73c2938ad8a083caf, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.03	0.03
query3	0.24	0.06	0.06
query4	1.62	0.11	0.09
query5	0.55	0.50	0.49
query6	1.13	0.74	0.72
query7	0.02	0.02	0.01
query8	0.04	0.04	0.03
query9	0.56	0.51	0.50
query10	0.55	0.54	0.58
query11	0.14	0.13	0.11
query12	0.14	0.11	0.10
query13	0.61	0.60	0.60
query14	2.76	2.73	2.77
query15	0.89	0.82	0.83
query16	0.37	0.38	0.40
query17	1.09	0.97	0.98
query18	0.23	0.21	0.22
query19	1.97	1.83	1.97
query20	0.01	0.01	0.01
query21	15.35	0.58	0.56
query22	2.93	2.84	1.76
query23	16.98	1.16	0.85
query24	3.76	1.17	1.93
query25	0.18	0.10	0.14
query26	0.47	0.15	0.14
query27	0.05	0.04	0.05
query28	8.79	0.48	0.52
query29	12.59	3.25	3.23
query30	0.25	0.08	0.06
query31	2.84	0.39	0.38
query32	3.26	0.46	0.46
query33	2.94	3.10	3.08
query34	17.23	4.56	4.50
query35	4.58	4.54	4.61
query36	0.67	0.48	0.47
query37	0.09	0.06	0.06
query38	0.05	0.03	0.03
query39	0.03	0.02	0.02
query40	0.16	0.13	0.14
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.04
Total cold run time: 106.35 s
Total hot run time: 32.39 s

amorynan · 2025-03-26T11:09:37Z

run buildall

dataroaring

LGTM

fix for branch-3.0

87d516f

amorynan requested a review from dataroaring as a code owner February 18, 2025 10:59

fix core

6f3ca18

update cases

f219464

add cases

47916c2

eldenmoon changed the title ~~[improve](sc) link for https://github.com/apache/doris/pull/46639~~ Brach-3.0 [improve](schema-change) support nested type with varchar type to support length growing Mar 5, 2025

Merge branch 'branch-3.0' into amory-pick

274c646

Hastyshell and others added 2 commits March 25, 2025 12:06

Merge branch 'branch-3.0' into amory-pick

bb055ab

Hastyshell reviewed Mar 25, 2025

View reviewed changes

fe/fe-core/src/main/java/org/apache/doris/catalog/ColumnType.java Show resolved Hide resolved

fix cases

cb6774a

fix case

a3405dd

fix case out file

fc62ac3

gavinchou changed the title ~~Brach-3.0 [improve](schema-change) support nested type with varchar type to support length growing~~ [improve](schema-change) support nested type with varchar type to support length growing Mar 26, 2025

dataroaring approved these changes Mar 27, 2025

View reviewed changes

dataroaring merged commit 7dbe083 into apache:branch-3.0 Mar 27, 2025
28 of 29 checks passed

gavinchou mentioned this pull request Apr 23, 2025

Release Notes 3.0.5 #50333

Closed

[improve](schema-change) support nested type with varchar type to support length growing #48025

[improve](schema-change) support nested type with varchar type to support length growing #48025

Uh oh!

Conversation

amorynan commented Feb 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

hello-stephen commented Feb 18, 2025

Uh oh!

amorynan commented Feb 18, 2025

Uh oh!

doris-robot commented Feb 18, 2025

Uh oh!

doris-robot commented Feb 18, 2025

Uh oh!

doris-robot commented Feb 18, 2025

Uh oh!

amorynan commented Feb 26, 2025

Uh oh!

doris-robot commented Feb 26, 2025

Uh oh!

doris-robot commented Feb 26, 2025

Uh oh!

doris-robot commented Feb 26, 2025

Uh oh!

amorynan commented Feb 26, 2025

Uh oh!

amorynan commented Mar 3, 2025

Uh oh!

amorynan commented Mar 3, 2025

Uh oh!

amorynan commented Mar 5, 2025

Uh oh!

amorynan commented Mar 10, 2025

Uh oh!

doris-robot commented Mar 10, 2025

Uh oh!

doris-robot commented Mar 10, 2025

Uh oh!

doris-robot commented Mar 10, 2025

Uh oh!

amorynan commented Mar 25, 2025

Uh oh!

Uh oh!

amorynan commented Mar 26, 2025

Uh oh!

doris-robot commented Mar 26, 2025

Uh oh!

amorynan commented Mar 26, 2025

Uh oh!

doris-robot commented Mar 26, 2025

Uh oh!

doris-robot commented Mar 26, 2025

Uh oh!

doris-robot commented Mar 26, 2025

Uh oh!

amorynan commented Mar 26, 2025

Uh oh!

dataroaring left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

amorynan commented Feb 18, 2025 •

edited

Loading