[Bug](exchange) fix tablet sink shuffle without project not match the output tuple #40299

zhangstar333 · 2024-09-03T03:54:15Z

Proposed changes

INSERT INTO tbl_4 SELECT k1, k2, k2 FROM tbl_1;

the tbl_1 have k1,k2 columns
the tbl_4 have k1,k2,v columns
if without project expr, will be only two columns not match the output tuple.

the co-auther of FE code from @starocean999

doris-robot · 2024-09-03T03:54:19Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

github-actions · 2024-09-03T04:01:42Z

clang-tidy review says "All clean, LGTM! 👍"

zhangstar333 · 2024-09-03T08:11:36Z

run buildall

doris-robot · 2024-09-03T09:44:15Z

TPC-H: Total hot run time: 38514 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit dce0950485f60ef05f0fd778b80ab2283f5a6ad0, data reload: false

------ Round 1 ----------------------------------
q1	18028	5420	4401	4401
q2	3018	186	179	179
q3	10912	1147	1066	1066
q4	10618	754	717	717
q5	8145	2932	2869	2869
q6	234	140	143	140
q7	987	641	609	609
q8	9668	2085	2096	2085
q9	7105	6583	6572	6572
q10	7001	2258	2244	2244
q11	475	250	254	250
q12	403	230	230	230
q13	17991	3091	3069	3069
q14	281	250	238	238
q15	545	487	499	487
q16	584	504	512	504
q17	972	690	696	690
q18	7386	6948	6764	6764
q19	1403	1068	986	986
q20	698	348	336	336
q21	4475	3070	3067	3067
q22	1130	1024	1011	1011
Total cold run time: 112059 ms
Total hot run time: 38514 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4346	4254	4282	4254
q2	379	278	268	268
q3	2900	2705	2693	2693
q4	1972	1686	1652	1652
q5	5417	5448	5428	5428
q6	221	132	137	132
q7	2119	1770	1760	1760
q8	3208	3363	3357	3357
q9	8547	8452	8457	8452
q10	3450	3217	3192	3192
q11	610	517	521	517
q12	779	578	605	578
q13	12439	3097	3064	3064
q14	310	279	273	273
q15	534	477	476	476
q16	579	569	573	569
q17	1795	1481	1491	1481
q18	7856	7552	7413	7413
q19	1674	1548	1534	1534
q20	2062	1852	1843	1843
q21	5498	5103	5259	5103
q22	1147	1043	1040	1040
Total cold run time: 67842 ms
Total hot run time: 55079 ms

doris-robot · 2024-09-03T09:55:59Z

TPC-DS: Total hot run time: 188022 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit dce0950485f60ef05f0fd778b80ab2283f5a6ad0, data reload: false

query1	928	378	370	370
query2	6478	1998	2031	1998
query3	6643	208	218	208
query4	29527	23219	23246	23219
query5	4141	507	506	506
query6	266	170	162	162
query7	4577	289	296	289
query8	262	212	215	212
query9	8570	2446	2423	2423
query10	431	262	274	262
query11	16639	14915	14948	14915
query12	152	103	98	98
query13	1621	378	369	369
query14	9704	7332	7568	7332
query15	292	170	176	170
query16	7972	458	444	444
query17	1588	578	558	558
query18	2066	298	295	295
query19	297	151	146	146
query20	119	111	116	111
query21	216	108	105	105
query22	4619	4278	4282	4278
query23	34143	33423	33326	33326
query24	11196	2903	2856	2856
query25	634	399	409	399
query26	1192	158	157	157
query27	2761	284	277	277
query28	7452	2047	2030	2030
query29	824	451	430	430
query30	311	161	159	159
query31	977	771	795	771
query32	96	54	60	54
query33	783	299	296	296
query34	955	480	479	479
query35	913	746	745	745
query36	1083	945	908	908
query37	163	94	86	86
query38	4065	3880	3917	3880
query39	1445	1417	1390	1390
query40	215	122	128	122
query41	52	47	48	47
query42	118	93	96	93
query43	516	486	475	475
query44	1248	752	735	735
query45	202	166	173	166
query46	1091	756	738	738
query47	1916	1822	1829	1822
query48	382	293	301	293
query49	1118	440	445	440
query50	809	410	418	410
query51	7018	6963	6798	6798
query52	102	90	89	89
query53	259	185	185	185
query54	1098	467	474	467
query55	82	74	77	74
query56	285	280	274	274
query57	1193	1073	1106	1073
query58	250	224	237	224
query59	3192	2660	2765	2660
query60	313	285	283	283
query61	126	227	102	102
query62	886	666	656	656
query63	216	180	181	180
query64	5332	681	653	653
query65	3230	3125	3126	3125
query66	1417	331	342	331
query67	15546	15576	15288	15288
query68	4569	546	566	546
query69	421	277	283	277
query70	1202	1074	1051	1051
query71	331	277	300	277
query72	6584	4072	3947	3947
query73	752	325	326	325
query74	9394	8931	8882	8882
query75	3431	2741	2709	2709
query76	2794	997	974	974
query77	502	331	321	321
query78	9753	9174	9015	9015
query79	1600	532	541	532
query80	1166	503	511	503
query81	586	240	245	240
query82	892	154	145	145
query83	216	156	151	151
query84	231	79	78	78
query85	1396	286	270	270
query86	451	291	278	278
query87	4467	4229	4252	4229
query88	2886	2351	2358	2351
query89	383	293	287	287
query90	1787	190	188	188
query91	125	101	100	100
query92	73	50	48	48
query93	1547	530	527	527
query94	942	303	284	284
query95	353	260	255	255
query96	607	270	273	270
query97	3176	3122	3033	3033
query98	220	243	193	193
query99	1678	1287	1220	1220
Total cold run time: 288828 ms
Total hot run time: 188022 ms

doris-robot · 2024-09-03T10:01:34Z

ClickBench: Total hot run time: 32.62 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit dce0950485f60ef05f0fd778b80ab2283f5a6ad0, data reload: false

query1	0.05	0.04	0.04
query2	0.09	0.04	0.04
query3	0.23	0.05	0.05
query4	1.67	0.07	0.07
query5	0.50	0.50	0.49
query6	1.13	0.73	0.73
query7	0.02	0.01	0.01
query8	0.05	0.05	0.05
query9	0.55	0.49	0.48
query10	0.54	0.55	0.55
query11	0.15	0.12	0.11
query12	0.16	0.12	0.13
query13	0.62	0.59	0.59
query14	2.05	2.04	2.09
query15	0.84	0.82	0.81
query16	0.37	0.38	0.39
query17	0.96	1.06	1.06
query18	0.22	0.21	0.20
query19	1.89	1.74	1.81
query20	0.01	0.01	0.01
query21	15.39	0.67	0.65
query22	4.50	6.81	2.29
query23	18.29	1.49	1.48
query24	2.10	0.24	0.22
query25	0.16	0.07	0.08
query26	0.28	0.19	0.17
query27	0.08	0.08	0.08
query28	13.17	1.02	1.00
query29	12.65	3.32	3.33
query30	0.25	0.06	0.05
query31	2.89	0.40	0.39
query32	3.26	0.50	0.48
query33	3.00	2.97	3.02
query34	17.07	4.37	4.37
query35	4.51	4.44	4.44
query36	0.65	0.51	0.47
query37	0.18	0.16	0.16
query38	0.16	0.14	0.15
query39	0.05	0.04	0.04
query40	0.16	0.13	0.14
query41	0.09	0.05	0.05
query42	0.05	0.04	0.04
query43	0.05	0.04	0.04
Total cold run time: 111.09 s
Total hot run time: 32.62 s

zhangstar333 · 2024-09-04T06:50:36Z

run buildall

github-actions · 2024-09-04T06:53:13Z

clang-tidy review says "All clean, LGTM! 👍"

zhangstar333 · 2024-09-04T08:46:03Z

run buildall

doris-robot · 2024-09-04T10:13:10Z

TeamCity be ut coverage result:
Function Coverage: 36.84% (9393/25497)
Line Coverage: 28.27% (77447/273972)
Region Coverage: 27.68% (39979/144458)
Branch Coverage: 24.32% (20343/83656)
Coverage Report: http://coverage.selectdb-in.cc/coverage/8b1885f7b4b0a901cf08c52591afb7e6dc9814c2_8b1885f7b4b0a901cf08c52591afb7e6dc9814c2/report/index.html

zhangstar333 · 2024-09-04T12:00:32Z

run buildall

doris-robot · 2024-09-04T13:46:07Z

TPC-H: Total hot run time: 38064 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8b1885f7b4b0a901cf08c52591afb7e6dc9814c2, data reload: false

------ Round 1 ----------------------------------
q1	17620	4610	4331	4331
q2	2036	186	184	184
q3	11889	950	1117	950
q4	10514	732	722	722
q5	7761	2868	2779	2779
q6	229	141	142	141
q7	947	615	611	611
q8	9346	2103	2114	2103
q9	7011	6469	6540	6469
q10	6996	2211	2148	2148
q11	453	260	246	246
q12	393	231	229	229
q13	17766	3118	3065	3065
q14	274	243	246	243
q15	533	504	507	504
q16	599	542	504	504
q17	985	672	660	660
q18	7478	6832	6879	6832
q19	1413	1070	1085	1070
q20	677	339	329	329
q21	3980	3202	2930	2930
q22	1129	1032	1014	1014
Total cold run time: 110029 ms
Total hot run time: 38064 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4365	4278	4311	4278
q2	375	281	275	275
q3	2889	2612	2668	2612
q4	1986	1685	1695	1685
q5	5673	5703	5708	5703
q6	230	138	141	138
q7	2277	1845	1824	1824
q8	3326	3459	3467	3459
q9	8878	8835	8750	8750
q10	3619	3445	3354	3354
q11	634	501	528	501
q12	865	686	671	671
q13	15228	3206	3324	3206
q14	327	301	272	272
q15	532	485	477	477
q16	663	602	578	578
q17	1849	1525	1537	1525
q18	8122	7822	7892	7822
q19	1744	1701	1579	1579
q20	2235	1935	1969	1935
q21	5961	5600	5449	5449
q22	1165	1059	1110	1059
Total cold run time: 72943 ms
Total hot run time: 57152 ms

doris-robot · 2024-09-04T13:51:55Z

TeamCity be ut coverage result:
Function Coverage: 36.84% (9393/25496)
Line Coverage: 28.28% (77463/273926)
Region Coverage: 27.67% (39970/144444)
Branch Coverage: 24.31% (20337/83648)
Coverage Report: http://coverage.selectdb-in.cc/coverage/8b1885f7b4b0a901cf08c52591afb7e6dc9814c2_8b1885f7b4b0a901cf08c52591afb7e6dc9814c2/report/index.html

doris-robot · 2024-09-04T13:58:25Z

TPC-DS: Total hot run time: 193150 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8b1885f7b4b0a901cf08c52591afb7e6dc9814c2, data reload: false

query1	1262	895	855	855
query2	6441	1963	1891	1891
query3	10710	4157	4045	4045
query4	59838	26169	23121	23121
query5	5323	484	486	484
query6	395	165	164	164
query7	5770	303	297	297
query8	293	211	211	211
query9	8835	2533	2474	2474
query10	497	266	256	256
query11	17300	15027	15467	15027
query12	164	101	104	101
query13	1555	393	403	393
query14	10841	7414	7288	7288
query15	252	174	183	174
query16	7618	517	496	496
query17	1124	601	579	579
query18	2092	309	305	305
query19	310	175	161	161
query20	128	113	112	112
query21	201	112	111	111
query22	4550	4505	4589	4505
query23	34527	33517	33555	33517
query24	5915	2828	2869	2828
query25	557	400	409	400
query26	682	158	163	158
query27	1777	278	281	278
query28	4013	2094	2073	2073
query29	726	425	434	425
query30	239	156	156	156
query31	952	767	793	767
query32	84	51	54	51
query33	467	291	292	291
query34	857	496	480	480
query35	849	729	743	729
query36	1072	903	917	903
query37	150	96	91	91
query38	3974	3926	3977	3926
query39	1457	1411	1412	1411
query40	193	116	117	116
query41	48	46	48	46
query42	115	95	97	95
query43	523	463	451	451
query44	1134	751	745	745
query45	199	172	165	165
query46	1100	753	754	753
query47	1928	1799	1839	1799
query48	375	303	298	298
query49	780	436	446	436
query50	800	430	422	422
query51	7021	6865	6865	6865
query52	102	87	88	87
query53	252	181	182	181
query54	579	466	460	460
query55	81	77	74	74
query56	285	275	269	269
query57	1195	1075	1106	1075
query58	225	239	234	234
query59	3049	2875	2850	2850
query60	292	263	293	263
query61	99	100	99	99
query62	765	656	655	655
query63	218	182	181	181
query64	2868	672	683	672
query65	3232	3133	3139	3133
query66	691	321	333	321
query67	15396	15384	15331	15331
query68	4470	572	555	555
query69	415	281	280	280
query70	1192	1141	1085	1085
query71	359	280	291	280
query72	6537	4080	4067	4067
query73	746	323	330	323
query74	9223	8798	8932	8798
query75	3368	2674	2688	2674
query76	1757	920	1025	920
query77	531	321	308	308
query78	9768	8980	9377	8980
query79	1411	541	525	525
query80	1031	502	506	502
query81	589	235	234	234
query82	645	142	145	142
query83	170	145	147	145
query84	263	75	78	75
query85	885	285	280	280
query86	412	297	295	295
query87	4435	4220	4282	4220
query88	3238	2373	2375	2373
query89	403	286	286	286
query90	1865	183	186	183
query91	122	100	98	98
query92	67	86	50	50
query93	1669	542	546	542
query94	769	301	295	295
query95	344	252	244	244
query96	597	276	271	271
query97	3151	3060	3062	3060
query98	221	215	195	195
query99	1879	1300	1255	1255
Total cold run time: 309874 ms
Total hot run time: 193150 ms

doris-robot · 2024-09-04T14:04:04Z

ClickBench: Total hot run time: 32.74 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8b1885f7b4b0a901cf08c52591afb7e6dc9814c2, data reload: false

query1	0.04	0.04	0.03
query2	0.09	0.04	0.04
query3	0.22	0.05	0.05
query4	1.67	0.07	0.08
query5	0.51	0.50	0.49
query6	1.13	0.74	0.73
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.56	0.52	0.50
query10	0.55	0.55	0.54
query11	0.14	0.11	0.12
query12	0.15	0.12	0.12
query13	0.62	0.59	0.59
query14	2.10	2.08	2.05
query15	0.85	0.83	0.83
query16	0.38	0.37	0.37
query17	1.07	1.01	1.05
query18	0.24	0.21	0.22
query19	1.87	1.74	1.73
query20	0.02	0.01	0.01
query21	15.39	0.65	0.65
query22	4.24	6.88	2.58
query23	18.27	1.33	1.26
query24	2.12	0.24	0.22
query25	0.18	0.08	0.08
query26	0.26	0.18	0.18
query27	0.08	0.08	0.07
query28	13.28	1.02	1.00
query29	12.62	3.39	3.36
query30	0.24	0.05	0.06
query31	2.88	0.41	0.38
query32	3.25	0.50	0.48
query33	2.99	3.02	3.06
query34	17.12	4.48	4.38
query35	4.48	4.52	4.44
query36	0.67	0.47	0.47
query37	0.19	0.16	0.16
query38	0.16	0.15	0.14
query39	0.05	0.04	0.04
query40	0.16	0.13	0.13
query41	0.10	0.05	0.04
query42	0.06	0.04	0.05
query43	0.05	0.04	0.04
Total cold run time: 111.12 s
Total hot run time: 32.74 s

zhangstar333 · 2024-09-05T02:02:05Z

run buildall

doris-robot · 2024-09-05T02:36:28Z

TeamCity be ut coverage result:
Function Coverage: 36.84% (9394/25497)
Line Coverage: 28.28% (77462/273940)
Region Coverage: 27.67% (39964/144455)
Branch Coverage: 24.31% (20337/83656)
Coverage Report: http://coverage.selectdb-in.cc/coverage/41925508f0324063ec7ebea243fa226e6315c17e_41925508f0324063ec7ebea243fa226e6315c17e/report/index.html

doris-robot · 2024-09-05T02:55:16Z

TPC-H: Total hot run time: 38242 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 41925508f0324063ec7ebea243fa226e6315c17e, data reload: false

------ Round 1 ----------------------------------
q1	18599	5072	4335	4335
q2	2031	186	175	175
q3	11655	941	1150	941
q4	10480	767	689	689
q5	7779	2870	2814	2814
q6	229	140	141	140
q7	958	613	609	609
q8	9324	2088	2094	2088
q9	7299	6558	6605	6558
q10	7004	2241	2244	2241
q11	459	241	245	241
q12	393	227	226	226
q13	18691	3079	3104	3079
q14	285	238	244	238
q15	529	515	493	493
q16	598	535	505	505
q17	981	686	665	665
q18	7464	6895	6919	6895
q19	1415	1087	1003	1003
q20	667	329	334	329
q21	3955	3052	2979	2979
q22	1143	1035	999	999
Total cold run time: 111938 ms
Total hot run time: 38242 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4379	4468	4304	4304
q2	379	268	280	268
q3	2872	2637	2626	2626
q4	1925	1649	1725	1649
q5	5685	5662	5792	5662
q6	225	130	136	130
q7	2228	1825	1796	1796
q8	3293	3471	3550	3471
q9	8883	8843	8864	8843
q10	3622	3426	3361	3361
q11	622	512	499	499
q12	847	659	651	651
q13	13881	3144	3248	3144
q14	330	291	280	280
q15	555	492	497	492
q16	638	573	575	573
q17	1859	1543	1571	1543
q18	8176	7740	7946	7740
q19	1778	1670	1383	1383
q20	2202	1908	1910	1908
q21	5810	5491	5583	5491
q22	1136	1040	1038	1038
Total cold run time: 71325 ms
Total hot run time: 56852 ms

doris-robot · 2024-09-05T03:07:33Z

TPC-DS: Total hot run time: 193684 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 41925508f0324063ec7ebea243fa226e6315c17e, data reload: false

query1	1263	903	881	881
query2	6341	2116	2007	2007
query3	10732	4113	4201	4113
query4	60072	27021	23209	23209
query5	5465	504	508	504
query6	417	167	167	167
query7	5906	293	300	293
query8	285	208	216	208
query9	8882	2511	2528	2511
query10	497	278	274	274
query11	18152	15295	15584	15295
query12	154	112	106	106
query13	1564	407	369	369
query14	11195	7332	7088	7088
query15	233	174	173	173
query16	7629	494	464	464
query17	1125	556	557	556
query18	2107	298	296	296
query19	292	151	152	151
query20	119	110	108	108
query21	207	105	107	105
query22	4940	4691	4778	4691
query23	34322	33632	33495	33495
query24	5926	2889	2883	2883
query25	554	409	400	400
query26	690	160	159	159
query27	1789	291	279	279
query28	3686	2083	2053	2053
query29	724	424	446	424
query30	234	163	153	153
query31	950	763	751	751
query32	88	50	53	50
query33	464	287	283	283
query34	849	477	473	473
query35	827	707	706	706
query36	1063	917	945	917
query37	148	87	85	85
query38	3972	3827	3906	3827
query39	1456	1381	1387	1381
query40	207	113	112	112
query41	49	47	44	44
query42	112	93	95	93
query43	503	480	467	467
query44	1086	735	740	735
query45	193	165	162	162
query46	1098	736	728	728
query47	1908	1825	1884	1825
query48	366	296	304	296
query49	765	419	433	419
query50	811	418	405	405
query51	7093	6843	6857	6843
query52	94	88	89	88
query53	249	179	179	179
query54	555	456	452	452
query55	78	72	77	72
query56	275	253	262	253
query57	1205	1082	1071	1071
query58	255	228	230	228
query59	3064	2853	2952	2853
query60	291	261	269	261
query61	105	97	97	97
query62	750	653	662	653
query63	215	178	181	178
query64	2841	671	696	671
query65	3251	3101	3155	3101
query66	686	339	388	339
query67	15469	15599	15383	15383
query68	2992	581	567	567
query69	415	280	273	273
query70	1161	1112	1128	1112
query71	360	281	275	275
query72	5918	4012	4133	4012
query73	748	320	325	320
query74	9094	8826	8871	8826
query75	3377	2700	2762	2700
query76	1445	968	993	968
query77	525	321	302	302
query78	9611	9125	9281	9125
query79	1030	528	525	525
query80	688	501	502	501
query81	459	236	230	230
query82	240	143	145	143
query83	169	148	148	148
query84	261	76	77	76
query85	694	282	282	282
query86	315	304	302	302
query87	4338	4284	4319	4284
query88	3300	2344	2360	2344
query89	381	288	288	288
query90	2018	190	186	186
query91	121	102	97	97
query92	58	47	48	47
query93	1045	536	536	536
query94	711	304	294	294
query95	314	244	248	244
query96	590	268	267	267
query97	3199	3048	3025	3025
query98	224	208	199	199
query99	1524	1290	1293	1290
Total cold run time: 306218 ms
Total hot run time: 193684 ms

doris-robot · 2024-09-05T03:13:13Z

ClickBench: Total hot run time: 31.82 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 41925508f0324063ec7ebea243fa226e6315c17e, data reload: false

query1	0.05	0.05	0.04
query2	0.08	0.04	0.04
query3	0.23	0.06	0.05
query4	1.65	0.08	0.10
query5	0.52	0.50	0.49
query6	1.13	0.73	0.73
query7	0.02	0.01	0.01
query8	0.06	0.04	0.04
query9	0.57	0.50	0.50
query10	0.55	0.56	0.54
query11	0.16	0.12	0.11
query12	0.15	0.12	0.12
query13	0.61	0.60	0.59
query14	2.06	2.03	2.10
query15	0.85	0.82	0.81
query16	0.37	0.38	0.39
query17	1.06	1.05	1.05
query18	0.23	0.20	0.21
query19	1.97	1.89	1.85
query20	0.01	0.01	0.01
query21	15.40	0.68	0.67
query22	4.11	8.41	1.57
query23	18.29	1.42	1.21
query24	2.03	0.21	0.22
query25	0.14	0.09	0.07
query26	0.27	0.18	0.18
query27	0.08	0.07	0.07
query28	13.34	1.01	0.99
query29	12.59	3.43	3.37
query30	0.24	0.05	0.06
query31	2.88	0.40	0.40
query32	3.28	0.48	0.47
query33	2.99	3.04	2.98
query34	17.00	4.43	4.40
query35	4.45	4.46	4.50
query36	0.66	0.46	0.50
query37	0.19	0.16	0.15
query38	0.16	0.15	0.15
query39	0.05	0.05	0.04
query40	0.15	0.13	0.13
query41	0.09	0.05	0.04
query42	0.05	0.04	0.05
query43	0.05	0.04	0.05
Total cold run time: 110.82 s
Total hot run time: 31.82 s

github-actions · 2024-09-05T07:04:12Z

PR approved by at least one committer and no changes requested.

github-actions · 2024-09-05T07:04:14Z

PR approved by anyone and no changes requested.

zhangstar333 · 2024-09-09T02:08:00Z

run buildall

doris-robot · 2024-09-09T03:52:40Z

TPC-H: Total hot run time: 38027 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 015668c608c933344d5293f08bd5e3ef398da9e0, data reload: false

------ Round 1 ----------------------------------
q1	17921	5260	4310	4310
q2	2036	194	198	194
q3	11386	987	1176	987
q4	10155	765	685	685
q5	7727	2854	2831	2831
q6	232	140	137	137
q7	975	627	603	603
q8	9332	2113	2079	2079
q9	7126	6574	6575	6574
q10	7045	2252	2171	2171
q11	467	243	244	243
q12	401	226	229	226
q13	17876	3094	3082	3082
q14	277	238	256	238
q15	554	480	484	480
q16	555	443	433	433
q17	1003	765	728	728
q18	7540	6871	7085	6871
q19	1402	1093	960	960
q20	672	337	335	335
q21	4056	2919	2841	2841
q22	1077	1020	1019	1019
Total cold run time: 109815 ms
Total hot run time: 38027 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4359	4275	4275	4275
q2	383	274	262	262
q3	2902	2601	2699	2601
q4	1985	1721	1721	1721
q5	5714	5700	5771	5700
q6	227	131	140	131
q7	2220	1815	1777	1777
q8	3347	3479	3466	3466
q9	8878	8874	8865	8865
q10	3594	3394	3370	3370
q11	620	501	516	501
q12	853	653	666	653
q13	13074	3282	3268	3268
q14	326	283	293	283
q15	562	489	510	489
q16	538	501	502	501
q17	1841	1516	1518	1516
q18	8199	7956	8059	7956
q19	1748	1701	1513	1513
q20	2141	1927	1908	1908
q21	5841	5630	5473	5473
q22	1136	997	1024	997
Total cold run time: 70488 ms
Total hot run time: 57226 ms

doris-robot · 2024-09-09T03:56:29Z

TeamCity be ut coverage result:
Function Coverage: 36.82% (9380/25475)
Line Coverage: 28.21% (77332/274155)
Region Coverage: 27.62% (39953/144646)
Branch Coverage: 24.25% (20329/83818)
Coverage Report: http://coverage.selectdb-in.cc/coverage/015668c608c933344d5293f08bd5e3ef398da9e0_015668c608c933344d5293f08bd5e3ef398da9e0/report/index.html

doris-robot · 2024-09-09T04:04:52Z

TPC-DS: Total hot run time: 192569 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 015668c608c933344d5293f08bd5e3ef398da9e0, data reload: false

query1	1269	891	894	891
query2	6312	1997	1987	1987
query3	10639	4131	3958	3958
query4	59587	25258	23355	23355
query5	5379	502	513	502
query6	410	182	169	169
query7	5785	290	293	290
query8	310	219	206	206
query9	8797	2496	2485	2485
query10	492	267	277	267
query11	17875	14988	15282	14988
query12	151	116	105	105
query13	1547	403	393	393
query14	10788	7415	7449	7415
query15	252	173	190	173
query16	7740	487	483	483
query17	1139	579	580	579
query18	2058	291	287	287
query19	300	142	148	142
query20	129	118	110	110
query21	205	107	104	104
query22	4809	4355	4749	4355
query23	34153	33157	33151	33151
query24	5959	2925	2882	2882
query25	525	380	406	380
query26	688	161	158	158
query27	1771	279	282	279
query28	3722	2065	2039	2039
query29	720	432	438	432
query30	248	159	152	152
query31	949	776	805	776
query32	117	54	54	54
query33	414	290	289	289
query34	868	475	471	471
query35	844	708	744	708
query36	1055	916	931	916
query37	147	86	82	82
query38	3998	3843	3902	3843
query39	1438	1416	1371	1371
query40	196	114	111	111
query41	49	47	44	44
query42	115	101	96	96
query43	510	478	481	478
query44	1076	749	735	735
query45	197	163	165	163
query46	1079	729	754	729
query47	1873	1794	1809	1794
query48	367	286	294	286
query49	764	437	451	437
query50	817	420	424	420
query51	7114	6939	6795	6795
query52	99	88	87	87
query53	252	181	176	176
query54	563	447	476	447
query55	73	75	77	75
query56	283	243	248	243
query57	1196	1100	1061	1061
query58	225	238	225	225
query59	3018	2804	2865	2804
query60	292	271	267	267
query61	102	103	97	97
query62	766	648	663	648
query63	215	198	179	179
query64	2835	660	711	660
query65	3221	3147	3159	3147
query66	710	354	350	350
query67	15321	15172	15420	15172
query68	2973	603	588	588
query69	419	293	296	293
query70	1243	1148	1147	1147
query71	343	275	271	271
query72	5357	4018	3795	3795
query73	736	320	325	320
query74	9193	8924	8879	8879
query75	3349	2653	2725	2653
query76	1425	1063	953	953
query77	519	333	333	333
query78	9998	9171	9306	9171
query79	1037	543	559	543
query80	686	496	507	496
query81	461	231	232	231
query82	245	143	139	139
query83	174	152	152	152
query84	263	75	76	75
query85	677	288	274	274
query86	302	283	301	283
query87	4528	4333	4281	4281
query88	3420	2269	2269	2269
query89	382	282	284	282
query90	2032	192	194	192
query91	124	99	102	99
query92	60	50	57	50
query93	1040	539	540	539
query94	704	318	298	298
query95	318	253	249	249
query96	586	259	262	259
query97	3155	3050	3090	3050
query98	225	204	199	199
query99	1778	1275	1253	1253
Total cold run time: 304669 ms
Total hot run time: 192569 ms

doris-robot · 2024-09-09T04:10:28Z

ClickBench: Total hot run time: 32.57 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 015668c608c933344d5293f08bd5e3ef398da9e0, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.05	0.04
query3	0.23	0.05	0.06
query4	1.66	0.09	0.08
query5	0.53	0.49	0.49
query6	1.13	0.73	0.74
query7	0.03	0.01	0.01
query8	0.06	0.04	0.05
query9	0.54	0.50	0.49
query10	0.54	0.57	0.52
query11	0.16	0.12	0.12
query12	0.16	0.13	0.12
query13	0.61	0.60	0.59
query14	1.39	1.46	1.44
query15	0.86	0.81	0.82
query16	0.38	0.41	0.38
query17	1.06	1.06	1.06
query18	0.21	0.21	0.20
query19	1.94	1.75	1.85
query20	0.02	0.01	0.00
query21	15.40	0.67	0.67
query22	3.67	6.50	3.11
query23	18.32	1.34	1.27
query24	2.13	0.22	0.21
query25	0.16	0.09	0.07
query26	0.26	0.18	0.17
query27	0.09	0.08	0.07
query28	13.25	1.02	0.99
query29	12.58	3.39	3.31
query30	0.24	0.06	0.06
query31	2.88	0.40	0.39
query32	3.24	0.48	0.47
query33	2.97	2.98	3.00
query34	17.01	4.36	4.38
query35	4.45	4.41	4.42
query36	0.65	0.49	0.51
query37	0.18	0.15	0.16
query38	0.16	0.15	0.15
query39	0.05	0.04	0.04
query40	0.16	0.13	0.12
query41	0.09	0.06	0.04
query42	0.06	0.04	0.05
query43	0.05	0.04	0.04
Total cold run time: 109.68 s
Total hot run time: 32.57 s

zhangstar333 · 2024-09-12T02:08:32Z

run buildall

zhangstar333 · 2024-09-12T05:33:10Z

run buildall

doris-robot · 2024-09-12T06:14:19Z

TPC-H: Total hot run time: 40464 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d20d165c5f9b982fb1d7297847ab0c49a671af62, data reload: false

------ Round 1 ----------------------------------
q1	18053	4768	4443	4443
q2	2798	196	193	193
q3	11361	1412	1399	1399
q4	11000	959	1062	959
q5	7788	3307	3222	3222
q6	231	141	143	141
q7	1053	653	637	637
q8	9525	2075	2010	2010
q9	6770	6280	6322	6280
q10	7028	2511	2468	2468
q11	440	263	258	258
q12	431	232	234	232
q13	17760	3068	3082	3068
q14	292	257	259	257
q15	557	502	492	492
q16	521	430	422	422
q17	989	968	949	949
q18	7714	6899	6963	6899
q19	1388	1239	1231	1231
q20	612	335	331	331
q21	3976	3574	3596	3574
q22	1095	1017	999	999
Total cold run time: 111382 ms
Total hot run time: 40464 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4197	4182	4154	4154
q2	348	245	231	231
q3	2885	2921	2909	2909
q4	2021	1988	1993	1988
q5	5440	5465	5486	5465
q6	221	133	134	133
q7	2107	1704	1689	1689
q8	3260	3302	3322	3302
q9	8529	8460	8444	8444
q10	3366	3437	3447	3437
q11	579	458	469	458
q12	797	567	578	567
q13	4074	3074	3088	3074
q14	299	268	278	268
q15	532	505	492	492
q16	511	468	455	455
q17	1767	1745	1713	1713
q18	8135	7559	7482	7482
q19	1720	1712	1699	1699
q20	2029	1798	1806	1798
q21	5761	5596	5522	5522
q22	1112	1019	1001	1001
Total cold run time: 59690 ms
Total hot run time: 56281 ms

doris-robot · 2024-09-12T06:23:38Z

TeamCity be ut coverage result:
Function Coverage: 36.88% (9453/25629)
Line Coverage: 28.25% (77788/275329)
Region Coverage: 27.65% (40150/145211)
Branch Coverage: 24.26% (20399/84094)
Coverage Report: http://coverage.selectdb-in.cc/coverage/d20d165c5f9b982fb1d7297847ab0c49a671af62_d20d165c5f9b982fb1d7297847ab0c49a671af62/report/index.html

doris-robot · 2024-09-12T06:26:08Z

TPC-DS: Total hot run time: 194608 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d20d165c5f9b982fb1d7297847ab0c49a671af62, data reload: false

query1	924	388	374	374
query2	6487	1845	1875	1845
query3	6661	216	222	216
query4	25898	24074	23626	23626
query5	5241	552	522	522
query6	278	181	190	181
query7	4594	308	316	308
query8	302	232	223	223
query9	8505	2452	2463	2452
query10	460	286	290	286
query11	16256	15502	15434	15434
query12	161	104	100	100
query13	1687	407	388	388
query14	11736	6442	7162	6442
query15	225	186	177	177
query16	7633	470	449	449
query17	1551	591	574	574
query18	2040	308	299	299
query19	198	160	156	156
query20	122	116	113	113
query21	211	108	106	106
query22	4599	4333	4344	4333
query23	34537	33865	33883	33865
query24	9381	3173	3068	3068
query25	671	416	411	411
query26	1191	165	161	161
query27	2550	287	298	287
query28	6760	2045	2007	2007
query29	944	433	435	433
query30	301	160	163	160
query31	1017	769	792	769
query32	108	60	60	60
query33	741	310	313	310
query34	908	482	498	482
query35	893	762	770	762
query36	1074	934	911	911
query37	163	85	89	85
query38	4025	3924	3947	3924
query39	1477	1432	1390	1390
query40	211	120	117	117
query41	52	51	49	49
query42	123	100	100	100
query43	512	470	451	451
query44	1253	777	756	756
query45	197	170	176	170
query46	1116	832	819	819
query47	1875	1786	1798	1786
query48	373	298	298	298
query49	1133	469	476	469
query50	928	459	466	459
query51	7046	7037	6976	6976
query52	106	95	94	94
query53	264	190	188	188
query54	786	479	473	473
query55	79	80	78	78
query56	305	275	288	275
query57	1228	1083	1107	1083
query58	278	245	366	245
query59	2757	2657	2492	2492
query60	316	273	278	273
query61	103	102	103	102
query62	916	695	689	689
query63	232	193	188	188
query64	5352	692	704	692
query65	3292	3192	3169	3169
query66	1407	347	343	343
query67	16342	15710	15475	15475
query68	3208	879	851	851
query69	444	326	323	323
query70	1178	1165	1156	1156
query71	389	353	345	345
query72	5927	3381	3466	3381
query73	586	585	580	580
query74	9227	9118	8903	8903
query75	3153	3078	3016	3016
query76	1865	867	880	867
query77	438	410	418	410
query78	9435	9286	9315	9286
query79	917	884	877	877
query80	855	867	823	823
query81	445	268	258	258
query82	271	268	268	268
query83	199	197	201	197
query84	229	110	110	110
query85	658	422	399	399
query86	309	327	311	311
query87	4368	4333	4455	4333
query88	4144	4022	4028	4022
query89	388	370	374	370
query90	1262	329	327	327
query91	127	127	125	125
query92	81	81	81	81
query93	1042	1057	1038	1038
query94	609	368	394	368
query95	481	431	435	431
query96	469	470	467	467
query97	3126	3141	3193	3141
query98	232	235	230	230
query99	1583	1316	1319	1316
Total cold run time: 278737 ms
Total hot run time: 194608 ms

doris-robot · 2024-09-12T06:31:36Z

ClickBench: Total hot run time: 31.34 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d20d165c5f9b982fb1d7297847ab0c49a671af62, data reload: false

query1	0.05	0.05	0.04
query2	0.07	0.04	0.04
query3	0.22	0.05	0.05
query4	1.67	0.07	0.07
query5	0.50	0.51	0.49
query6	1.16	0.73	0.72
query7	0.02	0.02	0.01
query8	0.06	0.05	0.05
query9	0.56	0.52	0.52
query10	0.57	0.59	0.58
query11	0.16	0.12	0.12
query12	0.15	0.12	0.12
query13	0.63	0.61	0.61
query14	1.46	1.48	1.50
query15	0.89	0.88	0.88
query16	0.37	0.36	0.37
query17	1.03	1.02	1.03
query18	0.22	0.20	0.20
query19	1.95	1.83	1.86
query20	0.01	0.00	0.01
query21	15.41	0.67	0.66
query22	4.33	7.07	1.49
query23	17.93	1.51	1.38
query24	2.29	0.22	0.22
query25	0.17	0.08	0.08
query26	0.30	0.19	0.18
query27	0.09	0.07	0.08
query28	13.17	1.02	0.97
query29	12.54	3.34	3.31
query30	0.25	0.06	0.05
query31	2.84	0.42	0.41
query32	3.22	0.50	0.51
query33	3.02	3.05	3.08
query34	15.46	4.33	4.32
query35	4.36	4.36	4.37
query36	0.68	0.49	0.49
query37	0.18	0.16	0.17
query38	0.17	0.15	0.15
query39	0.04	0.04	0.05
query40	0.17	0.13	0.14
query41	0.10	0.05	0.05
query42	0.06	0.04	0.04
query43	0.05	0.05	0.04
Total cold run time: 108.58 s
Total hot run time: 31.34 s

github-actions · 2024-09-12T09:20:41Z

PR approved by at least one committer and no changes requested.

HappenLee

LGTM

@starocean999

… output tuple (apache#40299) ``` INSERT INTO tbl_4 SELECT k1, k2, k2 FROM tbl_1; the tbl_1 have k1,k2 columns the tbl_4 have k1,k2,v columns if without project expr, will be only two columns not match the output tuple. ``` the co-auther of FE code from @starocean999

@starocean999

… output tuple (#40299) ``` INSERT INTO tbl_4 SELECT k1, k2, k2 FROM tbl_1; the tbl_1 have k1,k2 columns the tbl_4 have k1,k2,v columns if without project expr, will be only two columns not match the output tuple. ``` the co-auther of FE code from @starocean999

@starocean999

… output tuple (apache#40299) ``` INSERT INTO tbl_4 SELECT k1, k2, k2 FROM tbl_1; the tbl_1 have k1,k2 columns the tbl_4 have k1,k2,v columns if without project expr, will be only two columns not match the output tuple. ``` the co-auther of FE code from @starocean999

@starocean999

… output tuple (apache#40299) ``` INSERT INTO tbl_4 SELECT k1, k2, k2 FROM tbl_1; the tbl_1 have k1,k2 columns the tbl_4 have k1,k2,v columns if without project expr, will be only two columns not match the output tuple. ``` the co-auther of FE code from @starocean999

…match the output tuple (#40299)(#41293) (#41327) ## Proposed changes cherry-pick from master (#40299)(#41293)

zhangstar333 force-pushed the encryption_function_error branch from 8b1885f to 4192550 Compare September 5, 2024 02:01

starocean999 previously approved these changes Sep 5, 2024

View reviewed changes

github-actions bot added the approved Indicates a PR has been approved by one committer. label Sep 5, 2024

github-actions bot added the reviewed label Sep 5, 2024

yiguolei added dev/2.1.x p0_b labels Sep 6, 2024

Gabriel39 previously approved these changes Sep 6, 2024

View reviewed changes

zhangstar333 dismissed Gabriel39’s stale review via 015668c September 9, 2024 02:05

github-actions bot removed the approved Indicates a PR has been approved by one committer. label Sep 9, 2024

zhangstar333 force-pushed the encryption_function_error branch from 015668c to 0756437 Compare September 12, 2024 02:05

zhangstar333 added 2 commits September 12, 2024 12:54

[Bug](exchange) fix tablet sink shuffle without project cause coredump

85f930f

update

d20d165

zhangstar333 force-pushed the encryption_function_error branch from 0756437 to d20d165 Compare September 12, 2024 05:14

morrySnow approved these changes Sep 12, 2024

View reviewed changes

github-actions bot added the approved Indicates a PR has been approved by one committer. label Sep 12, 2024

HappenLee approved these changes Sep 18, 2024

View reviewed changes

HappenLee merged commit 8c97aa1 into apache:master Sep 18, 2024

zhangstar333 mentioned this pull request Sep 26, 2024

[cherry-pick](branch-21) fix tablet sink shuffle without project not match the output tuple (#40299)(#41293) #41327

Merged

dataroaring added the dev/3.0.2-merged label Sep 27, 2024

yiguolei added dev/2.1.7-merged and removed dev/2.1.x labels Oct 14, 2024

[Bug](exchange) fix tablet sink shuffle without project not match the output tuple #40299

[Bug](exchange) fix tablet sink shuffle without project not match the output tuple #40299

Uh oh!

Conversation

zhangstar333 commented Sep 3, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Proposed changes

Uh oh!

doris-robot commented Sep 3, 2024

Uh oh!

github-actions bot commented Sep 3, 2024

Uh oh!

zhangstar333 commented Sep 3, 2024

Uh oh!

doris-robot commented Sep 3, 2024

Uh oh!

doris-robot commented Sep 3, 2024

Uh oh!

doris-robot commented Sep 3, 2024

Uh oh!

zhangstar333 commented Sep 4, 2024

Uh oh!

github-actions bot commented Sep 4, 2024

Uh oh!

zhangstar333 commented Sep 4, 2024

Uh oh!

doris-robot commented Sep 4, 2024

Uh oh!

zhangstar333 commented Sep 4, 2024

Uh oh!

doris-robot commented Sep 4, 2024

Uh oh!

doris-robot commented Sep 4, 2024

Uh oh!

doris-robot commented Sep 4, 2024

Uh oh!

doris-robot commented Sep 4, 2024

Uh oh!

zhangstar333 commented Sep 5, 2024

Uh oh!

doris-robot commented Sep 5, 2024

Uh oh!

doris-robot commented Sep 5, 2024

Uh oh!

doris-robot commented Sep 5, 2024

Uh oh!

doris-robot commented Sep 5, 2024

Uh oh!

github-actions bot commented Sep 5, 2024

Uh oh!

github-actions bot commented Sep 5, 2024

Uh oh!

zhangstar333 commented Sep 9, 2024

Uh oh!

doris-robot commented Sep 9, 2024

Uh oh!

doris-robot commented Sep 9, 2024

Uh oh!

doris-robot commented Sep 9, 2024

Uh oh!

doris-robot commented Sep 9, 2024

Uh oh!

zhangstar333 commented Sep 12, 2024

Uh oh!

zhangstar333 commented Sep 12, 2024

Uh oh!

doris-robot commented Sep 12, 2024

Uh oh!

doris-robot commented Sep 12, 2024

Uh oh!

doris-robot commented Sep 12, 2024

Uh oh!

doris-robot commented Sep 12, 2024

Uh oh!

github-actions bot commented Sep 12, 2024

Uh oh!

HappenLee left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

zhangstar333 commented Sep 3, 2024 •

edited

Loading