Skip to content

[enhance](mtmv)not allow modify data of MTMV #35870

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
morrySnow merged 10 commits into from
Jun 24, 2024
Merged

[enhance](mtmv)not allow modify data of MTMV #35870

morrySnow merged 10 commits into from
Jun 24, 2024

Conversation

@zddr
Copy link
Contributor

@zddr zddr commented Jun 4, 2024 •
edited
Loading

Prohibited scope：

  • Transaction related operations,such as:insert,update,delete
  • insert overwrite
  • truncate table

@doris-robot
Copy link

doris-robot commented Jun 4, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zddr
Copy link
Contributor Author

zddr commented Jun 4, 2024

run buildall

@zddr
Copy link
Contributor Author

zddr commented Jun 4, 2024

run buildall

@doris-robot
Copy link

doris-robot commented Jun 4, 2024

TPC-H: Total hot run time: 40843 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 91647de70369bae639a3e40a0644ec06b8eb632e, data reload: false

------ Round 1 ----------------------------------
q1	17611	4292	4236	4236
q2	2022	197	204	197
q3	10433	1200	1116	1116
q4	10199	906	843	843
q5	7494	2710	2838	2710
q6	225	136	132	132
q7	955	619	602	602
q8	9221	2117	2114	2114
q9	9191	6644	6632	6632
q10	9320	3934	3911	3911
q11	452	249	242	242
q12	422	232	237	232
q13	17876	3231	3303	3231
q14	254	230	221	221
q15	499	471	472	471
q16	508	396	408	396
q17	987	632	569	569
q18	8339	7988	7680	7680
q19	5927	1426	1600	1426
q20	655	321	322	321
q21	5059	3220	4299	3220
q22	399	341	349	341
Total cold run time: 118048 ms
Total hot run time: 40843 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4679	4438	4370	4370
q2	385	285	270	270
q3	3185	3052	2813	2813
q4	1890	1631	1649	1631
q5	5506	5501	5509	5501
q6	243	129	126	126
q7	2182	1822	1798	1798
q8	3234	3362	3342	3342
q9	8589	8690	8690	8690
q10	4062	3840	3689	3689
q11	585	500	517	500
q12	785	620	629	620
q13	15946	3121	3143	3121
q14	313	279	254	254
q15	519	476	478	476
q16	477	429	433	429
q17	1817	1482	1488	1482
q18	8146	7456	7306	7306
q19	1737	1601	1632	1601
q20	3049	1802	1784	1784
q21	8288	4793	4826	4793
q22	783	538	598	538
Total cold run time: 76400 ms
Total hot run time: 55134 ms

@doris-robot
Copy link

doris-robot commented Jun 4, 2024

TPC-DS: Total hot run time: 170842 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 91647de70369bae639a3e40a0644ec06b8eb632e, data reload: false

query1	915	381	373	373
query2	6455	2460	2527	2460
query3	6639	216	213	213
query4	19156	17302	17386	17302
query5	4174	450	453	450
query6	250	161	152	152
query7	4595	299	292	292
query8	326	290	291	290
query9	8515	2464	2450	2450
query10	449	305	278	278
query11	10498	10047	9963	9963
query12	141	89	91	89
query13	1671	376	381	376
query14	9323	7623	7498	7498
query15	228	204	190	190
query16	7807	275	276	275
query17	1508	521	506	506
query18	1849	276	281	276
query19	210	156	157	156
query20	97	89	90	89
query21	209	134	128	128
query22	4302	4088	4003	4003
query23	33565	33172	33116	33116
query24	11078	2901	2807	2807
query25	626	351	362	351
query26	1185	154	154	154
query27	2680	329	319	319
query28	6848	2091	2084	2084
query29	871	653	604	604
query30	262	152	151	151
query31	955	736	747	736
query32	94	52	58	52
query33	748	282	292	282
query34	961	486	467	467
query35	755	610	608	608
query36	1080	945	940	940
query37	152	70	68	68
query38	2847	2727	2786	2727
query39	893	813	805	805
query40	207	130	125	125
query41	47	53	51	51
query42	127	96	101	96
query43	590	577	558	558
query44	1196	725	733	725
query45	206	168	161	161
query46	1076	754	721	721
query47	1828	1769	1762	1762
query48	379	300	309	300
query49	1012	421	458	421
query50	777	400	398	398
query51	6973	6755	6782	6755
query52	99	89	94	89
query53	352	288	280	280
query54	867	453	436	436
query55	72	72	73	72
query56	280	252	259	252
query57	1137	1053	1048	1048
query58	282	255	254	254
query59	3430	3312	3102	3102
query60	282	278	290	278
query61	89	88	88	88
query62	635	447	437	437
query63	315	286	290	286
query64	8894	2200	1692	1692
query65	3159	3105	3112	3105
query66	820	331	325	325
query67	15251	15022	14976	14976
query68	4498	541	542	541
query69	457	302	313	302
query70	1094	1144	1136	1136
query71	410	294	300	294
query72	7090	5419	2736	2736
query73	737	327	323	323
query74	5978	5510	5499	5499
query75	3422	2636	2642	2636
query76	2325	865	868	865
query77	447	295	298	295
query78	10254	9800	9752	9752
query79	1149	514	510	510
query80	669	462	458	458
query81	577	217	223	217
query82	622	103	101	101
query83	188	171	163	163
query84	253	85	81	81
query85	1147	282	262	262
query86	412	297	302	297
query87	3254	3142	3078	3078
query88	4112	2446	2421	2421
query89	456	381	368	368
query90	1871	190	188	188
query91	122	99	97	97
query92	56	51	49	49
query93	1982	519	501	501
query94	1202	193	194	193
query95	403	314	325	314
query96	589	264	272	264
query97	3178	3036	2976	2976
query98	236	218	220	218
query99	1219	838	834	834
Total cold run time: 265708 ms
Total hot run time: 170842 ms

@doris-robot
Copy link

doris-robot commented Jun 4, 2024

ClickBench: Total hot run time: 30.08 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 91647de70369bae639a3e40a0644ec06b8eb632e, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.03	0.04
query3	0.23	0.06	0.05
query4	1.68	0.08	0.08
query5	0.50	0.50	0.48
query6	1.12	0.72	0.73
query7	0.02	0.02	0.02
query8	0.05	0.04	0.04
query9	0.53	0.48	0.48
query10	0.55	0.54	0.55
query11	0.15	0.12	0.12
query12	0.15	0.12	0.12
query13	0.59	0.59	0.59
query14	0.78	0.78	0.78
query15	0.82	0.82	0.80
query16	0.37	0.36	0.37
query17	1.02	1.02	1.04
query18	0.20	0.26	0.22
query19	1.91	1.70	1.79
query20	0.02	0.01	0.01
query21	15.44	0.72	0.71
query22	4.31	8.34	1.36
query23	18.25	1.38	1.26
query24	2.00	0.21	0.20
query25	0.15	0.08	0.08
query26	0.26	0.18	0.17
query27	0.08	0.08	0.08
query28	13.26	1.01	1.00
query29	12.81	3.35	3.29
query30	0.24	0.05	0.05
query31	2.88	0.40	0.40
query32	3.25	0.47	0.46
query33	2.93	2.88	2.89
query34	16.99	4.40	4.40
query35	4.47	4.55	4.51
query36	0.72	0.48	0.47
query37	0.18	0.15	0.16
query38	0.15	0.14	0.15
query39	0.05	0.03	0.04
query40	0.16	0.15	0.14
query41	0.09	0.04	0.04
query42	0.05	0.05	0.04
query43	0.04	0.03	0.04
Total cold run time: 109.57 s
Total hot run time: 30.08 s

@zddr
Copy link
Contributor Author

zddr commented Jun 4, 2024

run buildall

@doris-robot
Copy link

doris-robot commented Jun 4, 2024

TPC-H: Total hot run time: 40282 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8712f3dcbca61d276ba61ff823bc1db0d3b73c4a, data reload: false

------ Round 1 ----------------------------------
q1	17714	4430	4454	4430
q2	2673	205	190	190
q3	12669	1161	1162	1161
q4	10502	789	822	789
q5	7814	2758	2718	2718
q6	224	135	140	135
q7	971	595	599	595
q8	9222	2077	2120	2077
q9	9089	6539	6493	6493
q10	8982	3732	3724	3724
q11	455	252	241	241
q12	410	232	231	231
q13	17760	3022	2980	2980
q14	267	235	218	218
q15	523	467	474	467
q16	499	380	381	380
q17	978	703	697	697
q18	8097	7509	7420	7420
q19	7593	1498	1562	1498
q20	670	315	311	311
q21	4942	3180	3824	3180
q22	400	350	347	347
Total cold run time: 122454 ms
Total hot run time: 40282 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4408	4202	4255	4202
q2	372	276	266	266
q3	2996	2743	2766	2743
q4	1848	1624	1636	1624
q5	5259	5267	5271	5267
q6	220	125	127	125
q7	2072	1764	1701	1701
q8	3176	3332	3289	3289
q9	8338	8338	8345	8338
q10	3856	3703	3664	3664
q11	602	516	489	489
q12	772	586	601	586
q13	17532	2978	2974	2974
q14	299	268	251	251
q15	531	464	480	464
q16	481	432	418	418
q17	1779	1486	1481	1481
q18	7726	7458	7432	7432
q19	2061	1536	1480	1480
q20	2018	1778	1770	1770
q21	4839	4786	4724	4724
q22	620	524	551	524
Total cold run time: 71805 ms
Total hot run time: 53812 ms

@doris-robot
Copy link

doris-robot commented Jun 4, 2024

TPC-DS: Total hot run time: 169941 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8712f3dcbca61d276ba61ff823bc1db0d3b73c4a, data reload: false

query1	934	386	374	374
query2	6461	2327	2297	2297
query3	6645	212	215	212
query4	20103	17461	17333	17333
query5	4116	460	462	460
query6	250	159	164	159
query7	4581	295	290	290
query8	324	286	303	286
query9	8432	2461	2427	2427
query10	440	314	284	284
query11	10525	9961	10044	9961
query12	139	90	91	90
query13	1647	360	369	360
query14	9387	6959	7613	6959
query15	230	187	186	186
query16	7789	273	270	270
query17	1817	528	527	527
query18	1943	272	271	271
query19	205	152	151	151
query20	94	84	83	83
query21	203	131	125	125
query22	4291	4073	4118	4073
query23	33723	32817	32999	32817
query24	11882	2865	2739	2739
query25	667	355	384	355
query26	1813	152	157	152
query27	2972	323	324	323
query28	7592	2083	2107	2083
query29	1147	603	606	603
query30	284	147	150	147
query31	951	750	733	733
query32	90	52	53	52
query33	759	286	276	276
query34	966	469	479	469
query35	832	603	627	603
query36	1067	955	933	933
query37	197	69	75	69
query38	2865	2742	2703	2703
query39	862	784	776	776
query40	282	123	124	123
query41	54	50	54	50
query42	125	101	97	97
query43	589	558	548	548
query44	1263	726	751	726
query45	199	167	167	167
query46	1079	704	749	704
query47	1869	1792	1785	1785
query48	383	304	310	304
query49	1191	414	415	414
query50	781	390	397	390
query51	6848	6710	6623	6623
query52	100	90	94	90
query53	356	291	318	291
query54	981	478	458	458
query55	77	75	73	73
query56	279	259	266	259
query57	1148	1044	1087	1044
query58	255	241	239	239
query59	3358	3312	3320	3312
query60	294	271	264	264
query61	107	89	87	87
query62	631	448	427	427
query63	315	287	289	287
query64	9872	2217	1731	1731
query65	3135	3124	3096	3096
query66	1365	325	335	325
query67	15447	14856	15082	14856
query68	4567	542	534	534
query69	462	320	351	320
query70	1185	1117	1119	1117
query71	398	284	285	284
query72	7038	5613	2761	2761
query73	767	338	329	329
query74	5902	5486	5428	5428
query75	3386	2656	2678	2656
query76	2436	945	884	884
query77	434	301	298	298
query78	10266	9776	9737	9737
query79	2737	513	519	513
query80	1503	472	463	463
query81	579	217	220	217
query82	853	100	100	100
query83	277	171	175	171
query84	256	85	86	85
query85	1521	313	315	313
query86	467	312	338	312
query87	3319	3082	3093	3082
query88	3978	2477	2473	2473
query89	470	382	378	378
query90	1765	196	193	193
query91	136	110	112	110
query92	66	52	56	52
query93	1803	521	509	509
query94	1245	207	199	199
query95	411	320	328	320
query96	597	280	271	271
query97	3228	3018	3030	3018
query98	244	220	216	216
query99	1279	847	817	817
Total cold run time: 275183 ms
Total hot run time: 169941 ms

@doris-robot
Copy link

doris-robot commented Jun 4, 2024

ClickBench: Total hot run time: 31.53 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8712f3dcbca61d276ba61ff823bc1db0d3b73c4a, data reload: false

query1	0.04	0.03	0.04
query2	0.09	0.04	0.04
query3	0.23	0.04	0.04
query4	1.68	0.06	0.07
query5	0.51	0.48	0.51
query6	1.13	0.73	0.72
query7	0.02	0.01	0.02
query8	0.04	0.04	0.04
query9	0.55	0.48	0.48
query10	0.54	0.55	0.55
query11	0.15	0.11	0.11
query12	0.15	0.11	0.12
query13	0.60	0.60	0.60
query14	0.76	0.78	0.76
query15	0.83	0.81	0.80
query16	0.37	0.34	0.36
query17	1.04	1.05	1.04
query18	0.22	0.25	0.22
query19	1.90	1.77	1.76
query20	0.01	0.01	0.01
query21	15.44	0.71	0.70
query22	4.82	5.87	2.85
query23	18.28	1.40	1.37
query24	1.47	0.40	0.20
query25	0.14	0.08	0.08
query26	0.28	0.17	0.18
query27	0.08	0.08	0.07
query28	13.28	1.02	0.99
query29	12.67	3.32	3.26
query30	0.25	0.06	0.05
query31	2.88	0.39	0.38
query32	3.27	0.47	0.46
query33	2.89	2.89	2.91
query34	16.97	4.36	4.40
query35	4.50	4.50	4.46
query36	0.66	0.46	0.46
query37	0.18	0.15	0.16
query38	0.16	0.14	0.15
query39	0.04	0.04	0.03
query40	0.17	0.14	0.15
query41	0.10	0.05	0.04
query42	0.05	0.04	0.04
query43	0.04	0.04	0.04
Total cold run time: 109.48 s
Total hot run time: 31.53 s

@zddr
Copy link
Contributor Author

zddr commented Jun 5, 2024

run buildall

@doris-robot
Copy link

doris-robot commented Jun 5, 2024

TPC-H: Total hot run time: 40826 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e78b295cbe0180ae8b9dc70035796e4c1d88e1a0, data reload: false

------ Round 1 ----------------------------------
q1	17634	4358	4257	4257
q2	2023	198	193	193
q3	10459	1233	1120	1120
q4	10179	871	804	804
q5	7468	2755	2694	2694
q6	221	137	142	137
q7	960	630	628	628
q8	9228	2136	2093	2093
q9	9012	6700	6757	6700
q10	9361	3872	3850	3850
q11	464	248	250	248
q12	467	244	252	244
q13	17532	3220	3248	3220
q14	273	233	222	222
q15	510	470	472	470
q16	466	374	380	374
q17	988	612	588	588
q18	8395	7848	7694	7694
q19	5613	1454	1285	1285
q20	649	332	311	311
q21	5397	3965	3355	3355
q22	398	339	340	339
Total cold run time: 117697 ms
Total hot run time: 40826 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4566	4523	4499	4499
q2	397	257	262	257
q3	3211	2963	2977	2963
q4	2025	1662	1666	1662
q5	5446	5556	5563	5556
q6	226	128	126	126
q7	2179	1812	1842	1812
q8	3263	3454	3392	3392
q9	8891	8810	8887	8810
q10	4316	4078	3974	3974
q11	613	501	518	501
q12	829	673	634	634
q13	16071	3114	3179	3114
q14	289	266	266	266
q15	509	497	496	496
q16	493	424	439	424
q17	1818	1535	1517	1517
q18	8284	7774	7227	7227
q19	1785	1530	1611	1530
q20	3024	1799	1804	1799
q21	8665	4651	4859	4651
q22	706	512	516	512
Total cold run time: 77606 ms
Total hot run time: 55722 ms

@doris-robot
Copy link

doris-robot commented Jun 5, 2024

TPC-DS: Total hot run time: 168182 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e78b295cbe0180ae8b9dc70035796e4c1d88e1a0, data reload: false

query1	901	374	371	371
query2	6456	2465	2379	2379
query3	6652	202	207	202
query4	21011	17388	17403	17388
query5	4142	434	435	434
query6	244	157	155	155
query7	4540	294	284	284
query8	300	263	263	263
query9	8349	2432	2410	2410
query10	424	293	277	277
query11	10524	9996	10016	9996
query12	132	89	84	84
query13	1614	358	360	358
query14	10165	7543	6031	6031
query15	222	184	182	182
query16	7944	264	260	260
query17	1790	534	510	510
query18	2003	265	265	265
query19	195	158	154	154
query20	93	86	81	81
query21	206	130	128	128
query22	4310	4048	4043	4043
query23	33625	32951	33112	32951
query24	10739	2840	2894	2840
query25	596	363	397	363
query26	701	150	150	150
query27	2234	317	310	310
query28	5862	2072	2059	2059
query29	863	597	598	597
query30	287	147	151	147
query31	950	747	717	717
query32	95	56	59	56
query33	664	300	261	261
query34	858	474	459	459
query35	725	656	603	603
query36	1094	938	953	938
query37	136	66	68	66
query38	2864	2760	2749	2749
query39	873	798	805	798
query40	209	127	125	125
query41	55	50	51	50
query42	116	96	98	96
query43	586	556	556	556
query44	1078	724	740	724
query45	193	162	170	162
query46	1073	727	724	724
query47	1860	1731	1777	1731
query48	364	289	287	287
query49	953	403	402	402
query50	784	410	388	388
query51	6772	6696	6793	6696
query52	110	89	92	89
query53	360	284	280	280
query54	850	442	427	427
query55	73	70	73	70
query56	271	275	248	248
query57	1096	1074	1022	1022
query58	245	229	230	229
query59	3294	3266	3024	3024
query60	300	265	275	265
query61	89	83	89	83
query62	593	453	448	448
query63	317	284	293	284
query64	8540	2233	1744	1744
query65	3192	3096	3134	3096
query66	793	328	319	319
query67	15399	14861	14917	14861
query68	4569	540	537	537
query69	564	432	348	348
query70	1167	1051	1060	1051
query71	379	280	281	280
query72	7067	2703	2554	2554
query73	756	315	316	315
query74	5856	5479	5456	5456
query75	3319	2758	2646	2646
query76	2387	912	934	912
query77	636	282	287	282
query78	10145	9572	9722	9572
query79	2085	504	518	504
query80	768	447	442	442
query81	583	219	219	219
query82	1383	104	101	101
query83	185	165	164	164
query84	242	82	81	81
query85	1339	261	254	254
query86	492	285	316	285
query87	3249	3083	3110	3083
query88	3850	2349	2334	2334
query89	470	388	383	383
query90	1858	186	192	186
query91	133	107	105	105
query92	63	50	51	50
query93	2310	512	502	502
query94	1241	200	263	200
query95	399	306	298	298
query96	580	266	266	266
query97	3183	2975	2969	2969
query98	233	223	221	221
query99	1257	841	833	833
Total cold run time: 267696 ms
Total hot run time: 168182 ms

@doris-robot
Copy link

doris-robot commented Jun 5, 2024

ClickBench: Total hot run time: 31.19 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e78b295cbe0180ae8b9dc70035796e4c1d88e1a0, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.03	0.04
query3	0.22	0.05	0.05
query4	1.68	0.09	0.09
query5	0.49	0.50	0.50
query6	1.13	0.72	0.73
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.53	0.49	0.49
query10	0.53	0.56	0.55
query11	0.15	0.11	0.11
query12	0.15	0.12	0.12
query13	0.60	0.59	0.60
query14	0.78	0.77	0.78
query15	0.85	0.82	0.80
query16	0.35	0.38	0.37
query17	1.00	1.07	1.02
query18	0.24	0.23	0.24
query19	1.80	1.73	1.74
query20	0.02	0.01	0.01
query21	15.45	0.74	0.68
query22	4.89	6.13	2.31
query23	18.30	1.39	1.24
query24	1.90	0.20	0.22
query25	0.15	0.08	0.08
query26	0.26	0.16	0.17
query27	0.09	0.07	0.08
query28	13.35	1.01	0.99
query29	13.36	3.42	3.37
query30	0.24	0.05	0.05
query31	2.89	0.39	0.38
query32	3.34	0.47	0.47
query33	2.90	2.93	2.95
query34	17.00	4.44	4.40
query35	4.51	4.58	4.61
query36	0.66	0.48	0.47
query37	0.17	0.14	0.15
query38	0.15	0.13	0.13
query39	0.04	0.03	0.04
query40	0.18	0.14	0.14
query41	0.08	0.04	0.04
query42	0.06	0.04	0.04
query43	0.04	0.03	0.03
Total cold run time: 110.72 s
Total hot run time: 31.19 s

@zddr
Copy link
Contributor Author

zddr commented Jun 7, 2024

run buildall

@doris-robot
Copy link

doris-robot commented Jun 7, 2024

TPC-H: Total hot run time: 40124 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 66034ef0f9ae673af9af2b9f70a1126c0d215e8b, data reload: false

------ Round 1 ----------------------------------
q1	18105	5154	4419	4419
q2	2902	209	214	209
q3	11130	1206	1121	1121
q4	10693	802	770	770
q5	7503	2700	2690	2690
q6	222	141	142	141
q7	971	635	612	612
q8	9598	2085	2070	2070
q9	8972	6420	6395	6395
q10	8893	3718	3722	3718
q11	440	250	243	243
q12	403	227	227	227
q13	17754	2993	3012	2993
q14	262	222	215	215
q15	510	487	466	466
q16	526	382	395	382
q17	956	677	702	677
q18	8055	7549	7446	7446
q19	7732	1480	1551	1480
q20	642	320	326	320
q21	4951	3190	4068	3190
q22	407	342	340	340
Total cold run time: 121627 ms
Total hot run time: 40124 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4389	4267	4266	4266
q2	370	261	269	261
q3	2983	2762	2722	2722
q4	1859	1624	1626	1624
q5	5276	5304	5286	5286
q6	215	127	134	127
q7	2136	1700	1763	1700
q8	3150	3321	3325	3321
q9	8376	8296	8321	8296
q10	3889	3711	3705	3705
q11	583	481	484	481
q12	780	631	595	595
q13	17502	2954	2973	2954
q14	285	278	289	278
q15	519	469	480	469
q16	469	420	416	416
q17	1766	1515	1506	1506
q18	7591	7603	7286	7286
q19	1720	1531	1627	1531
q20	1983	1793	1770	1770
q21	4913	4833	4748	4748
q22	613	562	545	545
Total cold run time: 71367 ms
Total hot run time: 53887 ms

@doris-robot
Copy link

doris-robot commented Jun 7, 2024

TPC-DS: Total hot run time: 173116 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 66034ef0f9ae673af9af2b9f70a1126c0d215e8b, data reload: false

query1	930	374	371	371
query2	6443	2562	2291	2291
query3	6649	207	211	207
query4	19135	17212	17152	17152
query5	4244	460	458	458
query6	253	155	152	152
query7	4596	296	286	286
query8	314	294	286	286
query9	8426	2415	2370	2370
query10	464	288	284	284
query11	10545	10063	9981	9981
query12	127	82	88	82
query13	1634	362	363	362
query14	10164	8043	7887	7887
query15	235	193	191	191
query16	7795	270	274	270
query17	1818	534	533	533
query18	1867	283	285	283
query19	217	159	156	156
query20	101	86	92	86
query21	209	137	125	125
query22	4245	4114	4029	4029
query23	33940	33129	33172	33129
query24	12027	2874	2745	2745
query25	659	370	374	370
query26	1758	154	159	154
query27	2993	309	319	309
query28	7428	2042	2032	2032
query29	1094	608	595	595
query30	291	151	149	149
query31	951	739	729	729
query32	91	55	52	52
query33	753	279	278	278
query34	1028	473	496	473
query35	751	622	604	604
query36	1106	945	936	936
query37	285	69	70	69
query38	2917	2746	2720	2720
query39	909	790	787	787
query40	286	121	122	121
query41	55	51	57	51
query42	123	106	94	94
query43	579	563	542	542
query44	1243	726	741	726
query45	199	165	162	162
query46	1073	736	698	698
query47	1829	1771	1774	1771
query48	373	295	298	295
query49	1178	427	407	407
query50	784	377	382	377
query51	6809	6748	6626	6626
query52	107	89	96	89
query53	359	293	287	287
query54	980	494	458	458
query55	76	75	72	72
query56	274	254	259	254
query57	1170	1045	1081	1045
query58	250	246	243	243
query59	3400	3150	3171	3150
query60	295	270	267	267
query61	93	89	92	89
query62	648	455	451	451
query63	332	293	294	293
query64	9875	2295	1771	1771
query65	3170	3143	3082	3082
query66	1360	331	327	327
query67	15312	15214	14938	14938
query68	4517	542	546	542
query69	454	310	292	292
query70	1135	1162	1133	1133
query71	405	268	266	266
query72	7148	5310	5436	5310
query73	729	320	313	313
query74	5927	5433	5557	5433
query75	3508	2675	2708	2675
query76	2943	1029	890	890
query77	453	289	292	289
query78	10239	9951	9807	9807
query79	2066	504	504	504
query80	1183	478	456	456
query81	538	219	219	219
query82	667	112	100	100
query83	234	178	173	173
query84	242	83	85	83
query85	2022	274	300	274
query86	488	335	321	321
query87	3242	3111	3065	3065
query88	3982	2349	2327	2327
query89	480	402	385	385
query90	1812	191	187	187
query91	128	100	97	97
query92	63	48	47	47
query93	2409	526	501	501
query94	1294	200	194	194
query95	407	317	377	317
query96	600	261	261	261
query97	3237	2961	2989	2961
query98	223	203	200	200
query99	1099	835	839	835
Total cold run time: 275498 ms
Total hot run time: 173116 ms

@doris-robot
Copy link

doris-robot commented Jun 7, 2024

ClickBench: Total hot run time: 30.28 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 66034ef0f9ae673af9af2b9f70a1126c0d215e8b, data reload: false

query1	0.04	0.03	0.04
query2	0.08	0.03	0.04
query3	0.23	0.05	0.05
query4	1.69	0.07	0.08
query5	0.52	0.48	0.49
query6	1.13	0.72	0.73
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.54	0.50	0.49
query10	0.55	0.54	0.55
query11	0.15	0.12	0.11
query12	0.14	0.12	0.12
query13	0.59	0.59	0.59
query14	0.81	0.83	0.78
query15	0.84	0.83	0.83
query16	0.35	0.37	0.37
query17	1.04	1.01	1.03
query18	0.22	0.25	0.23
query19	1.84	1.85	1.71
query20	0.02	0.01	0.01
query21	15.47	0.72	0.69
query22	5.02	7.14	1.49
query23	18.29	1.40	1.29
query24	2.10	0.24	0.22
query25	0.15	0.10	0.08
query26	0.26	0.18	0.18
query27	0.07	0.08	0.07
query28	13.24	1.03	1.00
query29	12.72	3.25	3.23
query30	0.25	0.06	0.06
query31	2.87	0.41	0.39
query32	3.27	0.47	0.48
query33	2.92	2.92	2.93
query34	16.98	4.45	4.42
query35	4.50	4.49	4.57
query36	0.65	0.47	0.48
query37	0.17	0.16	0.14
query38	0.16	0.15	0.15
query39	0.04	0.04	0.03
query40	0.17	0.14	0.15
query41	0.09	0.04	0.06
query42	0.06	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 110.34 s
Total hot run time: 30.28 s

@zddr
Copy link
Contributor Author

zddr commented Jun 13, 2024

run buildall

@doris-robot
Copy link

doris-robot commented Jun 13, 2024

TPC-H: Total hot run time: 40017 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 14f67f896e1553c613ef4eecdd90b97271bc5990, data reload: false

------ Round 1 ----------------------------------
q1	17598	4283	4248	4248
q2	2021	192	215	192
q3	10430	1090	1061	1061
q4	10186	793	765	765
q5	7453	2707	2620	2620
q6	229	136	136	136
q7	974	634	594	594
q8	9229	2030	2051	2030
q9	8955	6454	6506	6454
q10	8899	3756	3696	3696
q11	436	231	225	225
q12	456	234	229	229
q13	17762	2962	2995	2962
q14	263	218	220	218
q15	509	477	467	467
q16	509	369	378	369
q17	951	746	657	657
q18	8230	7985	7714	7714
q19	9092	1440	1378	1378
q20	697	326	323	323
q21	5070	3971	3334	3334
q22	405	351	345	345
Total cold run time: 120354 ms
Total hot run time: 40017 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4666	4422	4490	4422
q2	392	271	263	263
q3	3012	2859	2860	2859
q4	1987	1710	1676	1676
q5	5504	5499	5476	5476
q6	225	133	128	128
q7	2180	1838	1917	1838
q8	3263	3429	3406	3406
q9	8621	8582	8665	8582
q10	4025	3886	3832	3832
q11	572	490	495	490
q12	860	650	621	621
q13	15837	2992	3075	2992
q14	311	279	273	273
q15	510	497	486	486
q16	482	446	436	436
q17	1779	1530	1498	1498
q18	8023	7731	7747	7731
q19	1746	1725	1497	1497
q20	3024	1888	1845	1845
q21	9925	4868	4740	4740
q22	634	574	531	531
Total cold run time: 77578 ms
Total hot run time: 55622 ms

@doris-robot
Copy link

doris-robot commented Jun 13, 2024

TPC-DS: Total hot run time: 171951 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 14f67f896e1553c613ef4eecdd90b97271bc5990, data reload: false

query1	800	383	368	368
query2	6338	2503	2272	2272
query3	6397	203	203	203
query4	18853	17353	17210	17210
query5	3731	463	462	462
query6	243	157	164	157
query7	4450	296	297	296
query8	325	285	290	285
query9	8500	2456	2410	2410
query10	567	292	291	291
query11	10470	10052	9948	9948
query12	139	91	85	85
query13	1595	353	354	353
query14	9266	6810	6130	6130
query15	223	191	185	185
query16	7143	263	266	263
query17	1031	526	514	514
query18	1905	271	289	271
query19	194	154	148	148
query20	88	83	78	78
query21	205	129	129	129
query22	4382	4144	3924	3924
query23	33463	33621	33516	33516
query24	10866	2845	2849	2845
query25	616	358	352	352
query26	715	153	152	152
query27	2239	312	319	312
query28	5831	2060	2057	2057
query29	863	616	629	616
query30	248	147	153	147
query31	947	725	735	725
query32	98	52	55	52
query33	659	275	273	273
query34	875	468	457	457
query35	782	646	605	605
query36	1103	941	906	906
query37	132	67	72	67
query38	2867	2730	2741	2730
query39	833	775	797	775
query40	208	122	124	122
query41	52	55	56	55
query42	127	97	97	97
query43	587	551	531	531
query44	1072	713	710	710
query45	196	158	163	158
query46	1088	725	723	723
query47	1844	1799	1806	1799
query48	359	294	312	294
query49	853	404	390	390
query50	767	393	383	383
query51	6751	6635	6669	6635
query52	104	93	96	93
query53	364	290	287	287
query54	873	444	437	437
query55	74	71	75	71
query56	274	254	266	254
query57	1163	1071	1046	1046
query58	254	236	285	236
query59	3463	3474	3332	3332
query60	290	271	266	266
query61	90	86	91	86
query62	610	436	457	436
query63	312	287	290	287
query64	8515	2249	1791	1791
query65	3128	3134	3092	3092
query66	945	319	336	319
query67	15750	14900	14944	14900
query68	4470	525	527	525
query69	550	395	342	342
query70	1169	1159	1165	1159
query71	402	265	266	265
query72	7070	5496	5133	5133
query73	755	324	321	321
query74	5786	5553	5531	5531
query75	3384	2650	2628	2628
query76	2363	956	862	862
query77	433	307	288	288
query78	10176	9846	9876	9846
query79	2260	510	509	509
query80	1173	470	453	453
query81	587	222	226	222
query82	970	104	99	99
query83	228	160	172	160
query84	332	83	85	83
query85	1235	297	274	274
query86	475	313	317	313
query87	3284	3068	3102	3068
query88	3382	2433	2436	2433
query89	454	372	386	372
query90	1768	182	180	180
query91	122	96	101	96
query92	62	48	47	47
query93	1844	496	491	491
query94	1208	188	187	187
query95	413	315	310	310
query96	599	275	269	269
query97	3183	3059	3080	3059
query98	214	204	194	194
query99	1336	863	833	833
Total cold run time: 261782 ms
Total hot run time: 171951 ms

@doris-robot
Copy link

doris-robot commented Jun 13, 2024

ClickBench: Total hot run time: 30.34 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 14f67f896e1553c613ef4eecdd90b97271bc5990, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.03	0.04
query3	0.23	0.05	0.05
query4	1.67	0.09	0.08
query5	0.50	0.50	0.50
query6	1.13	0.71	0.72
query7	0.02	0.01	0.01
query8	0.05	0.04	0.05
query9	0.54	0.49	0.50
query10	0.54	0.54	0.52
query11	0.16	0.11	0.11
query12	0.14	0.12	0.12
query13	0.59	0.58	0.61
query14	0.79	0.79	0.79
query15	0.83	0.82	0.82
query16	0.37	0.36	0.34
query17	0.98	0.95	0.95
query18	0.20	0.28	0.24
query19	1.75	1.69	1.70
query20	0.01	0.01	0.01
query21	15.41	0.66	0.65
query22	3.63	7.58	1.91
query23	18.32	1.32	1.23
query24	2.14	0.22	0.23
query25	0.15	0.08	0.08
query26	0.26	0.17	0.18
query27	0.09	0.08	0.07
query28	13.22	1.01	0.98
query29	12.67	3.27	3.27
query30	0.26	0.06	0.09
query31	2.84	0.39	0.39
query32	3.28	0.46	0.47
query33	2.89	2.85	2.84
query34	17.17	4.39	4.43
query35	4.42	4.45	4.48
query36	0.65	0.46	0.45
query37	0.18	0.15	0.15
query38	0.15	0.14	0.15
query39	0.05	0.04	0.03
query40	0.17	0.15	0.14
query41	0.09	0.05	0.05
query42	0.05	0.06	0.05
query43	0.05	0.04	0.04
Total cold run time: 108.76 s
Total hot run time: 30.34 s

@zddr
Copy link
Contributor Author

zddr commented Jun 13, 2024

run feut

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jun 21, 2024
@github-actions
Copy link
Contributor

github-actions bot commented Jun 21, 2024

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Jun 21, 2024

PR approved by anyone and no changes requested.

morrySnow
morrySnow reviewed Jun 21, 2024
View reviewed changes
regression-test/suites/mtmv_p0/test_modify_data_mtmv.groovy
"""

sql """
insert into ${tableName} values(1,1),(2,2),(3,3);
Copy link
Contributor

@morrySnow morrySnow Jun 21, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should also test stream load, routine load, broker load, update, delete and truncate

Copy link
Contributor Author

@zddr zddr Jun 21, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i will do it in other pr

morningman
morningman approved these changes Jun 21, 2024
View reviewed changes
Copy link
Contributor

@morningman morningman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@morrySnow morrySnow merged commit 49a72b1 into apache:master Jun 24, 2024
dataroaring pushed a commit that referenced this pull request Jun 26, 2024
@zddr @dataroaring
[enhance](mtmv) not allow modify data of MTMV (#35870)
ad6466a 
Prohibited scope：
- Transaction related operations,such as:insert,update,delete
- insert overwrite
- truncate table
zddr added a commit to zddr/incubator-doris that referenced this pull request Jul 2, 2024
@zddr
[enhance](mtmv) not allow modify data of MTMV (apache#35870)
10cf8a9 
Prohibited scope：
- Transaction related operations,such as:insert,update,delete
- insert overwrite
- truncate table
@zddr zddr mentioned this pull request Jul 2, 2024
Merged
morningman pushed a commit that referenced this pull request Jul 2, 2024
@zddr
[enhance](mtmv) not allow modify data of MTMV (#35870) (#37129)
fbca319 
pick: #35870
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@morningman morningman morningman approved these changes

@morrySnow morrySnow morrySnow approved these changes

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.5-merged dev/3.0.0-merged reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@zddr @doris-robot @morningman @morrySnow @dataroaring