Skip to content

Conversation

@seawinde
Copy link
Contributor

@seawinde seawinde commented Sep 23, 2024

Proposed changes

This is brought by #39265

  1. Some test fail because MaterializedViewRewriteSuccessButNotChose, because in these tests materialized view are not analyzed after create, So Add analyze clause when waite materialized view task finished
  2. No signature of method: org.apache.doris.regression.suite.Suite.check_mv_rewrite_success(), because check_mv_rewrite_success is not available in Suite.groovy. Fix this by using correct method.
  3. If partition row count statistics is not ready, should not check mv rewrte by CBO succesfully

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@seawinde
Copy link
Contributor Author

run buildall

@morningman morningman changed the title Fix regression test unstable and error [fix](mtmv) regression test unstable and error Sep 23, 2024
morningman
morningman previously approved these changes Sep 23, 2024
Copy link
Contributor

@morningman morningman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Sep 23, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

morrySnow
morrySnow previously approved these changes Sep 23, 2024
@seawinde seawinde dismissed stale reviews from morrySnow and morningman via 120c66f September 23, 2024 12:36
@seawinde
Copy link
Contributor Author

run buildall

@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Sep 23, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 41676 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 120c66f202726f25478b09f25b2eff4dd2f182a6, data reload: false

------ Round 1 ----------------------------------
q1	17616	7462	7314	7314
q2	2002	283	279	279
q3	12290	1074	1274	1074
q4	10568	811	774	774
q5	7792	3119	3119	3119
q6	244	154	148	148
q7	1031	618	602	602
q8	9503	2082	2055	2055
q9	7876	6450	6443	6443
q10	7006	2339	2313	2313
q11	440	242	243	242
q12	422	217	209	209
q13	17792	2943	2948	2943
q14	245	208	221	208
q15	579	533	511	511
q16	685	623	623	623
q17	976	823	870	823
q18	7181	6685	6782	6685
q19	1398	1004	971	971
q20	566	270	282	270
q21	3984	3354	3082	3082
q22	1098	988	1001	988
Total cold run time: 111294 ms
Total hot run time: 41676 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7432	7332	8104	7332
q2	328	238	251	238
q3	3101	2957	2974	2957
q4	2077	1810	1741	1741
q5	5720	5536	5718	5536
q6	235	148	145	145
q7	2185	1828	1797	1797
q8	3320	3500	3438	3438
q9	8876	8839	8782	8782
q10	3477	3506	3480	3480
q11	583	470	458	458
q12	829	623	608	608
q13	10949	3154	3136	3136
q14	305	288	285	285
q15	556	552	525	525
q16	706	683	684	683
q17	1814	1624	1622	1622
q18	8189	7672	7830	7672
q19	1742	1634	1709	1634
q20	2132	1902	1885	1885
q21	5359	5370	5373	5370
q22	1155	1042	1012	1012
Total cold run time: 71070 ms
Total hot run time: 60336 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191859 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 120c66f202726f25478b09f25b2eff4dd2f182a6, data reload: false

query1	934	382	382	382
query2	6339	1970	1975	1970
query3	8694	203	198	198
query4	33892	23558	23609	23558
query5	3462	470	466	466
query6	286	174	165	165
query7	4188	297	309	297
query8	290	226	218	218
query9	9251	2632	2625	2625
query10	458	278	274	274
query11	18425	15267	15192	15192
query12	153	100	101	100
query13	1538	435	424	424
query14	9526	7444	7286	7286
query15	250	168	171	168
query16	8103	501	484	484
query17	1671	628	574	574
query18	2215	317	324	317
query19	367	161	156	156
query20	123	121	114	114
query21	210	103	105	103
query22	4642	4651	4495	4495
query23	35231	34804	34397	34397
query24	11045	2857	2883	2857
query25	624	427	408	408
query26	1138	161	156	156
query27	2357	287	283	283
query28	7485	2436	2436	2436
query29	815	432	426	426
query30	259	157	157	157
query31	1008	793	784	784
query32	102	52	53	52
query33	749	302	293	293
query34	926	503	471	471
query35	867	721	727	721
query36	1092	939	941	939
query37	161	88	87	87
query38	4024	3901	3853	3853
query39	1497	1413	1411	1411
query40	213	95	96	95
query41	50	48	48	48
query42	120	96	97	96
query43	511	472	474	472
query44	1246	827	796	796
query45	202	163	162	162
query46	1134	763	749	749
query47	1933	1821	1886	1821
query48	475	387	351	351
query49	872	384	383	383
query50	814	396	407	396
query51	7045	6921	6948	6921
query52	101	86	82	82
query53	250	174	171	171
query54	1128	465	470	465
query55	77	72	79	72
query56	269	257	249	249
query57	1211	1110	1101	1101
query58	235	236	227	227
query59	3191	3004	2835	2835
query60	295	257	249	249
query61	104	104	108	104
query62	799	685	674	674
query63	220	183	182	182
query64	3928	641	617	617
query65	3257	3179	3167	3167
query66	765	299	294	294
query67	15778	15587	15572	15572
query68	4925	573	561	561
query69	551	286	287	286
query70	1191	1111	1131	1111
query71	379	267	268	267
query72	7577	4184	4024	4024
query73	755	320	334	320
query74	10380	8903	9040	8903
query75	3994	2635	2648	2635
query76	3308	970	884	884
query77	721	286	292	286
query78	9954	10094	9554	9554
query79	2105	538	541	538
query80	1209	443	448	443
query81	588	243	250	243
query82	483	145	150	145
query83	356	131	139	131
query84	286	82	73	73
query85	1318	284	274	274
query86	447	314	298	298
query87	4522	4404	4368	4368
query88	3521	2339	2307	2307
query89	395	277	289	277
query90	2045	186	187	186
query91	176	145	148	145
query92	63	46	48	46
query93	1267	528	534	528
query94	930	291	290	290
query95	353	249	253	249
query96	608	271	279	271
query97	3312	3098	3088	3088
query98	221	204	195	195
query99	1530	1307	1285	1285
Total cold run time: 300090 ms
Total hot run time: 191859 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.68 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 120c66f202726f25478b09f25b2eff4dd2f182a6, data reload: false

query1	0.05	0.05	0.05
query2	0.06	0.02	0.03
query3	0.23	0.07	0.07
query4	1.65	0.11	0.10
query5	0.52	0.51	0.52
query6	1.14	0.71	0.73
query7	0.02	0.02	0.01
query8	0.04	0.03	0.02
query9	0.58	0.50	0.49
query10	0.55	0.55	0.54
query11	0.14	0.11	0.10
query12	0.14	0.11	0.11
query13	0.60	0.59	0.59
query14	2.98	2.95	2.99
query15	0.88	0.81	0.82
query16	0.38	0.39	0.37
query17	1.08	1.04	1.04
query18	0.20	0.19	0.19
query19	1.92	1.78	1.92
query20	0.01	0.01	0.01
query21	15.36	0.59	0.57
query22	2.69	1.88	1.90
query23	17.32	0.76	0.68
query24	2.90	0.99	1.67
query25	0.26	0.13	0.19
query26	0.36	0.14	0.13
query27	0.03	0.04	0.05
query28	10.38	1.12	1.11
query29	12.54	3.26	3.27
query30	0.25	0.06	0.06
query31	2.88	0.39	0.37
query32	3.28	0.47	0.46
query33	3.06	2.98	3.01
query34	17.07	4.37	4.36
query35	4.44	4.42	4.44
query36	0.65	0.48	0.48
query37	0.08	0.06	0.06
query38	0.04	0.04	0.03
query39	0.03	0.02	0.02
query40	0.16	0.12	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.03	0.02	0.03
Total cold run time: 107.09 s
Total hot run time: 32.68 s

@seawinde
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40878 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b4144844d0786f7c21f8669ccc979481e5a950ff, data reload: false

------ Round 1 ----------------------------------
q1	17569	7509	7235	7235
q2	2040	288	269	269
q3	12151	1061	1097	1061
q4	10552	699	714	699
q5	7742	2893	2831	2831
q6	242	150	148	148
q7	1001	623	605	605
q8	9352	1932	1943	1932
q9	6633	6450	6399	6399
q10	7017	2261	2351	2261
q11	445	243	240	240
q12	426	218	222	218
q13	17788	2984	2965	2965
q14	248	221	220	220
q15	571	544	518	518
q16	664	610	602	602
q17	978	615	601	601
q18	7090	6721	6753	6721
q19	1396	985	1057	985
q20	574	296	287	287
q21	4192	3254	3098	3098
q22	1102	983	1001	983
Total cold run time: 109773 ms
Total hot run time: 40878 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7230	7270	7187	7187
q2	330	235	236	235
q3	3043	2958	3005	2958
q4	2086	1865	1841	1841
q5	5686	5672	5738	5672
q6	235	149	147	147
q7	2220	1824	1812	1812
q8	3349	3531	3508	3508
q9	8835	9042	8947	8947
q10	3528	3526	3573	3526
q11	593	496	504	496
q12	829	641	622	622
q13	7694	3199	3149	3149
q14	316	279	296	279
q15	579	527	533	527
q16	721	685	667	667
q17	1872	1658	1633	1633
q18	8285	7978	7818	7818
q19	1712	1670	1494	1494
q20	2133	1845	1908	1845
q21	5559	5400	5518	5400
q22	1108	1057	1057	1057
Total cold run time: 67943 ms
Total hot run time: 60820 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191885 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b4144844d0786f7c21f8669ccc979481e5a950ff, data reload: false

query1	945	389	398	389
query2	6375	2153	2094	2094
query3	8678	194	210	194
query4	33734	23712	23482	23482
query5	3543	475	478	475
query6	276	171	172	171
query7	4198	307	310	307
query8	295	237	233	233
query9	9589	2699	2674	2674
query10	470	284	267	267
query11	18034	15108	15024	15024
query12	159	97	97	97
query13	1533	440	421	421
query14	9783	7094	7421	7094
query15	270	171	186	171
query16	7354	457	484	457
query17	1823	591	578	578
query18	1930	312	320	312
query19	370	154	153	153
query20	122	109	112	109
query21	209	104	104	104
query22	4870	4582	4371	4371
query23	35128	34586	34718	34586
query24	11168	2796	2806	2796
query25	623	399	416	399
query26	922	166	166	166
query27	2182	293	301	293
query28	7584	2457	2420	2420
query29	720	425	406	406
query30	254	153	156	153
query31	1029	786	795	786
query32	99	51	57	51
query33	735	282	295	282
query34	936	495	496	495
query35	881	743	733	733
query36	1113	952	949	949
query37	151	76	85	76
query38	3976	3939	3930	3930
query39	1482	1448	1425	1425
query40	203	95	93	93
query41	51	46	49	46
query42	117	97	95	95
query43	537	496	501	496
query44	1221	807	791	791
query45	196	166	162	162
query46	1142	703	702	702
query47	1941	1824	1840	1824
query48	467	373	367	367
query49	863	393	408	393
query50	806	422	435	422
query51	7032	6987	6980	6980
query52	96	91	88	88
query53	253	181	181	181
query54	1202	468	471	468
query55	77	79	77	77
query56	285	269	280	269
query57	1241	1112	1088	1088
query58	250	224	235	224
query59	3447	2972	3021	2972
query60	302	273	278	273
query61	101	102	121	102
query62	843	675	667	667
query63	227	190	185	185
query64	3974	647	607	607
query65	3294	3183	3206	3183
query66	768	317	312	312
query67	16117	15710	15576	15576
query68	4042	571	574	571
query69	491	298	299	298
query70	1173	1102	1098	1098
query71	364	275	275	275
query72	7236	4116	4003	4003
query73	784	355	349	349
query74	9999	9058	9020	9020
query75	3457	2700	2692	2692
query76	2944	931	934	931
query77	598	315	298	298
query78	9903	9183	9258	9183
query79	1969	594	615	594
query80	1180	454	445	445
query81	595	243	244	243
query82	638	144	135	135
query83	301	140	134	134
query84	273	79	81	79
query85	1378	290	285	285
query86	445	283	264	264
query87	4504	4218	4322	4218
query88	3037	2456	2415	2415
query89	410	290	287	287
query90	1850	191	187	187
query91	180	144	142	142
query92	59	52	48	48
query93	2582	545	548	545
query94	899	268	293	268
query95	358	254	254	254
query96	624	283	283	283
query97	3281	3088	3101	3088
query98	220	210	195	195
query99	1568	1328	1292	1292
Total cold run time: 297938 ms
Total hot run time: 191885 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.83 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b4144844d0786f7c21f8669ccc979481e5a950ff, data reload: false

query1	0.05	0.05	0.04
query2	0.07	0.03	0.03
query3	0.23	0.07	0.06
query4	1.65	0.11	0.09
query5	0.50	0.49	0.51
query6	1.14	0.74	0.71
query7	0.02	0.01	0.04
query8	0.04	0.03	0.03
query9	0.55	0.50	0.48
query10	0.55	0.55	0.53
query11	0.14	0.10	0.10
query12	0.13	0.11	0.10
query13	0.61	0.60	0.60
query14	2.93	2.96	2.97
query15	0.90	0.83	0.83
query16	0.37	0.39	0.38
query17	1.03	1.04	1.04
query18	0.20	0.20	0.20
query19	1.98	1.83	2.02
query20	0.01	0.01	0.00
query21	15.35	0.57	0.58
query22	2.32	1.81	2.11
query23	17.27	1.03	0.79
query24	2.49	1.00	0.95
query25	0.34	0.06	0.14
query26	0.42	0.14	0.14
query27	0.04	0.04	0.04
query28	11.08	1.09	1.07
query29	12.54	3.28	3.26
query30	0.24	0.06	0.06
query31	2.86	0.39	0.38
query32	3.28	0.48	0.46
query33	3.00	3.06	3.03
query34	17.08	4.49	4.53
query35	4.52	4.51	4.45
query36	0.67	0.48	0.49
query37	0.09	0.06	0.05
query38	0.05	0.04	0.03
query39	0.03	0.03	0.02
query40	0.15	0.12	0.11
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 107.06 s
Total hot run time: 32.83 s

@seawinde
Copy link
Contributor Author

run buildall

1 similar comment
@seawinde
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41151 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 689462e72d1dc1485db8beae9ea206294a6ceb62, data reload: false

------ Round 1 ----------------------------------
q1	17567	7558	7318	7318
q2	2016	282	275	275
q3	12110	1090	1206	1090
q4	10596	760	754	754
q5	7759	2871	2867	2867
q6	240	155	148	148
q7	1002	620	626	620
q8	9371	1969	1984	1969
q9	6560	6434	6457	6434
q10	6943	2290	2301	2290
q11	446	247	248	247
q12	418	221	220	220
q13	17826	3017	2988	2988
q14	237	207	208	207
q15	585	534	513	513
q16	678	606	610	606
q17	977	534	478	478
q18	7302	6769	6710	6710
q19	1397	966	1082	966
q20	574	286	281	281
q21	3991	3180	3266	3180
q22	1109	990	1015	990
Total cold run time: 109704 ms
Total hot run time: 41151 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7296	7246	7254	7246
q2	324	241	230	230
q3	3068	2957	2953	2953
q4	2066	1822	1833	1822
q5	5701	5683	5693	5683
q6	233	147	141	141
q7	2223	1837	1813	1813
q8	3364	3490	3542	3490
q9	8886	9068	8933	8933
q10	3588	3507	3586	3507
q11	589	495	482	482
q12	821	596	616	596
q13	8958	3156	3156	3156
q14	295	284	287	284
q15	587	512	539	512
q16	739	682	655	655
q17	1836	1619	1605	1605
q18	8293	7916	7814	7814
q19	1727	1647	1530	1530
q20	2145	1886	1875	1875
q21	5658	5144	5444	5144
q22	1139	1043	1053	1043
Total cold run time: 69536 ms
Total hot run time: 60514 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190767 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 689462e72d1dc1485db8beae9ea206294a6ceb62, data reload: false

query1	933	386	386	386
query2	6404	2069	1987	1987
query3	8688	201	199	199
query4	33862	23686	23388	23388
query5	3450	480	455	455
query6	290	184	174	174
query7	4191	304	300	300
query8	290	228	230	228
query9	9229	2670	2674	2670
query10	468	282	276	276
query11	17878	15147	15232	15147
query12	163	96	99	96
query13	1522	443	412	412
query14	9666	7451	7277	7277
query15	304	173	169	169
query16	7935	442	429	429
query17	1703	592	585	585
query18	2141	299	306	299
query19	380	154	155	154
query20	130	119	111	111
query21	211	114	112	112
query22	4940	4678	4736	4678
query23	35353	34621	35116	34621
query24	11043	2941	2919	2919
query25	613	408	416	408
query26	1101	168	164	164
query27	2252	298	308	298
query28	7339	2455	2442	2442
query29	813	444	429	429
query30	253	155	161	155
query31	1003	777	791	777
query32	93	55	55	55
query33	739	305	304	304
query34	980	507	513	507
query35	865	741	759	741
query36	1115	956	933	933
query37	156	89	84	84
query38	3970	3933	3889	3889
query39	1476	1430	1428	1428
query40	213	96	97	96
query41	50	49	50	49
query42	120	100	94	94
query43	537	484	480	480
query44	1194	807	795	795
query45	192	167	164	164
query46	1132	711	729	711
query47	1918	1802	1861	1802
query48	465	365	368	365
query49	883	412	402	402
query50	821	420	416	416
query51	7167	6973	6804	6804
query52	97	89	87	87
query53	263	186	189	186
query54	1106	467	475	467
query55	83	77	77	77
query56	276	284	268	268
query57	1225	1110	1073	1073
query58	264	249	241	241
query59	3319	2950	2914	2914
query60	316	283	285	283
query61	129	124	133	124
query62	817	664	679	664
query63	218	191	184	184
query64	4056	636	603	603
query65	3289	3364	3177	3177
query66	698	301	317	301
query67	15964	15700	15569	15569
query68	4651	564	552	552
query69	627	299	300	299
query70	1171	1076	1057	1057
query71	404	278	277	277
query72	7602	2470	3812	2470
query73	758	340	343	340
query74	10486	9115	8922	8922
query75	4565	2711	2749	2711
query76	3675	957	937	937
query77	741	302	290	290
query78	10152	9486	9272	9272
query79	2468	581	617	581
query80	2397	453	459	453
query81	597	240	242	240
query82	667	141	140	140
query83	315	134	135	134
query84	286	83	81	81
query85	1546	297	293	293
query86	446	295	302	295
query87	4500	4336	4332	4332
query88	3560	2414	2380	2380
query89	404	310	289	289
query90	2107	187	187	187
query91	176	143	138	138
query92	63	48	48	48
query93	2160	546	537	537
query94	1057	306	299	299
query95	360	259	256	256
query96	623	276	280	276
query97	3303	3140	3145	3140
query98	222	205	194	194
query99	1688	1312	1265	1265
Total cold run time: 304531 ms
Total hot run time: 190767 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.79 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 689462e72d1dc1485db8beae9ea206294a6ceb62, data reload: false

query1	0.04	0.05	0.04
query2	0.07	0.03	0.02
query3	0.23	0.06	0.07
query4	1.64	0.11	0.10
query5	0.52	0.52	0.51
query6	1.15	0.72	0.72
query7	0.02	0.01	0.01
query8	0.04	0.03	0.04
query9	0.58	0.51	0.50
query10	0.57	0.61	0.57
query11	0.14	0.10	0.11
query12	0.14	0.11	0.11
query13	0.62	0.60	0.59
query14	2.96	2.96	2.96
query15	0.90	0.83	0.82
query16	0.39	0.40	0.36
query17	1.05	1.05	1.07
query18	0.19	0.20	0.20
query19	2.01	1.88	2.00
query20	0.02	0.01	0.01
query21	15.35	0.62	0.60
query22	2.69	2.91	1.84
query23	17.43	0.78	0.83
query24	3.33	0.74	1.19
query25	0.28	0.12	0.09
query26	0.48	0.14	0.12
query27	0.05	0.04	0.03
query28	10.69	1.09	1.07
query29	12.53	3.25	3.22
query30	0.24	0.06	0.06
query31	2.90	0.37	0.38
query32	3.29	0.47	0.45
query33	2.99	3.04	3.06
query34	16.97	4.47	4.47
query35	4.52	4.49	4.52
query36	0.69	0.49	0.48
query37	0.09	0.05	0.06
query38	0.05	0.03	0.03
query39	0.03	0.03	0.03
query40	0.15	0.13	0.12
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 108.17 s
Total hot run time: 32.79 s

@seawinde
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41199 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit efe16cf37dfbb925371e766c1034293e2e1cd7bc, data reload: false

------ Round 1 ----------------------------------
q1	18146	7451	7321	7321
q2	2499	165	167	165
q3	11668	1345	1205	1205
q4	11175	738	773	738
q5	8096	2943	2951	2943
q6	244	153	159	153
q7	999	637	613	613
q8	9362	1975	1940	1940
q9	6619	6441	6469	6441
q10	6953	2311	2321	2311
q11	440	241	264	241
q12	426	224	210	210
q13	17815	2986	2967	2967
q14	249	216	211	211
q15	560	519	535	519
q16	658	620	612	612
q17	983	605	607	605
q18	7268	6802	6739	6739
q19	1396	971	993	971
q20	503	202	194	194
q21	4076	3105	3234	3105
q22	1102	1003	995	995
Total cold run time: 111237 ms
Total hot run time: 41199 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7244	7228	7222	7222
q2	330	239	232	232
q3	2883	2812	2772	2772
q4	1948	1782	1722	1722
q5	5437	5465	5488	5465
q6	227	137	141	137
q7	2100	1685	1737	1685
q8	3212	3407	3399	3399
q9	8604	8594	8510	8510
q10	3490	3459	3431	3431
q11	594	475	468	468
q12	779	592	618	592
q13	5904	2982	2984	2982
q14	308	285	261	261
q15	568	518	508	508
q16	692	695	666	666
q17	1776	1578	1554	1554
q18	7806	7532	7325	7325
q19	1669	1544	1532	1532
q20	2050	1806	1874	1806
q21	5403	5199	5246	5199
q22	1130	1043	1021	1021
Total cold run time: 64154 ms
Total hot run time: 58489 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192372 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit efe16cf37dfbb925371e766c1034293e2e1cd7bc, data reload: false

query1	988	376	373	373
query2	6513	2057	2060	2057
query3	6700	211	225	211
query4	34508	23376	23365	23365
query5	4401	484	462	462
query6	259	174	160	160
query7	4618	311	318	311
query8	296	241	224	224
query9	9794	2713	2687	2687
query10	478	279	285	279
query11	18253	15206	15186	15186
query12	153	97	104	97
query13	1635	436	419	419
query14	10868	6674	7455	6674
query15	252	172	178	172
query16	7375	442	479	442
query17	1658	574	599	574
query18	2010	319	313	313
query19	354	152	152	152
query20	126	108	106	106
query21	214	110	108	108
query22	4633	4691	4407	4407
query23	34892	33933	34104	33933
query24	11156	2817	2831	2817
query25	671	415	423	415
query26	1251	168	166	166
query27	2719	303	301	301
query28	8079	2473	2448	2448
query29	857	451	446	446
query30	322	164	160	160
query31	1029	786	847	786
query32	101	58	58	58
query33	768	306	315	306
query34	946	503	497	497
query35	881	749	725	725
query36	1106	977	951	951
query37	163	94	84	84
query38	4073	3937	3995	3937
query39	1477	1474	1424	1424
query40	211	100	99	99
query41	52	51	51	51
query42	121	99	96	96
query43	526	481	490	481
query44	1308	817	800	800
query45	198	169	173	169
query46	1143	729	743	729
query47	1933	1838	1892	1838
query48	462	377	388	377
query49	1156	425	427	425
query50	844	407	420	407
query51	7165	7000	7132	7000
query52	99	86	89	86
query53	262	192	186	186
query54	1166	474	473	473
query55	80	77	79	77
query56	302	261	268	261
query57	1237	1116	1142	1116
query58	251	239	258	239
query59	3225	3007	2983	2983
query60	323	277	280	277
query61	138	104	106	104
query62	888	674	668	668
query63	216	192	186	186
query64	4876	647	624	624
query65	3308	3235	3219	3219
query66	1441	310	303	303
query67	16104	15636	15796	15636
query68	5027	581	563	563
query69	510	288	306	288
query70	1136	1132	1143	1132
query71	361	263	282	263
query72	7397	3982	3996	3982
query73	772	346	349	346
query74	10416	9191	9130	9130
query75	3446	2648	2674	2648
query76	3529	924	918	918
query77	618	300	292	292
query78	11472	11802	10110	10110
query79	7423	585	587	585
query80	987	454	438	438
query81	587	242	241	241
query82	944	140	145	140
query83	322	142	143	142
query84	296	81	75	75
query85	752	297	275	275
query86	497	309	255	255
query87	4612	4361	4383	4361
query88	4890	2416	2407	2407
query89	423	288	289	288
query90	2095	198	192	192
query91	184	149	145	145
query92	63	51	49	49
query93	4027	574	556	556
query94	1046	300	316	300
query95	360	259	256	256
query96	663	290	285	285
query97	3299	3097	3102	3097
query98	237	197	202	197
query99	1797	1304	1273	1273
Total cold run time: 315800 ms
Total hot run time: 192372 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.04 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit efe16cf37dfbb925371e766c1034293e2e1cd7bc, data reload: false

query1	0.05	0.04	0.04
query2	0.07	0.03	0.03
query3	0.22	0.06	0.06
query4	1.65	0.10	0.10
query5	0.54	0.52	0.51
query6	1.13	0.72	0.72
query7	0.02	0.01	0.02
query8	0.04	0.03	0.03
query9	0.57	0.49	0.50
query10	0.55	0.58	0.55
query11	0.13	0.10	0.10
query12	0.14	0.10	0.11
query13	0.61	0.60	0.59
query14	2.93	3.02	3.12
query15	0.91	0.82	0.84
query16	0.38	0.38	0.39
query17	1.03	1.04	1.00
query18	0.24	0.22	0.22
query19	1.87	1.86	2.05
query20	0.01	0.02	0.01
query21	15.35	0.59	0.59
query22	2.72	2.99	1.86
query23	17.56	0.85	0.84
query24	2.51	1.05	0.99
query25	0.35	0.11	0.04
query26	0.48	0.14	0.14
query27	0.05	0.04	0.03
query28	11.03	1.10	1.06
query29	12.57	3.28	3.30
query30	0.25	0.06	0.06
query31	2.89	0.38	0.38
query32	3.27	0.48	0.45
query33	3.06	3.00	3.04
query34	17.36	4.47	4.44
query35	4.50	4.46	4.49
query36	0.66	0.48	0.48
query37	0.08	0.06	0.06
query38	0.04	0.03	0.03
query39	0.03	0.02	0.02
query40	0.16	0.14	0.13
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.02	0.03
Total cold run time: 108.14 s
Total hot run time: 33.04 s

@seawinde seawinde force-pushed the fix_regression_test_unstable_and_error branch from b6dfe2f to b8e2b54 Compare October 15, 2024 07:15
@seawinde
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41207 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b8e2b543bed50d161d863328f33848164e934bf4, data reload: false

------ Round 1 ----------------------------------
q1	17600	7501	7358	7358
q2	2060	166	154	154
q3	10567	1141	1156	1141
q4	10237	921	854	854
q5	7721	3075	3066	3066
q6	237	158	157	157
q7	1012	627	608	608
q8	9349	1921	2003	1921
q9	6615	6462	6380	6380
q10	7036	2441	2383	2383
q11	448	247	254	247
q12	412	223	224	223
q13	17793	3008	3027	3008
q14	239	215	207	207
q15	571	535	515	515
q16	629	593	593	593
q17	968	480	486	480
q18	7370	6636	6821	6636
q19	1363	953	951	951
q20	481	190	190	190
q21	4018	3125	3193	3125
q22	1132	1011	1010	1010
Total cold run time: 107858 ms
Total hot run time: 41207 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7289	7298	7289	7289
q2	328	232	227	227
q3	2911	2764	2775	2764
q4	1989	1688	1701	1688
q5	5480	5463	5527	5463
q6	225	146	144	144
q7	2107	1705	1681	1681
q8	3240	3419	3459	3419
q9	8513	8544	8493	8493
q10	3492	3432	3411	3411
q11	587	481	473	473
q12	791	604	603	603
q13	9860	3017	3025	3017
q14	281	259	263	259
q15	556	515	506	506
q16	682	624	638	624
q17	1812	1575	1562	1562
q18	7872	7516	7543	7516
q19	1676	1574	1644	1574
q20	2075	1810	1815	1810
q21	5319	5304	5175	5175
q22	1091	1058	1016	1016
Total cold run time: 68176 ms
Total hot run time: 58714 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192045 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b8e2b543bed50d161d863328f33848164e934bf4, data reload: false

query1	994	367	388	367
query2	6545	2002	1988	1988
query3	6782	210	221	210
query4	33972	23494	23506	23494
query5	4300	470	458	458
query6	262	171	168	168
query7	4610	291	292	291
query8	288	230	241	230
query9	9789	2734	2762	2734
query10	466	275	294	275
query11	18263	15142	15246	15142
query12	155	99	97	97
query13	1659	435	440	435
query14	10572	7520	7423	7423
query15	315	181	177	177
query16	8115	465	469	465
query17	1783	567	573	567
query18	2138	300	306	300
query19	384	153	161	153
query20	117	108	112	108
query21	219	106	106	106
query22	4630	4334	4326	4326
query23	35204	34403	34363	34363
query24	11107	2749	2786	2749
query25	650	410	422	410
query26	1171	160	163	160
query27	2770	283	287	283
query28	7926	2458	2447	2447
query29	843	428	433	428
query30	338	169	159	159
query31	1040	816	830	816
query32	100	56	58	56
query33	776	305	287	287
query34	952	500	528	500
query35	891	775	799	775
query36	1097	945	932	932
query37	156	95	89	89
query38	4044	3934	4034	3934
query39	1488	1438	1420	1420
query40	217	102	101	101
query41	49	45	47	45
query42	123	103	95	95
query43	509	466	485	466
query44	1276	836	816	816
query45	195	167	174	167
query46	1164	702	702	702
query47	1959	1810	1868	1810
query48	418	320	334	320
query49	1154	430	437	430
query50	812	381	399	381
query51	7059	7102	6919	6919
query52	101	91	90	90
query53	269	184	187	184
query54	1196	440	435	435
query55	82	81	80	80
query56	297	270	260	260
query57	1332	1176	1149	1149
query58	262	248	239	239
query59	3280	2987	3078	2987
query60	307	263	268	263
query61	107	99	100	99
query62	866	677	670	670
query63	218	191	182	182
query64	5247	644	593	593
query65	3356	3197	3187	3187
query66	1463	305	318	305
query67	16091	15639	15567	15567
query68	4871	557	535	535
query69	459	288	290	288
query70	1193	1148	1164	1148
query71	339	277	272	272
query72	6393	3989	4013	3989
query73	774	360	354	354
query74	9589	8926	8968	8926
query75	3370	2644	2663	2644
query76	2829	943	831	831
query77	451	297	319	297
query78	10529	9661	9619	9619
query79	2020	592	612	592
query80	1832	451	446	446
query81	581	244	242	242
query82	929	139	141	139
query83	260	134	153	134
query84	267	73	67	67
query85	1379	281	276	276
query86	454	306	306	306
query87	4496	4287	4332	4287
query88	3503	2212	2174	2174
query89	397	283	288	283
query90	1975	190	189	189
query91	138	105	98	98
query92	68	49	52	49
query93	1751	547	535	535
query94	1041	290	289	289
query95	364	247	248	247
query96	627	280	282	280
query97	3232	3141	3132	3132
query98	213	212	196	196
query99	1809	1338	1317	1317
Total cold run time: 304453 ms
Total hot run time: 192045 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.14 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b8e2b543bed50d161d863328f33848164e934bf4, data reload: false

query1	0.04	0.04	0.03
query2	0.06	0.03	0.04
query3	0.23	0.06	0.06
query4	1.64	0.10	0.09
query5	0.52	0.50	0.50
query6	1.13	0.72	0.71
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.57	0.52	0.51
query10	0.56	0.55	0.57
query11	0.14	0.11	0.09
query12	0.14	0.11	0.14
query13	0.61	0.60	0.59
query14	2.72	2.73	2.75
query15	0.90	0.82	0.82
query16	0.39	0.37	0.41
query17	1.05	1.06	1.01
query18	0.24	0.23	0.21
query19	1.98	1.87	2.01
query20	0.02	0.01	0.01
query21	15.35	0.57	0.57
query22	2.89	1.99	1.87
query23	17.08	0.96	0.76
query24	3.07	1.45	2.01
query25	0.13	0.18	0.09
query26	0.64	0.14	0.13
query27	0.03	0.04	0.04
query28	9.37	1.12	1.06
query29	12.55	3.24	3.20
query30	0.24	0.06	0.06
query31	2.89	0.38	0.39
query32	3.26	0.46	0.47
query33	2.99	3.00	3.11
query34	16.91	4.49	4.44
query35	4.50	4.55	4.51
query36	0.66	0.49	0.49
query37	0.09	0.06	0.06
query38	0.04	0.04	0.03
query39	0.03	0.03	0.02
query40	0.16	0.14	0.13
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.03	0.02	0.02
Total cold run time: 106.03 s
Total hot run time: 33.14 s

@seawinde
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41613 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 49fd2da954bcc06c2e97423fbc23387a4d6b57ef, data reload: false

------ Round 1 ----------------------------------
q1	17578	7469	7301	7301
q2	2054	166	155	155
q3	10564	1138	1166	1138
q4	10231	823	848	823
q5	7761	3158	3108	3108
q6	247	153	154	153
q7	1041	615	609	609
q8	9601	2025	2011	2011
q9	8201	6463	6471	6463
q10	7143	2402	2440	2402
q11	446	239	258	239
q12	525	225	230	225
q13	17814	3029	2982	2982
q14	250	210	206	206
q15	593	528	507	507
q16	665	589	587	587
q17	1005	551	514	514
q18	7482	6795	6775	6775
q19	1365	995	979	979
q20	505	186	188	186
q21	3988	3285	3221	3221
q22	1134	1039	1029	1029
Total cold run time: 110193 ms
Total hot run time: 41613 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7339	7276	7268	7268
q2	339	232	233	232
q3	2941	2814	2788	2788
q4	1932	1696	1676	1676
q5	5466	5490	5543	5490
q6	227	142	149	142
q7	2127	1753	1739	1739
q8	3248	3417	3426	3417
q9	8605	8634	8641	8634
q10	3478	3447	3431	3431
q11	588	473	500	473
q12	777	583	627	583
q13	11938	2994	3030	2994
q14	302	263	267	263
q15	552	504	503	503
q16	686	639	644	639
q17	1822	1578	1565	1565
q18	7809	7607	7363	7363
q19	1685	1574	1435	1435
q20	2080	1799	1794	1794
q21	5488	5115	5228	5115
q22	1123	1032	1015	1015
Total cold run time: 70552 ms
Total hot run time: 58559 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191220 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 49fd2da954bcc06c2e97423fbc23387a4d6b57ef, data reload: false

query1	948	367	373	367
query2	3357	2138	2138	2138
query3	2708	215	223	215
query4	33154	23606	23516	23516
query5	3363	489	464	464
query6	232	169	163	163
query7	3575	290	305	290
query8	282	224	221	221
query9	7711	2757	2765	2757
query10	403	295	283	283
query11	17848	15055	15220	15055
query12	153	101	101	101
query13	1370	434	409	409
query14	8900	7329	7520	7329
query15	227	174	184	174
query16	6446	465	464	464
query17	1277	562	567	562
query18	1857	297	319	297
query19	235	154	152	152
query20	119	108	113	108
query21	209	107	102	102
query22	4490	4349	4266	4266
query23	34745	34313	34119	34119
query24	8803	2811	2787	2787
query25	652	425	412	412
query26	1723	163	160	160
query27	2391	278	295	278
query28	6435	2440	2435	2435
query29	968	428	424	424
query30	327	156	156	156
query31	1023	805	867	805
query32	86	60	58	58
query33	664	288	307	288
query34	947	507	526	507
query35	933	775	754	754
query36	1116	936	956	936
query37	238	89	85	85
query38	3972	3836	3901	3836
query39	1517	1446	1404	1404
query40	280	100	101	100
query41	49	46	46	46
query42	121	101	99	99
query43	547	499	505	499
query44	1230	814	837	814
query45	198	167	166	166
query46	1129	707	697	697
query47	1917	1833	1842	1833
query48	438	328	336	328
query49	1172	432	422	422
query50	820	378	407	378
query51	7132	7035	7010	7010
query52	103	89	91	89
query53	262	182	182	182
query54	706	426	422	422
query55	81	75	79	75
query56	291	258	263	258
query57	1307	1227	1135	1135
query58	243	247	236	236
query59	3109	2990	2911	2911
query60	292	261	259	259
query61	105	102	107	102
query62	850	666	673	666
query63	218	188	179	179
query64	3823	665	602	602
query65	3247	3304	3193	3193
query66	1355	331	296	296
query67	15984	15475	15552	15475
query68	3427	577	568	568
query69	461	285	293	285
query70	1145	1138	1135	1135
query71	330	272	280	272
query72	7008	4007	3958	3958
query73	772	355	356	355
query74	9899	8865	9100	8865
query75	3456	2638	2657	2638
query76	2419	841	923	841
query77	631	316	304	304
query78	10507	9572	9500	9500
query79	1928	608	595	595
query80	877	454	449	449
query81	568	242	246	242
query82	654	137	138	137
query83	313	141	135	135
query84	278	77	66	66
query85	1166	291	287	287
query86	340	307	294	294
query87	4651	4358	4209	4209
query88	3778	2184	2136	2136
query89	408	295	286	286
query90	1894	179	181	179
query91	133	98	100	98
query92	61	50	47	47
query93	1224	538	538	538
query94	859	287	296	287
query95	325	243	243	243
query96	610	279	283	279
query97	3262	3173	3157	3157
query98	213	198	194	194
query99	1561	1292	1315	1292
Total cold run time: 277571 ms
Total hot run time: 191220 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.08 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 49fd2da954bcc06c2e97423fbc23387a4d6b57ef, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.03
query3	0.23	0.06	0.06
query4	1.65	0.11	0.10
query5	0.51	0.50	0.49
query6	1.14	0.72	0.73
query7	0.02	0.01	0.01
query8	0.03	0.03	0.03
query9	0.57	0.49	0.50
query10	0.52	0.54	0.54
query11	0.14	0.11	0.10
query12	0.14	0.11	0.11
query13	0.61	0.61	0.60
query14	2.83	2.70	2.82
query15	0.89	0.83	0.81
query16	0.41	0.38	0.39
query17	1.06	1.04	1.04
query18	0.20	0.20	0.19
query19	1.90	1.86	2.04
query20	0.01	0.01	0.01
query21	15.38	0.59	0.61
query22	2.30	2.82	1.82
query23	17.24	0.86	0.70
query24	3.36	1.76	1.42
query25	0.32	0.13	0.12
query26	0.50	0.14	0.14
query27	0.04	0.04	0.03
query28	9.26	1.09	1.07
query29	12.62	3.22	3.21
query30	0.24	0.06	0.07
query31	2.87	0.37	0.38
query32	3.29	0.45	0.46
query33	3.01	3.00	3.04
query34	17.00	4.50	4.51
query35	4.52	4.52	4.54
query36	0.65	0.49	0.48
query37	0.08	0.06	0.06
query38	0.04	0.03	0.04
query39	0.04	0.02	0.03
query40	0.16	0.12	0.12
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.04 s
Total hot run time: 33.08 s

@seawinde
Copy link
Contributor Author

run p0 10

@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Oct 18, 2024
Copy link
Contributor

@zfr9527 zfr9527 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@morrySnow morrySnow merged commit 5e6e4bf into apache:master Oct 18, 2024
seawinde added a commit to seawinde/doris that referenced this pull request Oct 21, 2024
This is brought by apache#39265

1. Some test fail because `MaterializedViewRewriteSuccessButNotChose`,
because in these tests materialized view are not analyzed after create,
So Add `analyze clause` when waite materialized view task finished
2. No signature of method:
org.apache.doris.regression.suite.Suite.check_mv_rewrite_success(),
because `check_mv_rewrite_success` is not available in Suite.groovy. Fix
this by using correct method.
3. If partition row count statistics is not ready, should not check mv
rewrte by CBO succesfully
seawinde added a commit to seawinde/doris that referenced this pull request Oct 23, 2024
This is brought by apache#39265

1. Some test fail because `MaterializedViewRewriteSuccessButNotChose`,
because in these tests materialized view are not analyzed after create,
So Add `analyze clause` when waite materialized view task finished
2. No signature of method:
org.apache.doris.regression.suite.Suite.check_mv_rewrite_success(),
because `check_mv_rewrite_success` is not available in Suite.groovy. Fix
this by using correct method.
3. If partition row count statistics is not ready, should not check mv
rewrte by CBO succesfully
yiguolei pushed a commit that referenced this pull request Oct 23, 2024
dataroaring pushed a commit that referenced this pull request Oct 23, 2024
## Proposed changes

pr: #40871
commitId: da6ac0c

pr: #41145
commitId: 5e6e4bf
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.7-merged dev/3.0.3-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants