Skip to content

Conversation

@mymeiyi
Copy link
Contributor

@mymeiyi mymeiyi commented Nov 13, 2023

Proposed changes

Enable wait_internal_group_commit_finish to check if all cases can pass:

fe.conf

wait_internal_group_commit_finish=true
group_commit_interval_ms_default_value=2

be.conf

wait_internal_group_commit_finish=true

some cases are not compitable, add excludeSuites in regression-conf.groovy:

"test_group_commit_data_bytes_property,test_group_commit_interval_ms_property,insert_group_commit_into_unique_sync_mode,insert_group_commit_into_max_filter_ratio,test_group_commit_stream_load,test_wal_mem_back_pressure_fault_injection," +
    "test_table_options,test_show_transaction,test_base_insert_job,test_show_create_table_and_views,test_show_create_table_and_views_nereids,test_get_stream_load_state,test_ctas,test_publish_timeout," +
    "test_array_insert_overflow," +

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@mymeiyi
Copy link
Contributor Author

mymeiyi commented Nov 13, 2023

run buildall

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Tpch sf100 test result on commit 19a463f3b06dd0e7cbe4049b9f433bba896b5fcb, data reload: false

run tpch-sf100 query with default conf and session variables
q1	5329	5069	5048	5048
q2	386	206	178	178
q3	2102	2105	2067	2067
q4	1482	1432	1421	1421
q5	4176	4192	4146	4146
q6	257	139	131	131
q7	2095	1618	1628	1618
q8	2775	2752	2758	2752
q9	10449	10247	10248	10247
q10	10257	3577	3552	3552
q11	391	269	269	269
q12	454	309	301	301
q13	4552	4109	4128	4109
q14	333	288	310	288
q15	618	569	557	557
q16	698	614	604	604
q17	1145	1099	1112	1099
q18	7748	7334	7262	7262
q19	1691	1707	1702	1702
q20	586	380	366	366
q21	4953	4583	4593	4583
q22	539	444	420	420
Total cold run time: 63016 ms
Total hot run time: 52720 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4988	4987	4964	4964
q2	342	278	270	270
q3	4019	4048	3898	3898
q4	2790	2776	2744	2744
q5	6541	6500	6501	6500
q6	248	130	133	130
q7	3103	2728	2690	2690
q8	4898	4752	4860	4752
q9	17777	17840	17649	17649
q10	4067	4143	4169	4143
q11	818	688	669	669
q12	995	838	822	822
q13	4307	3898	3903	3898
q14	387	342	354	342
q15	603	570	565	565
q16	794	682	686	682
q17	3922	3904	3922	3904
q18	9428	9240	9280	9240
q19	1866	1785	1779	1779
q20	2384	2062	2056	2056
q21	8834	8857	8795	8795
q22	955	869	870	869
Total cold run time: 84066 ms
Total hot run time: 81361 ms

@mymeiyi mymeiyi force-pushed the enable-group-commit branch from 19a463f to 699afff Compare November 13, 2023 06:21
@mymeiyi
Copy link
Contributor Author

mymeiyi commented Nov 13, 2023

run compile,p0

@mymeiyi
Copy link
Contributor Author

mymeiyi commented Nov 13, 2023

run buildall

1 similar comment
@mymeiyi
Copy link
Contributor Author

mymeiyi commented Nov 13, 2023

run buildall

@mymeiyi mymeiyi force-pushed the enable-group-commit branch 2 times, most recently from f7aadb7 to 367fd3f Compare November 14, 2023 02:53
@mymeiyi
Copy link
Contributor Author

mymeiyi commented Nov 14, 2023

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

1 similar comment
@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.65% (8381/22865)
Line Coverage: 29.23% (68024/232758)
Region Coverage: 27.82% (35143/126301)
Branch Coverage: 24.66% (17977/72888)
Coverage Report: http://coverage.selectdb-in.cc/coverage/367fd3fcdb28776e180b980d00e5b5db50688739_367fd3fcdb28776e180b980d00e5b5db50688739/report/index.html

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Tpch sf100 test result on commit 367fd3fcdb28776e180b980d00e5b5db50688739, data reload: false

run tpch-sf100 query with default conf and session variables
q1	5326	5189	5162	5162
q2	374	179	158	158
q3	2044	1991	2035	1991
q4	1409	1360	1381	1360
q5	3982	3988	3974	3974
q6	252	132	134	132
q7	1471	897	889	889
q8	2774	2786	2780	2780
q9	9624	9552	9434	9434
q10	3456	3546	3539	3539
q11	391	258	258	258
q12	434	284	285	284
q13	4573	4150	4117	4117
q14	314	287	281	281
q15	643	550	550	550
q16	672	600	592	592
q17	1138	1082	1081	1081
q18	8137	7553	7586	7553
q19	1687	1686	1673	1673
q20	584	330	299	299
q21	4698	4331	4378	4331
q22	521	399	411	399
Total cold run time: 54504 ms
Total hot run time: 50837 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	5160	5057	5087	5057
q2	327	222	233	222
q3	4048	4040	3962	3962
q4	2824	2793	2763	2763
q5	9630	9676	9649	9649
q6	243	125	125	125
q7	3037	2463	2557	2463
q8	4866	4835	4813	4813
q9	13117	12979	12962	12962
q10	4077	4151	4175	4151
q11	801	666	665	665
q12	988	815	853	815
q13	4321	3865	3901	3865
q14	381	343	349	343
q15	604	542	542	542
q16	785	699	683	683
q17	3912	3866	3847	3847
q18	9761	9361	9279	9279
q19	1868	1790	1773	1773
q20	2388	2083	2055	2055
q21	8873	8787	8682	8682
q22	936	839	883	839
Total cold run time: 82947 ms
Total hot run time: 79555 ms

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.84 seconds
stream load tsv: 555 seconds loaded 74807831229 Bytes, about 128 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.7 seconds inserted 10000000 Rows, about 348K ops/s
storage size: 17161014075 Bytes

@mymeiyi
Copy link
Contributor Author

mymeiyi commented Nov 15, 2023

run p0

@mymeiyi
Copy link
Contributor Author

mymeiyi commented Nov 15, 2023

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.79% (8417/22876)
Line Coverage: 29.28% (68425/233667)
Region Coverage: 27.89% (35371/126839)
Branch Coverage: 24.65% (18075/73312)
Coverage Report: http://coverage.selectdb-in.cc/coverage/f9be88eaa359488940d6ae33ac85b9a7123c753c_f9be88eaa359488940d6ae33ac85b9a7123c753c/report/index.html

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Tpch sf100 test result on commit f9be88eaa359488940d6ae33ac85b9a7123c753c, data reload: false

run tpch-sf100 query with default conf and session variables
q1	4961	4678	4633	4633
q2	361	143	143	143
q3	2012	1907	1889	1889
q4	1368	1259	1243	1243
q5	3963	3938	3996	3938
q6	250	130	131	130
q7	1407	889	895	889
q8	2724	2759	2747	2747
q9	19293	9626	9490	9490
q10	3424	3507	3517	3507
q11	373	258	246	246
q12	446	280	284	280
q13	4549	3765	3784	3765
q14	312	293	282	282
q15	590	541	526	526
q16	676	590	591	590
q17	1123	972	927	927
q18	7743	7321	7421	7321
q19	1680	1679	1656	1656
q20	550	295	309	295
q21	4392	3967	3913	3913
q22	481	379	385	379
Total cold run time: 62678 ms
Total hot run time: 48789 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4615	4565	4563	4563
q2	331	251	267	251
q3	4003	3996	3979	3979
q4	2689	2681	2688	2681
q5	9606	9629	9552	9552
q6	247	125	126	125
q7	2613	2339	2285	2285
q8	4436	4419	4409	4409
q9	13262	13152	13176	13152
q10	4049	4137	4157	4137
q11	785	702	649	649
q12	969	789	808	789
q13	4326	3566	3600	3566
q14	388	346	348	346
q15	582	532	519	519
q16	735	704	677	677
q17	3792	3867	3924	3867
q18	9558	8795	8931	8795
q19	1770	1767	1768	1767
q20	2389	2076	2053	2053
q21	8847	8713	8619	8619
q22	890	808	817	808
Total cold run time: 80882 ms
Total hot run time: 77589 ms

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.57 seconds
stream load tsv: 563 seconds loaded 74807831229 Bytes, about 126 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.9 seconds inserted 10000000 Rows, about 346K ops/s
storage size: 17098862468 Bytes

@mymeiyi mymeiyi force-pushed the enable-group-commit branch from f9be88e to 4239424 Compare November 23, 2023 09:05
@mymeiyi
Copy link
Contributor Author

mymeiyi commented Nov 23, 2023

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@mymeiyi
Copy link
Contributor Author

mymeiyi commented Nov 23, 2023

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Tpch sf100 test result on commit 42394243af5eb76ba552cae1a24c8be459524db5, data reload: false

run tpch-sf100 query with default conf and session variables
q1	4954	4713	4646	4646
q2	353	141	134	134
q3	2031	1923	1910	1910
q4	1386	1250	1256	1250
q5	3958	3975	4041	3975
q6	258	129	137	129
q7	1468	881	897	881
q8	2812	2823	2791	2791
q9	9625	9563	9451	9451
q10	3444	3533	3534	3533
q11	378	250	248	248
q12	438	292	287	287
q13	4570	3810	3814	3810
q14	317	281	287	281
q15	571	530	520	520
q16	674	590	586	586
q17	1155	955	922	922
q18	7918	7287	7444	7287
q19	1676	1687	1677	1677
q20	557	320	306	306
q21	4485	3997	3980	3980
q22	475	373	371	371
Total cold run time: 53503 ms
Total hot run time: 48975 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4599	4587	4642	4587
q2	349	231	249	231
q3	4020	4029	3997	3997
q4	2717	2705	2700	2700
q5	9697	9569	9615	9569
q6	245	125	123	123
q7	3029	2506	2501	2501
q8	4455	4441	4425	4425
q9	12949	12890	12829	12829
q10	4068	4166	4184	4166
q11	781	646	646	646
q12	980	818	820	818
q13	4332	3575	3555	3555
q14	390	352	341	341
q15	569	517	519	517
q16	749	684	660	660
q17	3880	3825	3859	3825
q18	9550	9135	9081	9081
q19	1831	1783	1791	1783
q20	2411	2078	2077	2077
q21	9041	8377	8540	8377
q22	887	811	843	811
Total cold run time: 81529 ms
Total hot run time: 77619 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.57% (8447/23097)
Line Coverage: 28.86% (68654/237925)
Region Coverage: 27.81% (35492/127606)
Branch Coverage: 24.55% (18109/73760)
Coverage Report: http://coverage.selectdb-in.cc/coverage/a35c2ad774684a66d8e64a1726c94b7233a486f1_a35c2ad774684a66d8e64a1726c94b7233a486f1/report/index.html

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 43.66 seconds
stream load tsv: 572 seconds loaded 74807831229 Bytes, about 124 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 29.0 seconds inserted 10000000 Rows, about 344K ops/s
storage size: 17099345388 Bytes

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Tpch sf100 test result on commit a35c2ad774684a66d8e64a1726c94b7233a486f1, data reload: false

run tpch-sf100 query with default conf and session variables
q1	4939	4670	4648	4648
q2	365	146	158	146
q3	2031	1909	1900	1900
q4	1385	1239	1234	1234
q5	3956	3962	4045	3962
q6	247	133	135	133
q7	1456	880	889	880
q8	2791	2797	2803	2797
q9	9729	9573	9419	9419
q10	3446	3508	3544	3508
q11	384	240	257	240
q12	440	292	289	289
q13	4587	3811	3829	3811
q14	327	287	285	285
q15	582	543	522	522
q16	657	587	580	580
q17	1136	968	921	921
q18	7758	7428	7496	7428
q19	1666	1701	1695	1695
q20	586	327	313	313
q21	4391	3993	4006	3993
q22	474	380	385	380
Total cold run time: 53333 ms
Total hot run time: 49084 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4595	4562	4558	4558
q2	329	241	278	241
q3	4018	4001	3998	3998
q4	2687	2696	2705	2696
q5	9652	9665	9621	9621
q6	249	125	125	125
q7	3008	2484	2478	2478
q8	4468	4455	4444	4444
q9	12897	12833	12840	12833
q10	4065	4202	4170	4170
q11	747	634	684	634
q12	987	805	799	799
q13	4292	3593	3579	3579
q14	390	350	358	350
q15	577	514	520	514
q16	728	721	673	673
q17	3890	3935	3864	3864
q18	9639	8964	9128	8964
q19	1843	1789	1798	1789
q20	2432	2072	2041	2041
q21	8906	8659	8633	8633
q22	868	827	779	779
Total cold run time: 81267 ms
Total hot run time: 77783 ms

@mymeiyi
Copy link
Contributor Author

mymeiyi commented Nov 23, 2023

run buildall

@doris-robot
Copy link

TPC-DS: Total hot run time: 172922 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b92ea458522ff6a27133d2e7250c75d9edb5efa9, data reload: false

query1	905	366	372	366
query2	6456	2354	2267	2267
query3	6624	203	214	203
query4	26320	17466	17454	17454
query5	3621	496	476	476
query6	285	163	156	156
query7	4592	306	287	287
query8	314	323	284	284
query9	8765	2383	2381	2381
query10	566	306	286	286
query11	12206	10050	10254	10050
query12	122	92	82	82
query13	1651	391	372	372
query14	9536	7758	6614	6614
query15	228	177	186	177
query16	7721	328	335	328
query17	1756	573	535	535
query18	1913	287	281	281
query19	213	154	157	154
query20	90	82	86	82
query21	214	133	131	131
query22	4395	4173	4129	4129
query23	34269	33803	33704	33704
query24	10934	2893	2840	2840
query25	648	440	471	440
query26	1141	162	158	158
query27	2440	330	335	330
query28	7226	2136	2108	2108
query29	908	657	638	638
query30	264	157	158	157
query31	982	741	750	741
query32	104	52	57	52
query33	746	308	301	301
query34	982	499	504	499
query35	755	672	641	641
query36	1149	971	970	970
query37	161	79	78	78
query38	3042	2862	2855	2855
query39	842	796	809	796
query40	212	124	124	124
query41	53	50	55	50
query42	120	97	94	94
query43	581	560	567	560
query44	1175	738	750	738
query45	188	155	161	155
query46	1078	734	703	703
query47	1849	1788	1768	1768
query48	393	304	309	304
query49	851	412	423	412
query50	765	393	407	393
query51	6883	6809	6737	6737
query52	109	97	117	97
query53	362	287	288	287
query54	905	451	457	451
query55	74	75	72	72
query56	283	269	270	269
query57	1134	1048	1038	1038
query58	265	239	245	239
query59	3641	3465	3308	3308
query60	298	275	279	275
query61	96	95	95	95
query62	597	432	431	431
query63	332	294	286	286
query64	9426	2155	1645	1645
query65	3117	3108	3120	3108
query66	764	337	342	337
query67	15418	14948	15022	14948
query68	5359	530	537	530
query69	631	413	358	358
query70	1103	1122	1082	1082
query71	476	314	267	267
query72	7503	5020	5619	5020
query73	771	325	326	325
query74	6060	5494	5490	5490
query75	3845	2680	2677	2677
query76	3652	929	921	921
query77	620	306	298	298
query78	9837	9039	8901	8901
query79	4968	508	504	504
query80	2122	475	477	475
query81	601	227	215	215
query82	1593	109	102	102
query83	317	169	163	163
query84	285	91	87	87
query85	1586	374	301	301
query86	468	323	335	323
query87	3344	3096	3106	3096
query88	4499	2451	2495	2451
query89	491	381	385	381
query90	1820	192	188	188
query91	129	105	102	102
query92	65	48	47	47
query93	5169	509	511	509
query94	1199	209	210	209
query95	402	317	325	317
query96	613	272	269	269
query97	3212	2971	3051	2971
query98	224	201	194	194
query99	1163	873	822	822
Total cold run time: 290182 ms
Total hot run time: 172922 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.47 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b92ea458522ff6a27133d2e7250c75d9edb5efa9, data reload: false

query1	0.04	0.03	0.04
query2	0.08	0.04	0.04
query3	0.23	0.06	0.05
query4	1.67	0.10	0.11
query5	0.50	0.49	0.51
query6	1.14	0.72	0.71
query7	0.02	0.02	0.01
query8	0.05	0.04	0.05
query9	0.56	0.49	0.50
query10	0.54	0.52	0.54
query11	0.15	0.11	0.12
query12	0.15	0.13	0.12
query13	0.60	0.58	0.58
query14	0.78	0.79	0.77
query15	0.84	0.81	0.82
query16	0.36	0.37	0.37
query17	0.99	0.95	0.99
query18	0.21	0.25	0.24
query19	1.79	1.69	1.68
query20	0.02	0.01	0.01
query21	15.41	0.77	0.66
query22	4.03	7.26	1.95
query23	18.33	1.44	1.28
query24	2.11	0.21	0.22
query25	0.17	0.08	0.08
query26	0.29	0.20	0.20
query27	0.45	0.23	0.23
query28	13.35	1.03	1.00
query29	12.65	3.27	3.25
query30	0.27	0.06	0.06
query31	2.87	0.39	0.39
query32	3.28	0.48	0.46
query33	2.85	2.91	2.83
query34	16.97	4.41	4.33
query35	4.44	4.40	4.47
query36	0.65	0.46	0.48
query37	0.18	0.15	0.14
query38	0.15	0.15	0.14
query39	0.04	0.03	0.03
query40	0.15	0.12	0.12
query41	0.10	0.05	0.05
query42	0.05	0.06	0.05
query43	0.04	0.03	0.04
Total cold run time: 109.55 s
Total hot run time: 30.47 s

@mymeiyi mymeiyi force-pushed the enable-group-commit branch from b92ea45 to e569463 Compare July 8, 2024 09:42
@github-actions
Copy link
Contributor

github-actions bot commented Jul 8, 2024

clang-tidy review says "All clean, LGTM! 👍"

@mymeiyi
Copy link
Contributor Author

mymeiyi commented Jul 8, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40433 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e5694632b727456a055f074f3375ca97d9f8df94, data reload: false

------ Round 1 ----------------------------------
q1	17760	4532	4393	4393
q2	2623	215	193	193
q3	12146	1184	1165	1165
q4	10318	848	847	847
q5	7522	2700	2662	2662
q6	225	141	140	140
q7	973	597	611	597
q8	9231	2080	2107	2080
q9	9081	6605	6514	6514
q10	8789	3727	3730	3727
q11	456	240	241	240
q12	396	228	227	227
q13	17775	2991	3002	2991
q14	267	233	229	229
q15	522	481	477	477
q16	509	381	377	377
q17	977	695	746	695
q18	8126	7591	7347	7347
q19	8293	1580	1547	1547
q20	690	330	338	330
q21	4921	3836	3320	3320
q22	399	338	335	335
Total cold run time: 121999 ms
Total hot run time: 40433 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4397	4425	4257	4257
q2	373	253	260	253
q3	3028	2727	2680	2680
q4	1897	1596	1584	1584
q5	5270	5312	5310	5310
q6	225	131	131	131
q7	2115	1709	1743	1709
q8	3197	3378	3346	3346
q9	8400	8326	8302	8302
q10	3871	3651	3700	3651
q11	606	488	480	480
q12	797	581	615	581
q13	16423	2971	2997	2971
q14	286	276	262	262
q15	522	479	476	476
q16	471	416	409	409
q17	1791	1494	1489	1489
q18	7772	7565	7438	7438
q19	1701	1640	1635	1635
q20	2020	1794	1781	1781
q21	4793	4770	4710	4710
q22	616	546	558	546
Total cold run time: 70571 ms
Total hot run time: 54001 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 174363 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e5694632b727456a055f074f3375ca97d9f8df94, data reload: false

query1	916	382	362	362
query2	6465	2392	2271	2271
query3	6661	204	211	204
query4	27817	17556	17455	17455
query5	4214	497	494	494
query6	265	178	169	169
query7	4581	292	300	292
query8	329	293	299	293
query9	8472	2394	2381	2381
query10	613	300	285	285
query11	11454	9983	10055	9983
query12	142	86	80	80
query13	1645	384	392	384
query14	10258	7598	7691	7598
query15	242	192	191	191
query16	7788	332	320	320
query17	1898	547	550	547
query18	1871	305	287	287
query19	223	157	164	157
query20	91	87	84	84
query21	221	145	131	131
query22	4266	3998	4136	3998
query23	33603	33037	33189	33037
query24	11830	2860	2913	2860
query25	681	388	390	388
query26	1800	153	156	153
query27	2886	273	271	271
query28	7562	2112	2096	2096
query29	1108	650	644	644
query30	297	154	149	149
query31	983	748	743	743
query32	100	56	58	56
query33	791	315	319	315
query34	898	489	482	482
query35	706	598	580	580
query36	1083	971	932	932
query37	160	83	85	83
query38	2879	2706	2770	2706
query39	869	808	808	808
query40	285	129	126	126
query41	59	54	54	54
query42	128	103	108	103
query43	592	526	528	526
query44	1238	767	746	746
query45	192	164	164	164
query46	1089	746	724	724
query47	1860	1790	1768	1768
query48	391	311	312	311
query49	1184	437	431	431
query50	784	402	395	395
query51	6943	6837	6763	6763
query52	104	92	96	92
query53	366	298	307	298
query54	1033	469	470	469
query55	76	78	76	76
query56	332	298	308	298
query57	1164	1062	1065	1062
query58	380	256	252	252
query59	3298	3080	3010	3010
query60	333	282	290	282
query61	101	101	96	96
query62	832	660	648	648
query63	327	290	295	290
query64	10451	2243	1635	1635
query65	3363	3119	3067	3067
query66	1356	351	326	326
query67	15707	15264	15117	15117
query68	9453	611	573	573
query69	748	453	337	337
query70	1376	1111	1157	1111
query71	541	276	282	276
query72	9450	5711	5795	5711
query73	2214	330	336	330
query74	5919	5499	5507	5499
query75	6361	2648	2671	2648
query76	5606	952	952	952
query77	753	320	318	318
query78	9792	8998	8972	8972
query79	10723	518	528	518
query80	1062	490	477	477
query81	586	226	225	225
query82	229	135	132	132
query83	335	162	168	162
query84	269	88	84	84
query85	1041	306	345	306
query86	366	326	308	308
query87	3313	3109	3175	3109
query88	5118	2453	2447	2447
query89	520	373	371	371
query90	2075	189	191	189
query91	133	103	101	101
query92	66	48	49	48
query93	6410	519	521	519
query94	1478	211	207	207
query95	398	310	312	310
query96	613	277	272	272
query97	3139	3000	3030	3000
query98	236	206	194	194
query99	1538	1267	1259	1259
Total cold run time: 314497 ms
Total hot run time: 174363 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.5 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e5694632b727456a055f074f3375ca97d9f8df94, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.68	0.07	0.10
query5	0.51	0.49	0.48
query6	1.14	0.72	0.73
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.56	0.49	0.48
query10	0.55	0.55	0.54
query11	0.15	0.11	0.10
query12	0.15	0.13	0.12
query13	0.59	0.59	0.58
query14	0.76	0.77	0.81
query15	0.85	0.81	0.81
query16	0.35	0.36	0.37
query17	0.96	0.98	0.95
query18	0.21	0.21	0.21
query19	1.73	1.69	1.68
query20	0.01	0.00	0.01
query21	15.42	0.76	0.65
query22	4.17	6.61	1.96
query23	18.28	1.41	1.24
query24	2.18	0.21	0.22
query25	0.16	0.09	0.08
query26	0.30	0.20	0.20
query27	0.46	0.23	0.22
query28	13.26	1.01	0.99
query29	12.63	3.28	3.25
query30	0.25	0.08	0.05
query31	2.87	0.38	0.39
query32	3.25	0.48	0.47
query33	2.87	2.90	2.88
query34	17.06	4.41	4.38
query35	4.43	4.46	4.50
query36	0.65	0.46	0.47
query37	0.18	0.15	0.15
query38	0.15	0.14	0.14
query39	0.04	0.04	0.03
query40	0.14	0.12	0.13
query41	0.10	0.05	0.05
query42	0.06	0.05	0.04
query43	0.05	0.04	0.04
Total cold run time: 109.57 s
Total hot run time: 30.5 s

@mymeiyi mymeiyi force-pushed the enable-group-commit branch from e569463 to 07eaf4f Compare July 10, 2024 03:47
@mymeiyi
Copy link
Contributor Author

mymeiyi commented Jul 10, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39986 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 07eaf4f85cce875837cfb2e6539ea7f648ada0fc, data reload: false

------ Round 1 ----------------------------------
q1	17622	4337	4240	4240
q2	2018	200	186	186
q3	10445	1202	1083	1083
q4	10184	860	877	860
q5	7514	2672	2582	2582
q6	217	136	133	133
q7	964	592	604	592
q8	9233	2038	2085	2038
q9	8994	6510	6463	6463
q10	9051	3724	3722	3722
q11	451	235	235	235
q12	404	227	225	225
q13	17758	3043	3003	3003
q14	264	242	229	229
q15	515	498	521	498
q16	608	375	378	375
q17	956	694	677	677
q18	8031	7604	7602	7602
q19	6767	1442	1459	1442
q20	676	309	331	309
q21	4909	3184	3149	3149
q22	389	343	344	343
Total cold run time: 117970 ms
Total hot run time: 39986 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4421	4295	4263	4263
q2	366	275	260	260
q3	3026	2948	3007	2948
q4	2040	1791	1802	1791
q5	5661	5733	5646	5646
q6	231	137	135	135
q7	2447	2036	1934	1934
q8	3362	3543	3481	3481
q9	8866	8925	8837	8837
q10	4138	3786	3817	3786
q11	607	526	492	492
q12	810	679	621	621
q13	17233	3140	3136	3136
q14	306	281	280	280
q15	534	488	509	488
q16	488	463	443	443
q17	1820	1520	1488	1488
q18	8190	7904	7942	7904
q19	1837	1646	1537	1537
q20	2973	1889	1890	1889
q21	13163	4763	4788	4763
q22	658	570	576	570
Total cold run time: 83177 ms
Total hot run time: 56692 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 174286 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 07eaf4f85cce875837cfb2e6539ea7f648ada0fc, data reload: false

query1	911	377	367	367
query2	6429	2571	2615	2571
query3	6633	204	218	204
query4	28554	17522	17423	17423
query5	3652	479	470	470
query6	266	173	165	165
query7	4578	294	280	280
query8	311	310	302	302
query9	8511	2394	2377	2377
query10	440	285	268	268
query11	10909	10194	10079	10079
query12	120	89	82	82
query13	1641	391	397	391
query14	10178	7733	6934	6934
query15	241	189	191	189
query16	7666	321	308	308
query17	1367	568	538	538
query18	1959	288	286	286
query19	201	154	158	154
query20	91	85	89	85
query21	214	128	131	128
query22	4394	4275	4256	4256
query23	34035	33599	33751	33599
query24	11089	2872	2872	2872
query25	612	438	417	417
query26	715	163	153	153
query27	2283	283	285	283
query28	6265	2138	2136	2136
query29	936	656	642	642
query30	253	154	160	154
query31	966	768	766	766
query32	102	58	57	57
query33	717	382	299	299
query34	913	497	492	492
query35	695	565	574	565
query36	1152	981	986	981
query37	145	81	83	81
query38	2954	2835	2824	2824
query39	876	814	814	814
query40	204	119	121	119
query41	53	49	51	49
query42	115	96	101	96
query43	615	578	547	547
query44	1218	735	751	735
query45	190	160	158	158
query46	1086	741	724	724
query47	1881	1792	1765	1765
query48	369	293	300	293
query49	840	397	401	397
query50	799	392	393	392
query51	6835	6804	6805	6804
query52	100	96	90	90
query53	359	286	286	286
query54	892	459	443	443
query55	73	74	73	73
query56	299	257	291	257
query57	1103	1050	1058	1050
query58	250	256	256	256
query59	3639	3122	3320	3122
query60	301	275	283	275
query61	100	97	93	93
query62	795	636	640	636
query63	331	286	286	286
query64	9492	2205	1625	1625
query65	3136	3110	3098	3098
query66	809	323	333	323
query67	15681	15033	14878	14878
query68	8420	559	553	553
query69	710	461	353	353
query70	1223	1082	1138	1082
query71	541	282	279	279
query72	8974	5626	5287	5287
query73	1738	326	324	324
query74	5870	5544	5531	5531
query75	5194	2647	2658	2647
query76	4796	889	923	889
query77	796	306	308	306
query78	9520	8942	9005	8942
query79	3093	520	516	516
query80	2180	487	480	480
query81	577	222	220	220
query82	285	133	145	133
query83	289	179	169	169
query84	280	90	86	86
query85	949	322	357	322
query86	356	306	279	279
query87	3294	3112	3096	3096
query88	4307	2461	2452	2452
query89	508	393	380	380
query90	1990	193	193	193
query91	131	104	106	104
query92	63	51	50	50
query93	4368	526	512	512
query94	1345	209	215	209
query95	413	315	319	315
query96	606	281	281	281
query97	3250	2999	3053	2999
query98	220	201	201	201
query99	1480	1234	1272	1234
Total cold run time: 293305 ms
Total hot run time: 174286 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.03 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 07eaf4f85cce875837cfb2e6539ea7f648ada0fc, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.03
query3	0.22	0.04	0.04
query4	1.68	0.06	0.06
query5	0.48	0.49	0.48
query6	1.13	0.72	0.73
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.56	0.48	0.48
query10	0.53	0.54	0.55
query11	0.16	0.11	0.11
query12	0.14	0.11	0.12
query13	0.60	0.58	0.58
query14	0.75	0.78	0.77
query15	0.86	0.81	0.82
query16	0.37	0.37	0.36
query17	0.99	0.95	1.00
query18	0.24	0.23	0.23
query19	1.79	1.85	1.67
query20	0.02	0.01	0.01
query21	15.40	0.75	0.66
query22	3.73	6.92	2.44
query23	18.30	1.34	1.24
query24	2.16	0.26	0.23
query25	0.16	0.09	0.09
query26	0.32	0.21	0.21
query27	0.45	0.22	0.22
query28	13.22	1.02	1.00
query29	12.58	3.35	3.31
query30	0.25	0.06	0.05
query31	2.88	0.41	0.40
query32	3.24	0.49	0.46
query33	2.94	2.97	2.93
query34	17.09	4.31	4.32
query35	4.42	4.42	4.40
query36	0.65	0.48	0.48
query37	0.18	0.16	0.16
query38	0.15	0.15	0.15
query39	0.04	0.03	0.04
query40	0.14	0.12	0.12
query41	0.09	0.05	0.04
query42	0.06	0.05	0.04
query43	0.05	0.05	0.03
Total cold run time: 109.21 s
Total hot run time: 31.03 s

@mymeiyi
Copy link
Contributor Author

mymeiyi commented Jul 10, 2024

run p0

@mymeiyi mymeiyi force-pushed the enable-group-commit branch from 07eaf4f to 49b5796 Compare July 11, 2024 02:26
@mymeiyi mymeiyi force-pushed the enable-group-commit branch from 49b5796 to 4e471d5 Compare July 11, 2024 02:33
@mymeiyi
Copy link
Contributor Author

mymeiyi commented Jul 11, 2024

run buildall

@mymeiyi mymeiyi changed the title [regression-test](group commit) enable wait_internal_group_commit_finish [regression-test](group commit) modify some case to make wait_internal_group_commit_finish mode can run all case Jul 11, 2024
@mymeiyi mymeiyi changed the title [regression-test](group commit) modify some case to make wait_internal_group_commit_finish mode can run all case [regression-test](group commit) modify some case to make group commit can run all case Jul 11, 2024
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jul 11, 2024
@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@dataroaring dataroaring merged commit 9bfb5e3 into apache:master Jul 11, 2024
seawinde pushed a commit to seawinde/doris that referenced this pull request Jul 17, 2024
… can run all case (apache#26856)

## Proposed changes

Enable `wait_internal_group_commit_finish` to check if all cases can
pass:

fe.conf
```
wait_internal_group_commit_finish=true
group_commit_interval_ms_default_value=2
```

be.conf
```
wait_internal_group_commit_finish=true
```

some cases are not compitable, add `excludeSuites` in
`regression-conf.groovy`:
```
"test_group_commit_data_bytes_property,test_group_commit_interval_ms_property,insert_group_commit_into_unique_sync_mode,insert_group_commit_into_max_filter_ratio,test_group_commit_stream_load,test_wal_mem_back_pressure_fault_injection," +
    "test_table_options,test_show_transaction,test_base_insert_job,test_show_create_table_and_views,test_show_create_table_and_views_nereids,test_get_stream_load_state,test_ctas,test_publish_timeout," +
    "test_array_insert_overflow," +
```


## Further comments

If this is a relatively large or complex change, kick off the discussion
at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why
you chose the solution you did and what alternatives you considered,
etc...
dataroaring pushed a commit that referenced this pull request Jul 17, 2024
… can run all case (#26856)

## Proposed changes

Enable `wait_internal_group_commit_finish` to check if all cases can
pass:

fe.conf
```
wait_internal_group_commit_finish=true
group_commit_interval_ms_default_value=2
```

be.conf
```
wait_internal_group_commit_finish=true
```

some cases are not compitable, add `excludeSuites` in
`regression-conf.groovy`:
```
"test_group_commit_data_bytes_property,test_group_commit_interval_ms_property,insert_group_commit_into_unique_sync_mode,insert_group_commit_into_max_filter_ratio,test_group_commit_stream_load,test_wal_mem_back_pressure_fault_injection," +
    "test_table_options,test_show_transaction,test_base_insert_job,test_show_create_table_and_views,test_show_create_table_and_views_nereids,test_get_stream_load_state,test_ctas,test_publish_timeout," +
    "test_array_insert_overflow," +
```


## Further comments

If this is a relatively large or complex change, kick off the discussion
at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why
you chose the solution you did and what alternatives you considered,
etc...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/3.0.1-merged meta-change reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants