Skip to content

Conversation

@github-actions
Copy link
Contributor

@github-actions github-actions bot commented Jan 6, 2025

Cherry-picked from #46292

For certain scenarios, it is possible to set the max_match_interval of
the routine load to be very small, such as setting it to 1, which can
result in a very short timeout period. In some scenarios (such as high
pressure and using MOW table), it may lead to a continuous non
consumption for timeout. Therefore, a minimum timeout is configured to
solve a problem.
@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring closed this Jan 6, 2025
@dataroaring dataroaring reopened this Jan 6, 2025
@hello-stephen
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40682 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 39ba9aa09d730a4c79e09cb50291ca4fcec381e1, data reload: false

------ Round 1 ----------------------------------
q1	17838	7417	7256	7256
q2	2069	165	170	165
q3	10551	1151	1135	1135
q4	10229	802	690	690
q5	7731	2829	2814	2814
q6	234	147	148	147
q7	977	616	604	604
q8	9368	1930	1961	1930
q9	6534	6416	6373	6373
q10	6952	2338	2318	2318
q11	471	264	265	264
q12	423	217	223	217
q13	17786	3004	2987	2987
q14	250	209	212	209
q15	576	532	527	527
q16	699	616	612	612
q17	973	548	608	548
q18	7354	6560	6755	6560
q19	1400	1045	1087	1045
q20	477	209	200	200
q21	4059	3102	3257	3102
q22	1121	979	1001	979
Total cold run time: 108072 ms
Total hot run time: 40682 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7285	7261	7226	7226
q2	325	238	231	231
q3	2921	2958	3035	2958
q4	2131	1859	1779	1779
q5	6050	5736	5708	5708
q6	222	138	144	138
q7	2201	1796	1853	1796
q8	3310	3505	3479	3479
q9	8887	8893	8866	8866
q10	3590	3523	3525	3523
q11	598	507	511	507
q12	871	594	609	594
q13	10210	3179	3116	3116
q14	300	278	266	266
q15	568	520	530	520
q16	713	662	675	662
q17	1801	1562	1548	1548
q18	7761	7568	7317	7317
q19	1650	1434	1442	1434
q20	2026	1807	1817	1807
q21	5500	5164	5188	5164
q22	1096	1036	968	968
Total cold run time: 70016 ms
Total hot run time: 59607 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191551 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 39ba9aa09d730a4c79e09cb50291ca4fcec381e1, data reload: false

query1	1000	378	362	362
query2	6510	2096	2052	2052
query3	6704	217	218	217
query4	33851	23514	23520	23514
query5	4404	457	454	454
query6	274	187	181	181
query7	4622	310	318	310
query8	285	224	229	224
query9	9443	2679	2664	2664
query10	499	265	254	254
query11	18212	15235	15115	15115
query12	156	103	99	99
query13	1645	449	410	410
query14	9241	7793	6655	6655
query15	259	176	180	176
query16	8193	494	388	388
query17	1690	585	576	576
query18	2136	314	321	314
query19	374	166	154	154
query20	120	108	111	108
query21	209	107	110	107
query22	4550	4276	4302	4276
query23	34727	33868	36373	33868
query24	11835	2885	2865	2865
query25	570	428	407	407
query26	1199	175	173	173
query27	2789	348	363	348
query28	7824	2472	2415	2415
query29	688	458	446	446
query30	345	175	162	162
query31	1017	816	798	798
query32	100	60	62	60
query33	789	297	299	297
query34	938	496	513	496
query35	866	713	725	713
query36	1125	922	948	922
query37	204	74	81	74
query38	3997	3867	3930	3867
query39	1488	1456	1423	1423
query40	285	105	103	103
query41	56	52	53	52
query42	123	105	102	102
query43	545	501	490	490
query44	1272	809	811	809
query45	185	173	175	173
query46	1145	733	747	733
query47	1934	1825	1814	1814
query48	479	388	388	388
query49	1249	411	413	411
query50	820	413	422	413
query51	7279	7154	7146	7146
query52	106	93	92	92
query53	258	188	184	184
query54	1040	476	465	465
query55	82	80	81	80
query56	290	269	268	268
query57	1205	1160	1117	1117
query58	256	205	208	205
query59	3141	3021	2839	2839
query60	281	259	250	250
query61	111	113	111	111
query62	847	665	665	665
query63	233	188	186	186
query64	5215	669	628	628
query65	3324	3184	3183	3183
query66	1079	335	302	302
query67	16118	15521	15537	15521
query68	4999	558	556	556
query69	410	267	270	267
query70	1212	1147	1156	1147
query71	322	261	269	261
query72	6019	4061	4038	4038
query73	746	350	347	347
query74	10192	9015	8987	8987
query75	3413	2639	2647	2639
query76	3008	1106	1178	1106
query77	542	282	283	282
query78	10469	9706	9635	9635
query79	1569	592	598	592
query80	1169	431	414	414
query81	557	244	242	242
query82	899	122	115	115
query83	218	151	153	151
query84	235	85	76	76
query85	1171	314	301	301
query86	356	277	298	277
query87	4440	4546	4328	4328
query88	3739	2412	2373	2373
query89	399	288	293	288
query90	1963	193	192	192
query91	183	148	150	148
query92	63	50	52	50
query93	1106	540	535	535
query94	760	305	298	298
query95	371	254	260	254
query96	614	284	285	284
query97	3327	3203	3198	3198
query98	211	207	196	196
query99	1538	1300	1304	1300
Total cold run time: 300056 ms
Total hot run time: 191551 ms

@dataroaring dataroaring merged commit de72a8e into branch-3.0 Jan 13, 2025
20 of 21 checks passed
@github-actions github-actions bot deleted the auto-pick-46292-branch-3.0 branch January 13, 2025 13:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants