Skip to content

[fix](cloud)Fix auto start affected by daemon jobs #51729

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
dataroaring merged 3 commits into from
Jun 25, 2025
Merged

[fix](cloud)Fix auto start affected by daemon jobs #51729

dataroaring merged 3 commits into from
Jun 25, 2025

Conversation

@deardeng
Copy link
Contributor

@deardeng deardeng commented Jun 15, 2025

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Jun 15, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@deardeng
Copy link
Contributor Author

deardeng commented Jun 15, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Jun 15, 2025

TPC-H: Total hot run time: 34671 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4ffebfd7b516f4909e5e6daeaba91fc1cd5a44ca, data reload: false

------ Round 1 ----------------------------------
q1	17621	5102	4985	4985
q2	1948	275	180	180
q3	10301	1275	743	743
q4	10340	1003	538	538
q5	8800	2355	2297	2297
q6	185	162	130	130
q7	897	756	605	605
q8	9304	1267	1097	1097
q9	6834	5060	5127	5060
q10	6839	2337	1910	1910
q11	505	294	300	294
q12	365	363	222	222
q13	17803	3696	3175	3175
q14	248	241	218	218
q15	572	487	486	486
q16	437	444	385	385
q17	633	849	379	379
q18	7569	7151	7096	7096
q19	1414	957	556	556
q20	365	368	240	240
q21	4249	3287	3071	3071
q22	1065	1026	1004	1004
Total cold run time: 108294 ms
Total hot run time: 34671 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5081	5131	5000	5000
q2	259	322	221	221
q3	2270	2760	2466	2466
q4	1493	1862	1456	1456
q5	4263	4318	4414	4318
q6	217	174	133	133
q7	2003	1956	1795	1795
q8	2620	2744	2700	2700
q9	7224	7309	7296	7296
q10	2953	3197	2843	2843
q11	597	518	496	496
q12	707	764	625	625
q13	3585	3973	3310	3310
q14	279	312	277	277
q15	525	474	492	474
q16	457	504	451	451
q17	1196	1545	1418	1418
q18	7851	7625	7485	7485
q19	859	825	902	825
q20	1991	2077	1938	1938
q21	5020	4466	4474	4466
q22	1124	1070	1035	1035
Total cold run time: 52574 ms
Total hot run time: 51028 ms

@doris-robot
Copy link

doris-robot commented Jun 15, 2025

TPC-DS: Total hot run time: 196558 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4ffebfd7b516f4909e5e6daeaba91fc1cd5a44ca, data reload: false

query1	1430	1009	1005	1005
query2	6280	1952	1950	1950
query3	11022	4694	4496	4496
query4	55052	25976	23545	23545
query5	5020	534	478	478
query6	348	227	232	227
query7	4881	541	312	312
query8	282	246	231	231
query9	5419	2904	2910	2904
query10	472	364	296	296
query11	15027	15048	14931	14931
query12	164	117	119	117
query13	1040	581	442	442
query14	10246	6395	6349	6349
query15	199	201	212	201
query16	7153	668	479	479
query17	1076	732	581	581
query18	1656	430	328	328
query19	217	209	183	183
query20	138	135	131	131
query21	210	138	112	112
query22	4495	4614	4399	4399
query23	34454	33739	33850	33739
query24	6649	2474	2445	2445
query25	482	495	416	416
query26	688	278	162	162
query27	2290	546	375	375
query28	3079	2425	2397	2397
query29	647	628	493	493
query30	278	237	205	205
query31	898	883	827	827
query32	76	67	69	67
query33	473	396	344	344
query34	861	903	592	592
query35	853	832	760	760
query36	1001	1043	960	960
query37	122	105	84	84
query38	4316	4286	4227	4227
query39	1539	1537	1449	1449
query40	212	124	116	116
query41	66	62	61	61
query42	135	126	123	123
query43	542	540	539	539
query44	1466	948	931	931
query45	191	183	173	173
query46	942	1061	680	680
query47	1822	1904	1827	1827
query48	440	457	343	343
query49	655	503	435	435
query50	714	716	431	431
query51	4240	4318	4296	4296
query52	122	128	107	107
query53	250	273	199	199
query54	629	631	563	563
query55	93	94	87	87
query56	337	337	336	336
query57	1239	1266	1157	1157
query58	291	291	284	284
query59	2784	2969	2803	2803
query60	343	362	336	336
query61	136	128	142	128
query62	750	740	704	704
query63	242	196	209	196
query64	1795	1089	749	749
query65	4226	4117	4168	4117
query66	722	404	321	321
query67	16364	15755	15542	15542
query68	6176	961	601	601
query69	546	349	278	278
query70	1295	1209	1143	1143
query71	474	354	320	320
query72	5842	4831	4808	4808
query73	1383	665	390	390
query74	9194	9186	9108	9108
query75	3440	3230	2742	2742
query76	3751	1221	867	867
query77	555	391	307	307
query78	9998	10219	9429	9429
query79	2192	852	624	624
query80	621	590	493	493
query81	474	263	238	238
query82	179	129	102	102
query83	269	269	252	252
query84	311	115	100	100
query85	796	374	335	335
query86	353	335	314	314
query87	4421	4586	4431	4431
query88	3640	2454	2444	2444
query89	448	334	295	295
query90	1890	215	206	206
query91	153	151	118	118
query92	83	72	59	59
query93	1799	986	649	649
query94	668	430	282	282
query95	390	310	302	302
query96	539	593	296	296
query97	2728	2811	2702	2702
query98	228	209	208	208
query99	1319	1393	1292	1292
Total cold run time: 298436 ms
Total hot run time: 196558 ms

@doris-robot
Copy link

doris-robot commented Jun 15, 2025

ClickBench: Total hot run time: 29.14 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4ffebfd7b516f4909e5e6daeaba91fc1cd5a44ca, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.05	0.04
query3	0.24	0.07	0.07
query4	1.60	0.10	0.10
query5	0.44	0.40	0.42
query6	1.19	0.67	0.68
query7	0.03	0.01	0.02
query8	0.05	0.04	0.04
query9	0.57	0.53	0.53
query10	0.59	0.61	0.59
query11	0.17	0.12	0.12
query12	0.16	0.12	0.12
query13	0.63	0.60	0.60
query14	0.83	0.80	0.82
query15	0.90	0.86	0.86
query16	0.38	0.38	0.38
query17	1.05	1.04	1.08
query18	0.23	0.22	0.22
query19	1.94	1.86	1.82
query20	0.01	0.01	0.01
query21	15.42	0.90	0.55
query22	0.79	1.12	0.71
query23	14.90	1.44	0.60
query24	6.72	1.86	0.75
query25	0.47	0.12	0.09
query26	0.60	0.17	0.16
query27	0.06	0.06	0.06
query28	9.36	0.94	0.46
query29	12.55	4.10	3.40
query30	0.26	0.10	0.07
query31	2.83	0.63	0.40
query32	3.24	0.57	0.48
query33	3.07	3.14	3.09
query34	15.66	5.09	4.51
query35	4.55	4.53	4.52
query36	0.68	0.51	0.49
query37	0.09	0.07	0.07
query38	0.05	0.04	0.04
query39	0.03	0.03	0.04
query40	0.17	0.14	0.14
query41	0.09	0.02	0.03
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 102.79 s
Total hot run time: 29.14 s

@hello-stephen
Copy link
Contributor

hello-stephen commented Jun 15, 2025

FE UT Coverage Report

Increment line coverage 0.00% (0/4) 🎉
Increment coverage report
Complete coverage report

@deardeng
Copy link
Contributor Author

deardeng commented Jun 24, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Jun 24, 2025

TPC-H: Total hot run time: 33849 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 44588bb74d26eb514bd0980d1881bee7db48333d, data reload: false

------ Round 1 ----------------------------------
q1	17597	5229	5054	5054
q2	1928	285	200	200
q3	10336	1301	717	717
q4	10236	1006	507	507
q5	7564	2391	2331	2331
q6	183	160	137	137
q7	901	746	608	608
q8	9315	1311	1106	1106
q9	6755	5011	5008	5008
q10	6925	2368	1984	1984
q11	510	304	279	279
q12	348	359	223	223
q13	17769	3661	3039	3039
q14	226	238	219	219
q15	574	477	470	470
q16	437	428	377	377
q17	632	886	383	383
q18	7506	7178	7092	7092
q19	1595	946	572	572
q20	339	343	225	225
q21	3746	3168	2361	2361
q22	1045	1022	957	957
Total cold run time: 106467 ms
Total hot run time: 33849 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5223	5127	5122	5122
q2	252	322	221	221
q3	2154	2669	2284	2284
q4	1378	1831	1312	1312
q5	4187	4267	4377	4267
q6	210	166	131	131
q7	2017	1907	1778	1778
q8	2563	2605	2540	2540
q9	7087	7038	7117	7038
q10	3071	3251	2828	2828
q11	568	536	496	496
q12	708	760	587	587
q13	3446	3867	3317	3317
q14	292	290	269	269
q15	518	475	476	475
q16	455	485	443	443
q17	1130	1507	1416	1416
q18	7334	7099	7055	7055
q19	797	889	948	889
q20	1898	2009	1826	1826
q21	4711	4326	4241	4241
q22	1063	1043	993	993
Total cold run time: 51062 ms
Total hot run time: 49528 ms

@dataroaring dataroaring added usercase Important user case type label dev/3.1.x labels Jun 25, 2025
dataroaring
dataroaring approved these changes Jun 25, 2025
View reviewed changes
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jun 25, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Jun 25, 2025

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Jun 25, 2025

PR approved by anyone and no changes requested.

@dataroaring dataroaring merged commit 3571050 into apache:master Jun 25, 2025
28 of 30 checks passed
deardeng added a commit to deardeng/incubator-doris that referenced this pull request Jun 30, 2025
@deardeng
[fix](cloud)Fix auto start affected by daemon jobs (apache#51729)
4f88f37
@deardeng deardeng mentioned this pull request Jun 30, 2025
Merged
deardeng added a commit to deardeng/incubator-doris that referenced this pull request Jun 30, 2025
@deardeng
[fix](cloud)Fix auto start affected by daemon jobs (apache#51729)
ed5c6df
@deardeng deardeng mentioned this pull request Jun 30, 2025
Merged
morrySnow pushed a commit that referenced this pull request Jul 1, 2025
@deardeng
branch-3.1: [fix](cloud)Fix auto start affected by daemon jobs #51729 (…
8bb59d3 
…#52521)

cherry pick from #51729
dataroaring pushed a commit that referenced this pull request Jul 2, 2025
@deardeng
branch-3.0: [fix](cloud)Fix auto start affected by daemon jobs #51729 (…
6693a90 
…#52519)

cherry pick from #51729
koarz pushed a commit to koarz/doris that referenced this pull request Jul 3, 2025
@deardeng @koarz
branch-3.0: [fix](cloud)Fix auto start affected by daemon jobs apache…
fcbc884 
…#51729 (apache#52519)

cherry pick from apache#51729
Hastyshell pushed a commit to Hastyshell/doris that referenced this pull request Jul 21, 2025
@deardeng
(selectdb-cloud) Fix auto start affected by __internal_schema db da…
6ea129b 
…emon thread apache#51729 (apache#4079)
@gavinchou gavinchou mentioned this pull request Aug 15, 2025
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@gavinchou gavinchou gavinchou approved these changes

@dataroaring dataroaring dataroaring approved these changes

@w41ter w41ter Awaiting requested review from w41ter w41ter is a code owner

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. cloud dev/3.0.7-merged dev/3.1.0-merged reviewed usercase Important user case type label

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

7 participants

@deardeng @Thearas @doris-robot @hello-stephen @gavinchou @dataroaring @morrySnow