[Fix](Streamingjob) fix streaming job auto resume clear error #59868

JNSimba · 2026-01-14T07:32:27Z

What problem does this PR solve?

Related PR: #57551 #59784

Currently, errors are automatically cleaned up during autoresume. Therefore, if a task continues to generate errors and autoresume, the errors may not be detected at the job level.
Data quality errors are flagged when retrieving tasks.

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

hello-stephen · 2026-01-14T07:32:32Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

JNSimba · 2026-01-14T07:36:47Z

run buildall

doris-robot · 2026-01-14T08:19:27Z

TPC-H: Total hot run time: 32116 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c39be48bc77731ab041db4ca32cffd49d9b8fc1c, data reload: false

------ Round 1 ----------------------------------
q1	17640	4200	4039	4039
q2	2047	367	238	238
q3	10232	1278	720	720
q4	10232	932	328	328
q5	7532	2094	1850	1850
q6	185	168	138	138
q7	926	806	645	645
q8	9273	1376	1150	1150
q9	4856	4581	4697	4581
q10	6743	1819	1422	1422
q11	517	287	286	286
q12	704	745	584	584
q13	17780	3812	3113	3113
q14	291	280	279	279
q15	562	514	508	508
q16	663	684	667	667
q17	653	800	477	477
q18	6602	6533	6871	6533
q19	1265	1006	651	651
q20	437	383	259	259
q21	3268	2672	2611	2611
q22	1166	1075	1037	1037
Total cold run time: 103574 ms
Total hot run time: 32116 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4462	4319	4225	4225
q2	348	415	324	324
q3	2287	3017	2421	2421
q4	1390	1894	1505	1505
q5	4425	4374	4287	4287
q6	215	164	133	133
q7	2004	1968	1781	1781
q8	2541	2646	2414	2414
q9	7098	7161	7210	7161
q10	2483	2726	2320	2320
q11	569	494	459	459
q12	725	786	623	623
q13	3641	3968	3095	3095
q14	266	284	267	267
q15	525	488	485	485
q16	606	646	608	608
q17	1102	1284	1319	1284
q18	7480	7354	7239	7239
q19	850	784	795	784
q20	1878	1978	1807	1807
q21	4485	4248	4174	4174
q22	1062	1024	994	994
Total cold run time: 50442 ms
Total hot run time: 48390 ms

JNSimba · 2026-01-14T08:29:09Z

run buildall

sollhui

LGTM

JNSimba · 2026-01-14T08:42:58Z

run buildall

doris-robot · 2026-01-14T09:54:53Z

TPC-H: Total hot run time: 32170 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ca10b713f0b0fbd80b924ec842ebab2b8860094e, data reload: false

------ Round 1 ----------------------------------
q1	17617	4150	4028	4028
q2	2032	389	239	239
q3	10131	1311	717	717
q4	10233	922	313	313
q5	7517	2123	1894	1894
q6	189	167	137	137
q7	923	813	666	666
q8	9266	1460	1116	1116
q9	4904	4544	4616	4544
q10	6802	1774	1419	1419
q11	538	300	282	282
q12	689	768	577	577
q13	17781	3838	3130	3130
q14	290	307	270	270
q15	587	512	515	512
q16	688	700	667	667
q17	665	801	515	515
q18	6725	6538	7117	6538
q19	1132	1055	667	667
q20	423	374	264	264
q21	3292	2665	2653	2653
q22	1119	1058	1022	1022
Total cold run time: 103543 ms
Total hot run time: 32170 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4448	4196	4320	4196
q2	339	429	335	335
q3	2288	2796	2311	2311
q4	1438	1872	1391	1391
q5	4456	4442	4510	4442
q6	213	167	131	131
q7	2024	1980	1862	1862
q8	2583	2372	2394	2372
q9	7239	7129	7261	7129
q10	2491	2646	2353	2353
q11	543	475	468	468
q12	689	755	655	655
q13	3649	3894	3066	3066
q14	261	276	255	255
q15	518	489	479	479
q16	613	670	604	604
q17	1086	1230	1250	1230
q18	7373	7258	7278	7258
q19	830	808	800	800
q20	1894	1956	1781	1781
q21	4480	4307	4136	4136
q22	1099	991	973	973
Total cold run time: 50554 ms
Total hot run time: 48227 ms

doris-robot · 2026-01-14T10:05:44Z

TPC-DS: Total hot run time: 173442 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ca10b713f0b0fbd80b924ec842ebab2b8860094e, data reload: false

query5	5016	628	473	473
query6	323	226	245	226
query7	4212	451	253	253
query8	356	294	237	237
query9	8726	2875	2879	2875
query10	568	374	308	308
query11	15253	15180	14752	14752
query12	192	111	109	109
query13	1243	464	382	382
query14	6471	2990	2749	2749
query14_1	2634	2601	2660	2601
query15	211	197	179	179
query16	1007	491	484	484
query17	1087	660	536	536
query18	2703	420	327	327
query19	218	211	191	191
query20	118	116	111	111
query21	211	143	132	132
query22	4038	4129	3889	3889
query23	15919	15571	15123	15123
query23_1	15443	15443	15284	15284
query24	7249	1519	1143	1143
query24_1	1180	1153	1151	1151
query25	547	442	398	398
query26	1242	272	153	153
query27	2758	443	269	269
query28	4573	2141	2135	2135
query29	767	568	453	453
query30	298	234	213	213
query31	826	636	556	556
query32	89	75	78	75
query33	538	357	317	317
query34	919	888	523	523
query35	740	777	684	684
query36	856	904	840	840
query37	132	97	84	84
query38	2696	2685	2708	2685
query39	773	752	740	740
query39_1	712	720	703	703
query40	225	141	129	129
query41	75	68	68	68
query42	108	114	104	104
query43	433	432	374	374
query44	1307	760	746	746
query45	191	182	177	177
query46	828	948	561	561
query47	1473	1514	1343	1343
query48	324	329	243	243
query49	623	429	360	360
query50	618	281	213	213
query51	3724	3952	3805	3805
query52	109	111	102	102
query53	298	324	277	277
query54	315	288	293	288
query55	84	84	77	77
query56	329	316	323	316
query57	1015	1055	891	891
query58	287	264	272	264
query59	2109	2227	2159	2159
query60	362	343	331	331
query61	192	193	184	184
query62	396	373	321	321
query63	302	263	272	263
query64	4977	1373	999	999
query65	3846	3787	3754	3754
query66	1381	408	309	309
query67	15902	14885	14906	14885
query68	6669	981	688	688
query69	509	356	332	332
query70	1053	858	876	858
query71	368	298	290	290
query72	5683	3469	3435	3435
query73	783	715	307	307
query74	8726	8700	8567	8567
query75	2803	2839	2468	2468
query76	3441	1063	641	641
query77	526	372	293	293
query78	9626	9938	9163	9163
query79	1355	894	584	584
query80	631	586	494	494
query81	527	259	230	230
query82	215	155	112	112
query83	262	255	245	245
query84	265	119	99	99
query85	911	552	460	460
query86	395	332	270	270
query87	2865	2829	2786	2786
query88	3453	2598	2584	2584
query89	381	351	332	332
query90	2178	168	163	163
query91	172	168	137	137
query92	93	72	64	64
query93	1281	878	523	523
query94	577	326	302	302
query95	606	396	317	317
query96	641	504	227	227
query97	2328	2403	2314	2314
query98	225	202	194	194
query99	583	572	513	513
Total cold run time: 253844 ms
Total hot run time: 173442 ms

doris-robot · 2026-01-14T10:10:46Z

ClickBench: Total hot run time: 27.03 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ca10b713f0b0fbd80b924ec842ebab2b8860094e, data reload: false

query1	0.06	0.05	0.05
query2	0.09	0.04	0.04
query3	0.25	0.09	0.09
query4	1.61	0.12	0.12
query5	0.27	0.25	0.24
query6	1.15	0.68	0.66
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.56	0.49	0.50
query10	0.55	0.54	0.54
query11	0.15	0.09	0.10
query12	0.13	0.10	0.11
query13	0.60	0.58	0.58
query14	0.97	0.94	0.96
query15	0.79	0.77	0.77
query16	0.40	0.40	0.39
query17	1.07	1.02	1.02
query18	0.22	0.21	0.21
query19	1.99	1.87	1.91
query20	0.04	0.01	0.02
query21	15.44	0.23	0.14
query22	5.04	0.06	0.04
query23	15.92	0.28	0.09
query24	1.88	0.62	0.53
query25	0.10	0.11	0.05
query26	0.15	0.14	0.14
query27	0.08	0.05	0.05
query28	4.32	1.07	0.88
query29	12.56	3.99	3.20
query30	0.28	0.13	0.11
query31	2.82	0.64	0.39
query32	3.23	0.56	0.46
query33	3.06	2.97	3.06
query34	16.07	5.10	4.43
query35	4.49	4.42	4.46
query36	0.65	0.51	0.51
query37	0.11	0.07	0.06
query38	0.08	0.05	0.04
query39	0.05	0.03	0.03
query40	0.17	0.14	0.13
query41	0.09	0.04	0.03
query42	0.04	0.03	0.03
query43	0.05	0.04	0.03
Total cold run time: 97.66 s
Total hot run time: 27.03 s

JNSimba · 2026-01-14T11:10:21Z

run cloud_p0

github-actions · 2026-01-14T11:23:34Z

PR approved by at least one committer and no changes requested.

github-actions · 2026-01-14T11:23:37Z

PR approved by anyone and no changes requested.

JNSimba · 2026-01-14T11:25:05Z

run external

JNSimba · 2026-01-14T11:58:16Z

run cloud_p0

JNSimba · 2026-01-14T12:51:02Z

run cloud_p0

JNSimba · 2026-01-14T14:30:29Z

run external

### What problem does this PR solve? Related PR: #57551 #59784 1. Currently, errors are automatically cleaned up during autoresume. Therefore, if a task continues to generate errors and autoresume, the errors may not be detected at the job level. 2. Data quality errors are flagged when retrieving tasks.

…rror #59868 (#59894) Cherry-picked from #59868 Co-authored-by: wudi <wudi@selectdb.com>

fix autoresume clear error

c39be48

JNSimba added the dev/4.0.x label Jan 14, 2026

fix

20f139e

sollhui approved these changes Jan 14, 2026

View reviewed changes

fix

ca10b71

CalvinKirs approved these changes Jan 14, 2026

View reviewed changes

github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 14, 2026

github-actions bot added the reviewed label Jan 14, 2026

JNSimba merged commit 7ccdbc1 into apache:master Jan 14, 2026
26 checks passed

github-actions bot mentioned this pull request Jan 14, 2026

branch-4.0: [Fix](Streamingjob) fix streaming job auto resume clear error #59868 #59894

Merged

yiguolei pushed a commit that referenced this pull request Jan 15, 2026

branch-4.0: [Fix](Streamingjob) fix streaming job auto resume clear e…

53749ed

…rror #59868 (#59894) Cherry-picked from #59868 Co-authored-by: wudi <wudi@selectdb.com>

yiguolei added dev/4.0.3-merged and removed dev/4.0.x labels Jan 15, 2026

[Fix](Streamingjob) fix streaming job auto resume clear error #59868

[Fix](Streamingjob) fix streaming job auto resume clear error #59868

Uh oh!

Conversation

JNSimba commented Jan 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

hello-stephen commented Jan 14, 2026

Uh oh!

JNSimba commented Jan 14, 2026

Uh oh!

doris-robot commented Jan 14, 2026

Uh oh!

JNSimba commented Jan 14, 2026

Uh oh!

sollhui left a comment

Choose a reason for hiding this comment

Uh oh!

JNSimba commented Jan 14, 2026

Uh oh!

doris-robot commented Jan 14, 2026

Uh oh!

doris-robot commented Jan 14, 2026

Uh oh!

doris-robot commented Jan 14, 2026

Uh oh!

JNSimba commented Jan 14, 2026

Uh oh!

github-actions bot commented Jan 14, 2026

Uh oh!

github-actions bot commented Jan 14, 2026

Uh oh!

JNSimba commented Jan 14, 2026

Uh oh!

JNSimba commented Jan 14, 2026

Uh oh!

JNSimba commented Jan 14, 2026

Uh oh!

JNSimba commented Jan 14, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

JNSimba commented Jan 14, 2026 •

edited

Loading