Skip to content

Conversation

@cambyzju
Copy link
Contributor

@cambyzju cambyzju commented Jul 29, 2025

What problem does this PR solve?

audit loader thread hang, and there are no new audit log in table __internal_schema.audit_log

"audit loader thread" #59 prio=5 os_prio=0 cpu=19288.63ms elapsed=714273.53s tid=0x00007f7edaf559d0 nid=0x302e1e runnable  [0x00007f7e9c3fe000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.SocketDispatcher.read0(java.base@17.0.13/Native Method)
        at sun.nio.ch.SocketDispatcher.read(java.base@17.0.13/SocketDispatcher.java:47)
        at sun.nio.ch.NioSocketImpl.tryRead(java.base@17.0.13/NioSocketImpl.java:266)
        at sun.nio.ch.NioSocketImpl.implRead(java.base@17.0.13/NioSocketImpl.java:317)
        at sun.nio.ch.NioSocketImpl.read(java.base@17.0.13/NioSocketImpl.java:355)
        at sun.nio.ch.NioSocketImpl$1.read(java.base@17.0.13/NioSocketImpl.java:808)
        at java.net.Socket$SocketInputStream.read(java.base@17.0.13/Socket.java:985)
        at java.io.BufferedInputStream.fill(java.base@17.0.13/BufferedInputStream.java:244)
        at java.io.BufferedInputStream.read1(java.base@17.0.13/BufferedInputStream.java:284)
        at java.io.BufferedInputStream.read(java.base@17.0.13/BufferedInputStream.java:343)
        - locked <0x00000005dbc6ecf8> (a java.io.BufferedInputStream)
        at sun.net.www.http.HttpClient.parseHTTPHeader(java.base@17.0.13/HttpClient.java:826)
        at sun.net.www.http.HttpClient.parseHTTP(java.base@17.0.13/HttpClient.java:761)
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(java.base@17.0.13/HttpURLConnection.java:1724)
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(java.base@17.0.13/HttpURLConnection.java:1625)
        at java.net.HttpURLConnection.getResponseCode(java.base@17.0.13/HttpURLConnection.java:529)
        at org.apache.doris.plugin.audit.AuditStreamLoader.loadBatch(AuditStreamLoader.java:138)
        at org.apache.doris.plugin.audit.AuditLoader.loadIfNecessary(AuditLoader.java:196)
        - locked <0x00000005c6182238> (a org.apache.doris.plugin.audit.AuditLoader)
        at org.apache.doris.plugin.audit.AuditLoader$LoadWorker.run(AuditLoader.java:234)
        at java.lang.Thread.run(java.base@17.0.13/Thread.java:840)

Also modify the label of audit log load, use true FE ip to avoid conflict between FEs

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Jul 29, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@cambyzju
Copy link
Contributor Author

run buildall

@cambyzju
Copy link
Contributor Author

run performance

@doris-robot
Copy link

TPC-H: Total hot run time: 34090 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 320b23fa4f029071c7e01de7ee560be09c496226, data reload: false

------ Round 1 ----------------------------------
q1	17591	5642	5588	5588
q2	1945	277	179	179
q3	10315	1381	688	688
q4	10218	964	528	528
q5	7525	2205	2355	2205
q6	170	165	130	130
q7	874	798	618	618
q8	9310	1304	1078	1078
q9	6875	5094	5124	5094
q10	6879	2375	1979	1979
q11	465	296	267	267
q12	349	359	251	251
q13	17769	3461	2981	2981
q14	241	233	233	233
q15	525	471	469	469
q16	413	414	368	368
q17	562	819	347	347
q18	7135	6974	6944	6944
q19	889	983	535	535
q20	312	316	208	208
q21	3345	3031	2395	2395
q22	1022	1061	1005	1005
Total cold run time: 104729 ms
Total hot run time: 34090 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5770	5762	5818	5762
q2	231	309	218	218
q3	2072	2558	2222	2222
q4	1309	1707	1254	1254
q5	4088	4565	4492	4492
q6	216	176	133	133
q7	1980	1918	1849	1849
q8	2500	2434	2539	2434
q9	7652	7288	7446	7288
q10	3237	3252	2890	2890
q11	594	565	657	565
q12	690	799	634	634
q13	3429	3735	3154	3154
q14	328	404	285	285
q15	507	459	445	445
q16	464	528	454	454
q17	1219	1530	1392	1392
q18	9149	8021	7543	7543
q19	10922	1149	1199	1149
q20	2066	2028	1889	1889
q21	10200	4288	4262	4262
q22	1049	1011	1004	1004
Total cold run time: 69672 ms
Total hot run time: 51318 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 174200 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 320b23fa4f029071c7e01de7ee560be09c496226, data reload: false

============================================
query1	1036	413	415	413
query2	6526	1738	1680	1680
query3	6743	230	226	226
query4	27777	23184	23298	23184
query5	4356	620	526	526
query6	317	239	239	239
query7	4632	513	294	294
query8	278	230	218	218
query9	8605	3201	3206	3201
query10	459	329	311	311
query11	15465	15166	15146	15146
query12	190	138	127	127
query13	1662	558	433	433
query14	9734	7776	7883	7776
query15	271	202	175	175
query16	8039	655	486	486
query17	1675	825	645	645
query18	2095	464	323	323
query19	310	221	193	193
query20	154	141	139	139
query21	228	129	111	111
query22	3872	3951	3814	3814
query23	34688	34251	34324	34251
query24	8167	2388	2427	2388
query25	635	497	437	437
query26	892	289	159	159
query27	2626	489	348	348
query28	4296	2314	2292	2292
query29	689	605	481	481
query30	297	228	207	207
query31	909	795	701	701
query32	90	76	77	76
query33	550	419	428	419
query34	796	839	518	518
query35	801	819	751	751
query36	1036	1053	934	934
query37	137	107	92	92
query38	3980	4019	3945	3945
query39	1464	1446	1372	1372
query40	243	144	131	131
query41	64	60	56	56
query42	144	121	127	121
query43	497	497	476	476
query44	1419	893	889	889
query45	206	188	181	181
query46	948	1058	667	667
query47	1780	1838	1754	1754
query48	407	424	306	306
query49	685	507	424	424
query50	666	707	406	406
query51	5533	5489	5444	5444
query52	129	129	116	116
query53	262	292	212	212
query54	653	648	572	572
query55	89	93	89	89
query56	364	357	374	357
query57	1176	1205	1137	1137
query58	341	356	339	339
query59	2582	2642	2500	2500
query60	409	390	391	390
query61	123	118	127	118
query62	844	724	648	648
query63	253	212	221	212
query64	3589	1086	799	799
query65	4133	4139	4102	4102
query66	1012	472	343	343
query67	query68	18386	879	602	602
query69	1009	313	301	301
query70	1405	1086	1158	1086
query71	679	365	326	326
query72	9099	2255	2361	2255
query73	3927	629	356	356
query74	9056	9003	8957	8957
query75	7622	3144	2680	2680
query76	8456	1210	786	786
query77	1173	413	360	360
query78	9452	10553	9363	9363
query79	15029	617	579	579
query80	1169	567	494	494
query81	538	277	228	228
query82	605	149	116	116
query83	298	288	273	273
query84	305	98	82	82
query85	911	373	326	326
query86	347	339	295	295
query87	4320	4299	4259	4259
query88	5565	2271	2255	2255
query89	493	390	315	315
query90	2532	230	225	225
query91	143	149	110	110
query92	86	71	67	67
query93	6419	990	670	670
query94	1077	400	277	277
query95	423	340	323	323
query96	512	579	278	278
query97	2687	2706	2630	2630
query98	250	241	228	228
query99	1529	1476	1278	1278
Total cold run time: 310530 ms
Total hot run time: 174200 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.84 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 320b23fa4f029071c7e01de7ee560be09c496226, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.05	0.04
query3	0.25	0.07	0.07
query4	1.62	0.10	0.11
query5	0.42	0.44	0.44
query6	1.17	0.66	0.68
query7	0.02	0.02	0.02
query8	0.05	0.04	0.03
query9	0.56	0.46	0.46
query10	0.52	0.53	0.52
query11	0.16	0.10	0.11
query12	0.14	0.11	0.11
query13	0.67	0.66	0.66
query14	0.95	1.08	1.19
query15	0.90	0.88	0.86
query16	0.41	0.40	0.39
query17	1.09	1.07	1.12
query18	0.21	0.21	0.21
query19	2.07	1.91	1.81
query20	0.01	0.01	0.01
query21	15.37	0.87	0.57
query22	0.75	1.08	0.62
query23	15.09	1.19	0.59
query24	6.79	1.57	0.56
query25	0.53	0.31	0.09
query26	0.62	0.16	0.13
query27	0.05	0.05	0.06
query28	9.64	0.89	0.46
query29	12.58	3.87	3.34
query30	3.04	2.99	3.06
query31	2.81	0.57	0.39
query32	3.24	0.57	0.50
query33	3.03	3.13	3.22
query34	16.18	5.42	4.92
query35	4.85	4.94	4.95
query36	0.70	0.52	0.50
query37	0.10	0.07	0.08
query38	0.06	0.05	0.05
query39	0.03	0.03	0.03
query40	0.17	0.15	0.14
query41	0.08	0.03	0.03
query42	0.04	0.03	0.03
query43	0.04	0.03	0.04
Total cold run time: 107.13 s
Total hot run time: 32.84 s

morningman
morningman previously approved these changes Jul 30, 2025
@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jul 30, 2025
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@morningman
Copy link
Contributor

run buildall

@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Jul 30, 2025
@doris-robot
Copy link

TPC-H: Total hot run time: 33643 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d1a58c4eb24a6a3e7e1bb86552df1ca181a501e3, data reload: false

------ Round 1 ----------------------------------
q1	17625	5905	5474	5474
q2	1935	279	185	185
q3	10318	1320	665	665
q4	10204	985	506	506
q5	7451	2340	2286	2286
q6	172	167	133	133
q7	911	768	610	610
q8	9323	1235	1034	1034
q9	6668	5157	4993	4993
q10	6884	2348	1975	1975
q11	475	275	266	266
q12	341	361	220	220
q13	17758	3435	2970	2970
q14	233	232	219	219
q15	522	456	465	456
q16	420	433	378	378
q17	541	820	345	345
q18	7305	7005	6864	6864
q19	1303	963	545	545
q20	325	317	216	216
q21	3316	3080	2323	2323
q22	1042	1041	980	980
Total cold run time: 105072 ms
Total hot run time: 33643 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5876	5933	5874	5874
q2	232	306	217	217
q3	2110	2534	2172	2172
q4	1296	1712	1284	1284
q5	4087	4370	4380	4370
q6	216	170	129	129
q7	1965	1934	1828	1828
q8	2510	2452	2377	2377
q9	7260	7408	7278	7278
q10	3130	3348	2871	2871
q11	530	524	504	504
q12	742	763	612	612
q13	3367	3737	3248	3248
q14	294	298	278	278
q15	495	447	455	447
q16	477	496	448	448
q17	1182	1410	1339	1339
q18	8219	7776	7592	7592
q19	12161	875	886	875
q20	2858	1964	1832	1832
q21	15007	4169	4209	4169
q22	1096	1070	998	998
Total cold run time: 75110 ms
Total hot run time: 50742 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 163041 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d1a58c4eb24a6a3e7e1bb86552df1ca181a501e3, data reload: false

reason	Doris	NULL	NULL	0	0	0	NULL	0	NULL	NULL	2023-12-26 22:43:56	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
============================================
query1	1026	387	396	387
query2	6529	1924	1680	1680
query3	6740	221	216	216
query4	27192	23602	23260	23260
query5	4689	661	530	530
query6	359	238	223	223
query7	4736	541	310	310
query8	288	228	217	217
query9	8588	3170	3185	3170
query10	464	348	310	310
query11	15414	15046	15349	15046
query12	187	142	132	132
query13	1681	558	451	451
query14	9351	7787	7756	7756
query15	224	197	169	169
query16	7239	663	490	490
query17	1226	765	640	640
query18	2004	448	343	343
query19	250	217	185	185
query20	157	145	143	143
query21	216	123	110	110
query22	3957	3898	3923	3898
query23	34319	34144	34029	34029
query24	7589	2466	2418	2418
query25	524	510	432	432
query26	724	292	163	163
query27	2328	500	356	356
query28	2964	2283	2272	2272
query29	674	651	481	481
query30	288	232	198	198
query31	884	799	745	745
query32	84	77	77	77
query33	559	408	393	393
query34	814	838	530	530
query35	799	845	753	753
query36	1015	1048	965	965
query37	130	110	93	93
query38	4012	3974	4019	3974
query39	1455	1375	1367	1367
query40	247	147	127	127
query41	64	60	55	55
query42	138	126	132	126
query43	516	519	468	468
query44	1397	873	867	867
query45	200	185	187	185
query46	939	1086	687	687
query47	1807	1831	1767	1767
query48	423	431	312	312
query49	687	524	414	414
query50	666	713	415	415
query51	4211	4184	4157	4157
query52	127	136	119	119
query53	265	293	203	203
query54	658	652	554	554
query55	90	89	85	85
query56	360	364	368	364
query57	1173	1211	1142	1142
query58	333	331	336	331
query59	2514	2571	2503	2503
query60	408	394	379	379
query61	132	121	122	121
query62	781	753	651	651
query63	257	218	220	218
query64	2438	1090	831	831
query65	4257	4092	4168	4092
query66	1015	436	336	336
query67	query68	17533	877	965	877
query69	1010	284	298	284
query70	1301	1105	1080	1080
query71	697	319	330	319
query72	9161	2381	2227	2227
query73	3409	683	364	364
query74	9031	8965	8466	8466
query75	7692	3131	2682	2682
query76	8928	1244	838	838
query77	1153	415	328	328
query78	9642	query79	16551	611	578	578
query80	2364	571	487	487
query81	550	262	237	237
query82	509	154	120	120
query83	362	276	268	268
query84	306	97	81	81
query85	1441	398	330	330
query86	366	300	314	300
query87	4341	4259	4134	4134
query88	5457	2241	2218	2218
query89	517	369	327	327
query90	2512	237	239	237
query91	141	145	109	109
query92	86	73	69	69
query93	6845	1037	662	662
query94	1161	449	278	278
query95	434	328	320	320
query96	506	595	282	282
query97	2658	2704	2635	2635
query98	237	228	236	228
query99	1475	1348	1255	1255
Total cold run time: 296516 ms
Total hot run time: 163041 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.48 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d1a58c4eb24a6a3e7e1bb86552df1ca181a501e3, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.25	0.07	0.07
query4	1.62	0.10	0.10
query5	0.43	0.41	0.42
query6	1.18	0.66	0.65
query7	0.02	0.02	0.02
query8	0.05	0.04	0.04
query9	0.55	0.48	0.47
query10	0.52	0.52	0.53
query11	0.16	0.10	0.10
query12	0.14	0.11	0.12
query13	0.64	0.65	0.63
query14	0.95	1.04	1.11
query15	0.95	0.89	0.90
query16	0.40	0.38	0.38
query17	1.00	1.02	1.09
query18	0.21	0.20	0.20
query19	1.88	1.87	1.80
query20	0.02	0.01	0.01
query21	15.42	0.87	0.59
query22	0.78	1.30	0.89
query23	14.76	1.14	0.64
query24	6.44	1.07	2.40
query25	0.55	0.16	0.13
query26	0.56	0.16	0.14
query27	0.06	0.06	0.05
query28	10.16	0.82	0.46
query29	12.63	3.85	3.32
query30	3.11	3.00	2.94
query31	2.81	0.57	0.40
query32	3.23	0.56	0.48
query33	3.00	3.16	3.17
query34	16.14	5.27	4.88
query35	4.83	4.96	4.99
query36	0.70	0.51	0.49
query37	0.10	0.08	0.07
query38	0.06	0.05	0.04
query39	0.04	0.03	0.04
query40	0.18	0.14	0.13
query41	0.08	0.02	0.02
query42	0.04	0.03	0.02
query43	0.04	0.04	0.03
Total cold run time: 106.81 s
Total hot run time: 33.48 s

@morningman morningman changed the title [fix](audit) fix audit loader thread hang [fix](audit) fix audit loader thread hang and label already exists issue Jul 31, 2025
@morningman morningman added the usercase Important user case type label label Jul 31, 2025
@cambyzju
Copy link
Contributor Author

run fe_ut

@cambyzju
Copy link
Contributor Author

run fe ut

@cambyzju
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34115 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d1a58c4eb24a6a3e7e1bb86552df1ca181a501e3, data reload: false

------ Round 1 ----------------------------------
q1	17613	5725	5641	5641
q2	1925	304	186	186
q3	10304	1458	713	713
q4	10241	975	522	522
q5	7517	2337	2257	2257
q6	182	166	133	133
q7	869	756	632	632
q8	9307	1277	1097	1097
q9	6621	5045	5047	5045
q10	6903	2354	1978	1978
q11	451	278	266	266
q12	345	358	224	224
q13	17779	3435	3007	3007
q14	243	233	227	227
q15	550	468	462	462
q16	409	436	372	372
q17	566	824	348	348
q18	7356	7003	6929	6929
q19	2326	973	541	541
q20	330	317	222	222
q21	3340	3058	2294	2294
q22	1037	1042	1019	1019
Total cold run time: 106214 ms
Total hot run time: 34115 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5954	5807	6073	5807
q2	238	309	217	217
q3	2060	2554	2190	2190
q4	1290	1714	1314	1314
q5	4229	4396	4462	4396
q6	220	180	135	135
q7	1892	2240	1910	1910
q8	2559	2398	2409	2398
q9	7298	7201	7188	7188
q10	3194	3459	2828	2828
q11	595	515	475	475
q12	751	793	609	609
q13	3348	3763	3207	3207
q14	316	299	284	284
q15	493	452	468	452
q16	614	497	435	435
q17	1139	1512	1382	1382
q18	7750	7673	7710	7673
q19	12849	935	958	935
q20	2980	2055	1776	1776
q21	14830	4293	4245	4245
q22	1090	1020	1015	1015
Total cold run time: 75689 ms
Total hot run time: 50871 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 172496 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d1a58c4eb24a6a3e7e1bb86552df1ca181a501e3, data reload: false

============================================
query1	1020	385	447	385
query2	6557	1765	1707	1707
query3	6742	224	218	218
query4	27376	23766	23160	23160
query5	4397	635	548	548
query6	331	247	239	239
query7	4638	530	294	294
query8	277	254	230	230
query9	8611	3160	3120	3120
query10	505	338	313	313
query11	15683	15189	15069	15069
query12	187	138	136	136
query13	1678	574	434	434
query14	10195	7806	7780	7780
query15	210	195	172	172
query16	7118	640	459	459
query17	1102	748	633	633
query18	1968	441	309	309
query19	215	224	187	187
query20	154	145	136	136
query21	216	128	104	104
query22	3883	4168	3759	3759
query23	34084	34240	34167	34167
query24	5328	2412	2420	2412
query25	492	516	427	427
query26	718	289	157	157
query27	2258	498	349	349
query28	3019	2319	2328	2319
query29	617	615	491	491
query30	290	251	198	198
query31	826	812	714	714
query32	93	77	75	75
query33	452	414	366	366
query34	810	864	515	515
query35	826	846	803	803
query36	1026	1061	954	954
query37	127	113	93	93
query38	3982	4031	3926	3926
query39	1444	1393	1514	1393
query40	250	147	134	134
query41	60	59	55	55
query42	136	124	128	124
query43	535	531	486	486
query44	1439	874	876	874
query45	191	192	199	192
query46	934	1062	664	664
query47	1795	1904	1722	1722
query48	407	438	330	330
query49	681	516	410	410
query50	678	684	422	422
query51	4155	4128	4188	4128
query52	128	137	120	120
query53	268	291	229	229
query54	662	645	556	556
query55	92	88	87	87
query56	357	362	359	359
query57	1195	1233	1139	1139
query58	337	333	335	333
query59	2622	2657	2566	2566
query60	400	412	410	410
query61	122	141	120	120
query62	763	725	642	642
query63	257	210	220	210
query64	2387	1195	898	898
query65	4164	4095	4124	4095
query66	1065	455	329	329
query67	query68	17218	911	953	911
query69	1041	268	300	268
query70	1442	1125	1122	1122
query71	712	326	329	326
query72	9236	2258	2161	2161
query73	3286	707	359	359
query74	9153	8936	8851	8851
query75	7587	3124	2642	2642
query76	8843	1236	794	794
query77	1114	417	325	325
query78	9491	10096	9050	9050
query79	15034	669	588	588
query80	2843	624	497	497
query81	601	276	240	240
query82	508	146	113	113
query83	427	288	281	281
query84	293	100	89	89
query85	1118	370	403	370
query86	373	341	292	292
query87	4253	4209	4199	4199
query88	5476	2232	2235	2232
query89	503	383	312	312
query90	2543	230	224	224
query91	140	140	111	111
query92	97	70	68	68
query93	6236	991	677	677
query94	1037	394	270	270
query95	411	335	323	323
query96	513	592	286	286
query97	2684	2689	2613	2613
query98	272	225	223	223
query99	1458	1356	1294	1294
Total cold run time: 301478 ms
Total hot run time: 172496 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.67 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d1a58c4eb24a6a3e7e1bb86552df1ca181a501e3, data reload: false

query1	0.04	0.04	0.04
query2	0.07	0.04	0.04
query3	0.25	0.07	0.07
query4	1.67	0.12	0.11
query5	0.44	0.40	0.42
query6	1.16	0.68	0.67
query7	0.03	0.02	0.02
query8	0.06	0.04	0.04
query9	0.56	0.46	0.48
query10	0.54	0.54	0.53
query11	0.15	0.10	0.10
query12	0.14	0.11	0.11
query13	0.64	0.65	0.62
query14	0.99	1.03	1.16
query15	0.93	0.90	0.91
query16	0.39	0.40	0.39
query17	1.08	1.06	1.09
query18	0.23	0.21	0.20
query19	2.01	1.93	2.00
query20	0.02	0.01	0.02
query21	15.35	0.87	0.55
query22	0.77	1.24	0.80
query23	14.80	1.15	0.61
query24	7.04	0.99	0.83
query25	0.54	0.26	0.11
query26	0.60	0.15	0.13
query27	0.06	0.06	0.06
query28	10.09	0.84	0.45
query29	12.69	3.81	3.35
query30	3.04	2.96	3.01
query31	2.82	0.57	0.39
query32	3.24	0.57	0.50
query33	3.04	3.29	3.29
query34	16.12	5.53	5.03
query35	5.01	5.04	5.02
query36	0.72	0.52	0.50
query37	0.10	0.07	0.07
query38	0.06	0.05	0.05
query39	0.04	0.03	0.03
query40	0.18	0.14	0.13
query41	0.08	0.03	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.04
Total cold run time: 107.86 s
Total hot run time: 33.67 s

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage 33.33% (1/3) 🎉
Increment coverage report
Complete coverage report

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jul 31, 2025
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@cambyzju
Copy link
Contributor Author

run cloud_p0

@morningman morningman merged commit 5254772 into apache:master Jul 31, 2025
31 of 32 checks passed
github-actions bot pushed a commit that referenced this pull request Jul 31, 2025
…sue (#54031)

### What problem does this PR solve?

audit loader thread hang, and there are no new audit log in table
__internal_schema.audit_log

```
"audit loader thread" #59 prio=5 os_prio=0 cpu=19288.63ms elapsed=714273.53s tid=0x00007f7edaf559d0 nid=0x302e1e runnable  [0x00007f7e9c3fe000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.SocketDispatcher.read0(java.base@17.0.13/Native Method)
        at sun.nio.ch.SocketDispatcher.read(java.base@17.0.13/SocketDispatcher.java:47)
        at sun.nio.ch.NioSocketImpl.tryRead(java.base@17.0.13/NioSocketImpl.java:266)
        at sun.nio.ch.NioSocketImpl.implRead(java.base@17.0.13/NioSocketImpl.java:317)
        at sun.nio.ch.NioSocketImpl.read(java.base@17.0.13/NioSocketImpl.java:355)
        at sun.nio.ch.NioSocketImpl$1.read(java.base@17.0.13/NioSocketImpl.java:808)
        at java.net.Socket$SocketInputStream.read(java.base@17.0.13/Socket.java:985)
        at java.io.BufferedInputStream.fill(java.base@17.0.13/BufferedInputStream.java:244)
        at java.io.BufferedInputStream.read1(java.base@17.0.13/BufferedInputStream.java:284)
        at java.io.BufferedInputStream.read(java.base@17.0.13/BufferedInputStream.java:343)
        - locked <0x00000005dbc6ecf8> (a java.io.BufferedInputStream)
        at sun.net.www.http.HttpClient.parseHTTPHeader(java.base@17.0.13/HttpClient.java:826)
        at sun.net.www.http.HttpClient.parseHTTP(java.base@17.0.13/HttpClient.java:761)
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(java.base@17.0.13/HttpURLConnection.java:1724)
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(java.base@17.0.13/HttpURLConnection.java:1625)
        at java.net.HttpURLConnection.getResponseCode(java.base@17.0.13/HttpURLConnection.java:529)
        at org.apache.doris.plugin.audit.AuditStreamLoader.loadBatch(AuditStreamLoader.java:138)
        at org.apache.doris.plugin.audit.AuditLoader.loadIfNecessary(AuditLoader.java:196)
        - locked <0x00000005c6182238> (a org.apache.doris.plugin.audit.AuditLoader)
        at org.apache.doris.plugin.audit.AuditLoader$LoadWorker.run(AuditLoader.java:234)
        at java.lang.Thread.run(java.base@17.0.13/Thread.java:840)
```

Also modify the label of audit log load, use true FE ip to avoid
conflict between FEs
github-actions bot pushed a commit that referenced this pull request Jul 31, 2025
…sue (#54031)

### What problem does this PR solve?

audit loader thread hang, and there are no new audit log in table
__internal_schema.audit_log

```
"audit loader thread" #59 prio=5 os_prio=0 cpu=19288.63ms elapsed=714273.53s tid=0x00007f7edaf559d0 nid=0x302e1e runnable  [0x00007f7e9c3fe000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.SocketDispatcher.read0(java.base@17.0.13/Native Method)
        at sun.nio.ch.SocketDispatcher.read(java.base@17.0.13/SocketDispatcher.java:47)
        at sun.nio.ch.NioSocketImpl.tryRead(java.base@17.0.13/NioSocketImpl.java:266)
        at sun.nio.ch.NioSocketImpl.implRead(java.base@17.0.13/NioSocketImpl.java:317)
        at sun.nio.ch.NioSocketImpl.read(java.base@17.0.13/NioSocketImpl.java:355)
        at sun.nio.ch.NioSocketImpl$1.read(java.base@17.0.13/NioSocketImpl.java:808)
        at java.net.Socket$SocketInputStream.read(java.base@17.0.13/Socket.java:985)
        at java.io.BufferedInputStream.fill(java.base@17.0.13/BufferedInputStream.java:244)
        at java.io.BufferedInputStream.read1(java.base@17.0.13/BufferedInputStream.java:284)
        at java.io.BufferedInputStream.read(java.base@17.0.13/BufferedInputStream.java:343)
        - locked <0x00000005dbc6ecf8> (a java.io.BufferedInputStream)
        at sun.net.www.http.HttpClient.parseHTTPHeader(java.base@17.0.13/HttpClient.java:826)
        at sun.net.www.http.HttpClient.parseHTTP(java.base@17.0.13/HttpClient.java:761)
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(java.base@17.0.13/HttpURLConnection.java:1724)
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(java.base@17.0.13/HttpURLConnection.java:1625)
        at java.net.HttpURLConnection.getResponseCode(java.base@17.0.13/HttpURLConnection.java:529)
        at org.apache.doris.plugin.audit.AuditStreamLoader.loadBatch(AuditStreamLoader.java:138)
        at org.apache.doris.plugin.audit.AuditLoader.loadIfNecessary(AuditLoader.java:196)
        - locked <0x00000005c6182238> (a org.apache.doris.plugin.audit.AuditLoader)
        at org.apache.doris.plugin.audit.AuditLoader$LoadWorker.run(AuditLoader.java:234)
        at java.lang.Thread.run(java.base@17.0.13/Thread.java:840)
```

Also modify the label of audit log load, use true FE ip to avoid
conflict between FEs
github-actions bot pushed a commit that referenced this pull request Jul 31, 2025
…sue (#54031)

### What problem does this PR solve?

audit loader thread hang, and there are no new audit log in table
__internal_schema.audit_log

```
"audit loader thread" #59 prio=5 os_prio=0 cpu=19288.63ms elapsed=714273.53s tid=0x00007f7edaf559d0 nid=0x302e1e runnable  [0x00007f7e9c3fe000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.SocketDispatcher.read0(java.base@17.0.13/Native Method)
        at sun.nio.ch.SocketDispatcher.read(java.base@17.0.13/SocketDispatcher.java:47)
        at sun.nio.ch.NioSocketImpl.tryRead(java.base@17.0.13/NioSocketImpl.java:266)
        at sun.nio.ch.NioSocketImpl.implRead(java.base@17.0.13/NioSocketImpl.java:317)
        at sun.nio.ch.NioSocketImpl.read(java.base@17.0.13/NioSocketImpl.java:355)
        at sun.nio.ch.NioSocketImpl$1.read(java.base@17.0.13/NioSocketImpl.java:808)
        at java.net.Socket$SocketInputStream.read(java.base@17.0.13/Socket.java:985)
        at java.io.BufferedInputStream.fill(java.base@17.0.13/BufferedInputStream.java:244)
        at java.io.BufferedInputStream.read1(java.base@17.0.13/BufferedInputStream.java:284)
        at java.io.BufferedInputStream.read(java.base@17.0.13/BufferedInputStream.java:343)
        - locked <0x00000005dbc6ecf8> (a java.io.BufferedInputStream)
        at sun.net.www.http.HttpClient.parseHTTPHeader(java.base@17.0.13/HttpClient.java:826)
        at sun.net.www.http.HttpClient.parseHTTP(java.base@17.0.13/HttpClient.java:761)
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(java.base@17.0.13/HttpURLConnection.java:1724)
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(java.base@17.0.13/HttpURLConnection.java:1625)
        at java.net.HttpURLConnection.getResponseCode(java.base@17.0.13/HttpURLConnection.java:529)
        at org.apache.doris.plugin.audit.AuditStreamLoader.loadBatch(AuditStreamLoader.java:138)
        at org.apache.doris.plugin.audit.AuditLoader.loadIfNecessary(AuditLoader.java:196)
        - locked <0x00000005c6182238> (a org.apache.doris.plugin.audit.AuditLoader)
        at org.apache.doris.plugin.audit.AuditLoader$LoadWorker.run(AuditLoader.java:234)
        at java.lang.Thread.run(java.base@17.0.13/Thread.java:840)
```

Also modify the label of audit log load, use true FE ip to avoid
conflict between FEs
yiguolei pushed a commit that referenced this pull request Aug 1, 2025
…dy exists issue #54031 (#54169)

Cherry-picked from #54031

Co-authored-by: camby <104178625@qq.com>
morrySnow pushed a commit that referenced this pull request Aug 1, 2025
…dy exists issue #54031 (#54170)

Cherry-picked from #54031

Co-authored-by: camby <104178625@qq.com>
dataroaring pushed a commit that referenced this pull request Aug 1, 2025
…dy exists issue #54031 (#54168)

Cherry-picked from #54031

Co-authored-by: camby <104178625@qq.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.11-merged dev/3.0.7-merged dev/3.1.0-merged reviewed usercase Important user case type label

Projects

None yet

Development

Successfully merging this pull request may close these issues.

9 participants