[metrics](warmup) add some metrics for warmup jobs #52991

[kaijchen]

pick #52991

What problem does this PR solve?

Add the following metrics:

• file_cache_once_or_periodic_warm_up_submitted_tablet_num
• file_cache_once_or_periodic_warm_up_finished_tablet_num

Fix the following metrics:

• file_cache_once_or_periodic_warm_up_finished_segment_num
• file_cache_once_or_periodic_warm_up_finished_segment_size
• file_cache_once_or_periodic_warm_up_finished_index_num
• file_cache_once_or_periodic_warm_up_finished_index_size

Release note

None

Check List (For Author)

• Test

  • Regression test
  • Unit Test
  • Manual test (add detailed scripts or steps below)
  • No need to test or manual test. Explain why:
    • This is a refactor/code format and no logic has been changed.
    • Previous test can cover this change.
    • No code files have been changed.
    • Other reason

• Behavior changed:

  • No.
  • Yes.

• Does this need documentation?

  • No.
  • Yes.

Check List (For Reviewer who merge this PR)

• Confirm the release note
• Confirm test cases
• Confirm document
• Add branch pick label

[hello-stephen]

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
3. What features were added. Why was this function added?
4. Which code was refactored and why was this part of the code refactored?
5. Which functions were optimized and what is the difference before and after the optimization?

[kaijchen]

run buildall

[doris-robot]

BE UT Coverage Report

Increment line coverage 0.00% (0/16) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	45.13% (12408/27492)
Line Coverage	36.06% (109740/304299)
Region Coverage	35.21% (56984/161836)
Branch Coverage	32.30% (30886/95616)

[morrySnow]

run buildall

[hello-stephen]

BE UT Coverage Report

Increment line coverage 0.00% (0/16) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	45.12% (12405/27492)
Line Coverage	36.07% (109741/304280)
Region Coverage	35.21% (56977/161831)
Branch Coverage	32.30% (30886/95612)

[morrySnow]

run buildall

[doris-robot]

TPC-H: Total hot run time: 39732 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ebfe6967a575968c9aa534a48ba95ba6b854e186, data reload: false

------ Round 1 ----------------------------------
q1	17594	6723	6875	6723
q2	2052	180	187	180
q3	10518	1137	1192	1137
q4	10225	747	768	747
q5	7730	2858	2781	2781
q6	212	135	133	133
q7	999	616	604	604
q8	9340	1954	1973	1954
q9	6637	6361	6347	6347
q10	7052	2257	2302	2257
q11	461	269	265	265
q12	412	221	219	219
q13	17792	2974	3010	2974
q14	258	207	219	207
q15	518	465	476	465
q16	482	381	369	369
q17	968	538	645	538
q18	7235	6747	6645	6645
q19	1323	1018	990	990
q20	478	197	195	195
q21	3942	3073	3017	3017
q22	1108	988	985	985
Total cold run time: 107336 ms
Total hot run time: 39732 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6705	6628	6592	6592
q2	323	231	234	231
q3	2900	2862	2862	2862
q4	2076	1904	1981	1904
q5	5801	5787	5822	5787
q6	213	129	134	129
q7	2320	1786	1848	1786
q8	3393	3549	3621	3549
q9	8877	9068	8957	8957
q10	3605	3563	3550	3550
q11	597	489	504	489
q12	823	684	626	626
q13	8705	3243	3179	3179
q14	294	276	271	271
q15	505	483	484	483
q16	507	441	440	440
q17	1838	1640	1592	1592
q18	8202	7741	7757	7741
q19	1701	1515	1539	1515
q20	2066	1813	1834	1813
q21	5239	5063	4969	4969
q22	1158	1046	1042	1042
Total cold run time: 67848 ms
Total hot run time: 59507 ms

[hello-stephen]

BE UT Coverage Report

Increment line coverage 0.00% (0/16) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	45.23% (12462/27555)
Line Coverage	36.18% (110428/305244)
Region Coverage	35.33% (57287/162164)
Branch Coverage	32.42% (31067/95838)

[doris-robot]

TPC-DS: Total hot run time: 197602 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ebfe6967a575968c9aa534a48ba95ba6b854e186, data reload: false

query1	1277	917	908	908
query2	6259	1953	1871	1871
query3	10969	4368	4461	4368
query4	33283	23495	23491	23491
query5	3450	455	453	453
query6	271	180	183	180
query7	3996	324	325	324
query8	286	230	226	226
query9	9537	2587	2588	2587
query10	477	258	267	258
query11	17998	15182	15570	15182
query12	158	102	102	102
query13	1550	434	415	415
query14	9282	7509	7678	7509
query15	258	190	197	190
query16	7849	452	447	447
query17	1695	629	617	617
query18	2094	317	318	317
query19	392	173	174	173
query20	126	119	116	116
query21	204	119	105	105
query22	4738	4409	4321	4321
query23	34844	34077	34127	34077
query24	11492	2995	2974	2974
query25	671	431	438	431
query26	1246	178	178	178
query27	2286	352	371	352
query28	7137	2193	2189	2189
query29	832	455	472	455
query30	275	164	160	160
query31	1066	860	800	800
query32	88	56	58	56
query33	752	293	295	293
query34	916	516	532	516
query35	857	724	748	724
query36	1108	958	943	943
query37	129	67	73	67
query38	4119	3972	3959	3959
query39	1491	1499	1475	1475
query40	195	107	105	105
query41	50	47	52	47
query42	119	107	112	107
query43	529	471	488	471
query44	1348	833	827	827
query45	185	169	168	168
query46	1171	734	742	734
query47	2050	1924	1883	1883
query48	438	347	351	347
query49	990	425	386	386
query50	826	443	432	432
query51	7447	7258	7262	7258
query52	103	91	89	89
query53	255	183	189	183
query54	1256	475	487	475
query55	83	83	79	79
query56	286	244	257	244
query57	1312	1215	1219	1215
query58	225	213	209	209
query59	3180	3067	3063	3063
query60	296	281	266	266
query61	133	132	107	107
query62	859	702	702	702
query63	231	204	192	192
query64	4022	701	651	651
query65	3353	3272	3296	3272
query66	774	301	311	301
query67	16080	15644	15528	15528
query68	4617	581	585	581
query69	445	290	293	290
query70	1182	1086	1121	1086
query71	353	264	273	264
query72	6291	4053	4001	4001
query73	762	350	360	350
query74	10468	8975	9352	8975
query75	3406	2611	2696	2611
query76	2601	1122	1090	1090
query77	391	277	268	268
query78	10625	9594	9557	9557
query79	2479	604	622	604
query80	1219	415	430	415
query81	547	220	220	220
query82	826	99	93	93
query83	236	143	142	142
query84	233	81	84	81
query85	1401	298	292	292
query86	440	290	301	290
query87	4419	4228	4186	4186
query88	4401	2410	2387	2387
query89	417	292	297	292
query90	1946	189	191	189
query91	141	108	106	106
query92	63	50	51	50
query93	2274	552	565	552
query94	792	301	296	296
query95	357	265	260	260
query96	619	282	277	277
query97	3280	3147	3207	3147
query98	228	217	197	197
query99	1555	1303	1339	1303
Total cold run time: 302268 ms
Total hot run time: 197602 ms

[doris-robot]

TPC-H: Total hot run time: 39693 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ebfe6967a575968c9aa534a48ba95ba6b854e186, data reload: false

------ Round 1 ----------------------------------
q1	17595	6849	6676	6676
q2	2078	183	165	165
q3	10609	1145	1181	1145
q4	10376	701	702	701
q5	7764	2875	2747	2747
q6	219	138	136	136
q7	970	612	619	612
q8	9351	1956	1996	1956
q9	6690	6445	6454	6445
q10	7061	2259	2296	2259
q11	476	260	253	253
q12	395	207	205	205
q13	17799	2990	2947	2947
q14	250	211	208	208
q15	516	464	459	459
q16	471	378	373	373
q17	994	544	580	544
q18	7553	6759	6556	6556
q19	1312	1036	1002	1002
q20	481	205	195	195
q21	4136	3123	3209	3123
q22	1088	986	995	986
Total cold run time: 108184 ms
Total hot run time: 39693 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6660	6639	6556	6556
q2	326	225	239	225
q3	2885	2916	2877	2877
q4	2054	1848	1766	1766
q5	5707	5691	5697	5691
q6	211	126	130	126
q7	2186	1768	1796	1768
q8	3388	3542	3526	3526
q9	8794	8911	8830	8830
q10	3558	3487	3505	3487
q11	596	486	485	485
q12	790	604	615	604
q13	6858	3186	3170	3170
q14	290	268	270	268
q15	508	466	461	461
q16	472	425	442	425
q17	1848	1632	1592	1592
q18	8390	7854	7652	7652
q19	1714	1554	1569	1554
q20	2083	1787	1821	1787
q21	5250	5175	5020	5020
q22	1168	1051	1043	1043
Total cold run time: 65736 ms
Total hot run time: 58913 ms

[doris-robot]

TPC-DS: Total hot run time: 196580 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ebfe6967a575968c9aa534a48ba95ba6b854e186, data reload: false

query1	1289	938	905	905
query2	6346	1999	1921	1921
query3	10904	4397	4317	4317
query4	32991	23302	23936	23302
query5	4324	449	453	449
query6	316	180	183	180
query7	3986	317	328	317
query8	288	226	230	226
query9	9333	2615	2617	2615
query10	482	261	256	256
query11	17948	15168	15269	15168
query12	154	98	101	98
query13	1557	432	434	432
query14	10083	7367	7169	7169
query15	256	181	192	181
query16	8069	541	489	489
query17	1629	598	595	595
query18	2154	328	318	318
query19	370	168	172	168
query20	129	118	115	115
query21	211	110	108	108
query22	4861	4622	4658	4622
query23	34731	34089	33796	33796
query24	11368	2928	2943	2928
query25	674	419	429	419
query26	1328	171	174	171
query27	2324	353	353	353
query28	7775	2203	2165	2165
query29	856	464	489	464
query30	263	157	160	157
query31	1064	819	826	819
query32	92	59	55	55
query33	763	292	314	292
query34	964	511	534	511
query35	856	746	728	728
query36	1114	945	939	939
query37	133	69	65	65
query38	4144	3978	3935	3935
query39	1524	1482	1458	1458
query40	209	102	103	102
query41	48	47	50	47
query42	115	103	100	100
query43	543	515	488	488
query44	1240	818	830	818
query45	187	168	171	168
query46	1193	736	719	719
query47	2042	1921	1938	1921
query48	432	341	358	341
query49	969	405	396	396
query50	861	449	432	432
query51	7417	7257	7155	7155
query52	98	92	91	91
query53	266	191	188	188
query54	1395	471	490	471
query55	83	81	77	77
query56	286	266	257	257
query57	1293	1206	1204	1204
query58	249	219	216	216
query59	3312	2999	3081	2999
query60	290	271	269	269
query61	128	117	113	113
query62	867	693	710	693
query63	226	196	192	192
query64	4070	682	636	636
query65	3364	3281	3260	3260
query66	747	298	302	298
query67	15960	15679	15482	15482
query68	4492	590	567	567
query69	435	271	274	271
query70	1182	1094	1126	1094
query71	336	260	257	257
query72	6297	4096	4041	4041
query73	779	352	350	350
query74	10316	8929	8914	8914
query75	3400	2634	2678	2634
query76	2712	1007	1074	1007
query77	399	285	259	259
query78	10665	9528	9499	9499
query79	1485	602	594	594
query80	1097	424	425	424
query81	545	222	224	222
query82	950	94	88	88
query83	244	143	144	143
query84	233	83	83	83
query85	1294	327	297	297
query86	364	290	276	276
query87	4354	4178	4255	4178
query88	3318	2422	2412	2412
query89	423	293	303	293
query90	1871	185	184	184
query91	136	111	110	110
query92	55	51	48	48
query93	1753	548	554	548
query94	784	286	281	281
query95	363	257	258	257
query96	605	284	289	284
query97	3276	3145	3245	3145
query98	210	197	193	193
query99	1541	1303	1288	1288
Total cold run time: 301457 ms
Total hot run time: 196580 ms

[doris-robot]

ClickBench: Total hot run time: 30.01 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ebfe6967a575968c9aa534a48ba95ba6b854e186, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.03	0.03
query3	0.24	0.06	0.06
query4	1.63	0.10	0.10
query5	0.54	0.52	0.49
query6	1.13	0.71	0.72
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.56	0.52	0.50
query10	0.55	0.56	0.53
query11	0.14	0.10	0.10
query12	0.13	0.11	0.11
query13	0.60	0.59	0.60
query14	0.78	0.78	0.81
query15	0.84	0.82	0.82
query16	0.42	0.38	0.38
query17	1.06	1.09	1.05
query18	0.24	0.23	0.22
query19	1.97	1.90	1.79
query20	0.01	0.01	0.01
query21	15.40	0.58	0.58
query22	2.50	1.63	1.59
query23	17.06	0.89	0.85
query24	2.93	0.97	0.99
query25	0.37	0.07	0.05
query26	0.50	0.14	0.13
query27	0.04	0.04	0.03
query28	10.57	0.51	0.47
query29	12.59	3.26	3.27
query30	0.25	0.06	0.06
query31	2.87	0.40	0.37
query32	3.22	0.46	0.46
query33	2.94	3.05	2.99
query34	16.99	4.52	4.52
query35	4.62	4.57	4.66
query36	0.67	0.47	0.48
query37	0.08	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.03
query40	0.17	0.12	0.12
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.04
Total cold run time: 104.99 s
Total hot run time: 30.01 s

[kaijchen]

run buildall

[hello-stephen]

BE UT Coverage Report

Increment line coverage 0.00% (0/20) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	45.23% (12467/27563)
Line Coverage	36.20% (110530/305341)
Region Coverage	35.34% (57313/162184)
Branch Coverage	32.43% (31082/95850)

[doris-robot]

TPC-H: Total hot run time: 39682 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit eaac1a6cf08343805f5405e1bad21860f87a3960, data reload: false

------ Round 1 ----------------------------------
q1	17593	6941	6572	6572
q2	2083	192	167	167
q3	10638	1131	1230	1131
q4	10448	774	751	751
q5	7742	2922	2824	2824
q6	207	132	132	132
q7	1003	614	611	611
q8	9353	1933	2017	1933
q9	6602	6432	6433	6432
q10	7035	2259	2298	2259
q11	467	252	270	252
q12	395	214	219	214
q13	17806	2965	2965	2965
q14	239	204	204	204
q15	509	461	465	461
q16	482	376	375	375
q17	964	583	576	576
q18	7184	6717	6533	6533
q19	1304	962	1017	962
q20	473	197	197	197
q21	3893	3141	3170	3141
q22	1073	993	990	990
Total cold run time: 107493 ms
Total hot run time: 39682 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6614	6598	6554	6554
q2	327	232	237	232
q3	2884	2909	2944	2909
q4	2082	1804	1802	1802
q5	5711	5750	5672	5672
q6	208	127	132	127
q7	2251	1862	1845	1845
q8	3375	3525	3519	3519
q9	8864	8882	8839	8839
q10	3593	3512	3546	3512
q11	576	495	502	495
q12	816	632	630	630
q13	8553	3155	3193	3155
q14	305	270	278	270
q15	528	458	455	455
q16	487	441	429	429
q17	1845	1660	1605	1605
q18	8326	7890	7878	7878
q19	1667	1597	1526	1526
q20	2058	1867	1882	1867
q21	5172	5034	5001	5001
q22	1152	1039	1042	1039
Total cold run time: 67394 ms
Total hot run time: 59361 ms

[doris-robot]

TPC-DS: Total hot run time: 196657 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit eaac1a6cf08343805f5405e1bad21860f87a3960, data reload: false

query1	1302	904	905	904
query2	6289	1831	1838	1831
query3	11007	4516	4642	4516
query4	33533	23277	23443	23277
query5	3676	454	430	430
query6	252	178	180	178
query7	3988	311	327	311
query8	292	229	232	229
query9	9645	2588	2583	2583
query10	475	266	258	258
query11	17813	15116	15210	15116
query12	152	102	101	101
query13	1552	435	422	422
query14	8930	7289	7605	7289
query15	265	190	186	186
query16	8113	486	481	481
query17	1768	599	600	599
query18	2184	323	321	321
query19	374	163	166	163
query20	127	121	120	120
query21	207	112	111	111
query22	4755	4431	4374	4374
query23	35255	34274	34023	34023
query24	11158	2886	2923	2886
query25	662	439	442	439
query26	1197	178	175	175
query27	2554	366	369	366
query28	7324	2167	2180	2167
query29	865	453	465	453
query30	272	159	161	159
query31	1024	846	838	838
query32	99	57	55	55
query33	754	296	304	296
query34	971	516	521	516
query35	860	760	723	723
query36	1117	941	995	941
query37	134	69	66	66
query38	4056	3967	4011	3967
query39	1516	1463	1475	1463
query40	196	102	102	102
query41	51	47	47	47
query42	121	102	101	101
query43	517	491	503	491
query44	1256	829	831	829
query45	182	172	171	171
query46	1174	728	720	720
query47	2019	1931	1902	1902
query48	425	352	381	352
query49	1070	392	384	384
query50	855	417	418	417
query51	7407	7270	7278	7270
query52	100	89	93	89
query53	260	180	187	180
query54	1173	488	472	472
query55	76	80	78	78
query56	259	248	243	243
query57	1328	1218	1211	1211
query58	246	221	214	214
query59	3258	3115	2952	2952
query60	282	253	265	253
query61	107	108	110	108
query62	866	702	681	681
query63	228	191	189	189
query64	4005	660	626	626
query65	3300	3215	3152	3152
query66	769	294	288	288
query67	15954	15578	15531	15531
query68	4599	585	591	585
query69	446	271	258	258
query70	1168	1060	1084	1060
query71	348	265	253	253
query72	6290	4035	4020	4020
query73	748	352	356	352
query74	10590	8976	8968	8968
query75	3409	2641	2647	2641
query76	2680	970	1127	970
query77	398	277	274	274
query78	10536	9555	9563	9555
query79	1592	611	598	598
query80	1161	423	421	421
query81	537	224	224	224
query82	942	94	86	86
query83	238	138	146	138
query84	243	87	75	75
query85	1374	307	283	283
query86	438	291	287	287
query87	4308	4207	4218	4207
query88	3668	2418	2395	2395
query89	418	288	297	288
query90	1911	190	189	189
query91	143	107	111	107
query92	68	50	54	50
query93	2139	556	549	549
query94	831	295	290	290
query95	352	252	263	252
query96	615	292	289	289
query97	3285	3131	3199	3131
query98	214	203	198	198
query99	1546	1287	1278	1278
Total cold run time: 301236 ms
Total hot run time: 196657 ms

[doris-robot]

ClickBench: Total hot run time: 30.28 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit eaac1a6cf08343805f5405e1bad21860f87a3960, data reload: false

query1	0.03	0.03	0.04
query2	0.07	0.02	0.03
query3	0.24	0.06	0.06
query4	1.62	0.10	0.10
query5	0.53	0.52	0.50
query6	1.12	0.73	0.72
query7	0.02	0.01	0.02
query8	0.04	0.04	0.03
query9	0.57	0.50	0.50
query10	0.56	0.55	0.56
query11	0.15	0.11	0.10
query12	0.15	0.11	0.11
query13	0.59	0.59	0.58
query14	0.77	0.80	0.78
query15	0.84	0.83	0.83
query16	0.39	0.37	0.36
query17	1.03	1.03	1.00
query18	0.23	0.22	0.21
query19	1.88	1.86	1.83
query20	0.02	0.01	0.01
query21	15.40	0.58	0.60
query22	2.30	1.61	1.71
query23	16.97	0.89	0.92
query24	3.00	1.26	1.28
query25	0.25	0.12	0.09
query26	0.37	0.14	0.13
query27	0.05	0.04	0.04
query28	10.11	0.47	0.49
query29	12.54	3.19	3.15
query30	0.25	0.07	0.06
query31	2.84	0.39	0.37
query32	3.24	0.46	0.46
query33	3.00	3.01	3.02
query34	17.20	4.51	4.50
query35	4.58	4.58	4.55
query36	0.65	0.49	0.48
query37	0.09	0.05	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.16	0.13	0.13
query41	0.07	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 104.07 s
Total hot run time: 30.28 s