Skip to content

Conversation

@github-actions
Copy link
Contributor

@github-actions github-actions bot commented Apr 7, 2025

Cherry-picked from #49721

…cy (#49721)

partition's `storage_policy` are lost when the fe master sync with the
follower or when the fe recovers
@github-actions github-actions bot requested a review from dataroaring as a code owner April 7, 2025 08:40
@Thearas
Copy link
Contributor

Thearas commented Apr 7, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring closed this Apr 7, 2025
@dataroaring dataroaring reopened this Apr 7, 2025
@Thearas
Copy link
Contributor

Thearas commented Apr 7, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40781 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2ac2f46b80a4fa72c7534a6fe17f8e5bb6946b49, data reload: false

------ Round 1 ----------------------------------
q1	17596	6915	6805	6805
q2	2062	171	174	171
q3	10632	1114	1193	1114
q4	10553	770	776	770
q5	7733	2927	2918	2918
q6	229	139	134	134
q7	975	631	611	611
q8	9340	2030	2085	2030
q9	6676	6471	6456	6456
q10	7062	2285	2314	2285
q11	468	257	270	257
q12	416	218	217	217
q13	17793	2981	2986	2981
q14	234	207	214	207
q15	498	452	471	452
q16	681	612	578	578
q17	1015	601	545	545
q18	7256	6678	6701	6678
q19	1400	1137	1077	1077
q20	490	205	205	205
q21	4170	3317	3367	3317
q22	1133	1021	973	973
Total cold run time: 108412 ms
Total hot run time: 40781 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6772	6994	7191	6994
q2	353	237	233	233
q3	2929	2978	3018	2978
q4	2146	1877	1911	1877
q5	5879	5907	5970	5907
q6	225	133	131	131
q7	2299	1884	1861	1861
q8	3516	3796	3623	3623
q9	9064	9141	9157	9141
q10	3619	3600	3538	3538
q11	607	523	515	515
q12	813	598	649	598
q13	8387	3222	3221	3221
q14	308	259	278	259
q15	514	474	478	474
q16	691	666	665	665
q17	1913	1637	1677	1637
q18	8226	7867	7506	7506
q19	1819	1623	1601	1601
q20	2134	1911	1855	1855
q21	5548	5513	5292	5292
q22	1170	1013	1056	1013
Total cold run time: 68932 ms
Total hot run time: 60919 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 198241 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2ac2f46b80a4fa72c7534a6fe17f8e5bb6946b49, data reload: false

query1	1308	930	958	930
query2	6233	2047	1990	1990
query3	10924	4703	4582	4582
query4	66453	28122	23502	23502
query5	4894	464	456	456
query6	402	184	189	184
query7	5501	323	309	309
query8	311	235	229	229
query9	8488	2599	2611	2599
query10	440	263	255	255
query11	17197	15383	15709	15383
query12	176	105	106	105
query13	1456	457	457	457
query14	11082	7660	7404	7404
query15	204	185	182	182
query16	7037	518	484	484
query17	1104	598	609	598
query18	1899	336	318	318
query19	212	174	183	174
query20	118	117	115	115
query21	206	98	105	98
query22	4794	4402	4434	4402
query23	34645	33943	34280	33943
query24	6079	2962	2927	2927
query25	510	410	390	390
query26	663	167	166	166
query27	1910	360	368	360
query28	4256	2425	2424	2424
query29	669	441	451	441
query30	267	172	165	165
query31	986	827	854	827
query32	70	56	58	56
query33	423	298	315	298
query34	917	504	519	504
query35	856	719	735	719
query36	1117	952	983	952
query37	116	66	67	66
query38	4135	4128	4085	4085
query39	1514	1471	1468	1468
query40	201	100	103	100
query41	52	49	48	48
query42	114	99	110	99
query43	515	485	491	485
query44	1178	831	845	831
query45	193	180	175	175
query46	1174	732	762	732
query47	2046	1926	1949	1926
query48	494	388	408	388
query49	749	423	408	408
query50	855	458	438	438
query51	7449	7277	7076	7076
query52	102	89	96	89
query53	258	183	187	183
query54	566	460	451	451
query55	76	75	79	75
query56	271	260	247	247
query57	1251	1139	1095	1095
query58	220	214	221	214
query59	3148	2935	2884	2884
query60	290	257	260	257
query61	132	129	129	129
query62	787	680	666	666
query63	216	197	196	196
query64	1468	743	638	638
query65	3261	3221	3204	3204
query66	758	298	303	298
query67	16174	15587	15595	15587
query68	3922	576	555	555
query69	436	264	260	260
query70	1183	1171	1112	1112
query71	359	256	258	256
query72	6380	4055	4030	4030
query73	758	345	343	343
query74	10315	9023	9224	9023
query75	3393	2664	2685	2664
query76	1908	1076	1023	1023
query77	457	277	271	271
query78	10545	9658	9585	9585
query79	1828	599	601	599
query80	1344	440	420	420
query81	546	243	242	242
query82	1325	93	89	89
query83	267	145	150	145
query84	276	84	76	76
query85	1014	320	291	291
query86	431	308	306	306
query87	4576	4477	4459	4459
query88	4099	2401	2364	2364
query89	415	289	295	289
query90	1936	199	188	188
query91	179	147	148	147
query92	68	49	51	49
query93	2566	553	546	546
query94	858	300	285	285
query95	362	257	257	257
query96	614	288	284	284
query97	3281	3156	3170	3156
query98	214	209	200	200
query99	1615	1306	1261	1261
Total cold run time: 321040 ms
Total hot run time: 198241 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.95 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2ac2f46b80a4fa72c7534a6fe17f8e5bb6946b49, data reload: false

query1	0.04	0.04	0.04
query2	0.06	0.03	0.03
query3	0.23	0.07	0.06
query4	1.63	0.11	0.10
query5	0.50	0.51	0.50
query6	1.13	0.73	0.73
query7	0.03	0.02	0.02
query8	0.04	0.04	0.03
query9	0.57	0.51	0.49
query10	0.54	0.56	0.55
query11	0.13	0.10	0.10
query12	0.14	0.11	0.12
query13	0.62	0.61	0.58
query14	2.73	2.76	2.74
query15	0.88	0.82	0.82
query16	0.39	0.38	0.39
query17	1.06	1.08	1.06
query18	0.24	0.22	0.21
query19	1.98	1.88	2.01
query20	0.01	0.02	0.01
query21	15.37	0.60	0.63
query22	2.64	1.94	2.33
query23	16.96	0.95	0.87
query24	3.39	1.36	2.26
query25	0.30	0.12	0.12
query26	0.51	0.14	0.14
query27	0.03	0.04	0.04
query28	8.76	0.47	0.49
query29	12.63	3.21	3.18
query30	0.25	0.06	0.06
query31	2.86	0.40	0.39
query32	3.23	0.47	0.46
query33	2.99	3.01	3.01
query34	17.20	4.50	4.50
query35	4.61	4.59	4.61
query36	0.65	0.49	0.47
query37	0.08	0.06	0.06
query38	0.05	0.03	0.03
query39	0.04	0.02	0.03
query40	0.16	0.13	0.14
query41	0.08	0.03	0.02
query42	0.03	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.8 s
Total hot run time: 32.95 s

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dataroaring dataroaring merged commit 64cfdf7 into branch-3.0 Apr 7, 2025
23 of 24 checks passed
@github-actions github-actions bot deleted the auto-pick-49721-branch-3.0 branch April 7, 2025 13:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants