Skip to content

Conversation

@github-actions
Copy link
Contributor

@github-actions github-actions bot commented Nov 4, 2024

Cherry-picked from #42419

Change the map to a concurrency safe map,because there is a possibility
of concurrent read and write operations

For example, when a node performs the rectifyPrivs operation, it needs
to traverse 'roles' and may be adding or deleting roles at the same time
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@doris-robot
Copy link

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40148 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ac602f4957078801e7f01c4bb2e4d8e5326bc364, data reload: false

------ Round 1 ----------------------------------
q1	17572	7344	8045	7344
q2	2066	152	163	152
q3	10836	1030	1100	1030
q4	10551	762	688	688
q5	7977	2813	2681	2681
q6	233	146	140	140
q7	958	605	585	585
q8	9552	1861	1929	1861
q9	6851	6385	6377	6377
q10	6970	2296	2298	2296
q11	449	276	267	267
q12	394	206	201	201
q13	17782	2969	2953	2953
q14	245	206	210	206
q15	551	507	503	503
q16	645	600	609	600
q17	945	544	535	535
q18	7318	6510	6539	6510
q19	3030	1074	1077	1074
q20	463	190	191	190
q21	3966	3001	3118	3001
q22	1085	983	954	954
Total cold run time: 110439 ms
Total hot run time: 40148 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7362	7290	7194	7194
q2	317	225	224	224
q3	2926	2813	2864	2813
q4	2022	1759	1741	1741
q5	5671	5630	5719	5630
q6	224	142	136	136
q7	2153	1770	1767	1767
q8	3301	3460	3412	3412
q9	8715	8803	8769	8769
q10	3514	3493	3486	3486
q11	595	492	498	492
q12	779	610	583	583
q13	16503	3132	3107	3107
q14	297	268	275	268
q15	566	524	524	524
q16	695	662	662	662
q17	1818	1628	1568	1568
q18	8200	7781	7505	7505
q19	1682	1677	1463	1463
q20	2058	1864	1816	1816
q21	5245	5275	5235	5235
q22	1139	1051	1029	1029
Total cold run time: 75782 ms
Total hot run time: 59424 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193359 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ac602f4957078801e7f01c4bb2e4d8e5326bc364, data reload: false

query1	1227	896	947	896
query2	6228	2105	2057	2057
query3	10799	3843	3870	3843
query4	67922	27995	23441	23441
query5	5518	445	426	426
query6	473	185	172	172
query7	6177	309	315	309
query8	340	234	229	229
query9	9445	2667	2656	2656
query10	522	265	261	261
query11	18066	15271	15619	15271
query12	160	102	104	102
query13	1616	426	424	424
query14	11027	7264	7000	7000
query15	230	182	185	182
query16	7326	499	479	479
query17	1058	571	559	559
query18	1870	303	292	292
query19	186	145	149	145
query20	115	106	109	106
query21	206	98	100	98
query22	4277	4112	4225	4112
query23	34131	33593	33711	33593
query24	5675	2763	2741	2741
query25	533	418	398	398
query26	684	157	164	157
query27	1705	290	291	290
query28	4377	2521	2468	2468
query29	690	431	430	430
query30	237	152	149	149
query31	992	760	806	760
query32	62	56	55	55
query33	429	268	271	268
query34	898	493	488	488
query35	837	698	714	698
query36	1057	925	910	910
query37	118	72	75	72
query38	3999	3812	3809	3809
query39	1542	1443	1443	1443
query40	197	98	94	94
query41	55	50	48	48
query42	111	98	93	93
query43	529	493	465	465
query44	1112	770	781	770
query45	185	164	165	164
query46	1127	704	721	704
query47	1909	1796	1798	1796
query48	445	364	366	364
query49	748	395	392	392
query50	802	400	415	400
query51	7278	7043	6968	6968
query52	129	93	90	90
query53	251	179	178	178
query54	571	456	434	434
query55	75	77	72	72
query56	250	239	245	239
query57	1182	1087	1077	1077
query58	203	197	197	197
query59	3146	2835	3132	2835
query60	266	249	243	243
query61	101	97	100	97
query62	785	661	650	650
query63	211	183	186	183
query64	1744	605	589	589
query65	3261	3157	3156	3156
query66	730	334	311	311
query67	15736	15209	15166	15166
query68	4580	553	545	545
query69	422	254	244	244
query70	1119	1122	1119	1119
query71	362	263	253	253
query72	6430	3861	3934	3861
query73	758	335	335	335
query74	10236	8920	8891	8891
query75	3344	2647	2599	2599
query76	2401	1036	905	905
query77	503	253	260	253
query78	10817	9665	9451	9451
query79	11941	582	584	582
query80	2264	412	419	412
query81	556	253	251	251
query82	1339	114	112	112
query83	302	136	137	136
query84	289	74	76	74
query85	1821	289	277	277
query86	463	281	295	281
query87	4570	4315	4260	4260
query88	5955	2398	2415	2398
query89	552	287	298	287
query90	2111	184	186	184
query91	181	139	139	139
query92	60	48	46	46
query93	7344	532	533	532
query94	916	277	285	277
query95	360	250	248	248
query96	633	288	281	281
query97	3323	3121	3165	3121
query98	228	199	192	192
query99	1634	1249	1294	1249
Total cold run time: 343707 ms
Total hot run time: 193359 ms

@zddr
Copy link
Contributor

zddr commented Nov 6, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40639 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ac602f4957078801e7f01c4bb2e4d8e5326bc364, data reload: false

------ Round 1 ----------------------------------
q1	17597	7383	7289	7289
q2	2077	161	159	159
q3	10704	1082	1142	1082
q4	10540	713	745	713
q5	7729	2846	2758	2758
q6	240	148	146	146
q7	983	614	618	614
q8	9352	1931	1980	1931
q9	6563	6438	6484	6438
q10	6993	2311	2306	2306
q11	461	260	267	260
q12	412	217	218	217
q13	17790	2968	2991	2968
q14	255	213	214	213
q15	577	524	527	524
q16	671	602	607	602
q17	973	565	557	557
q18	7392	6655	6601	6601
q19	2146	1053	964	964
q20	483	202	198	198
q21	4126	3125	3243	3125
q22	1071	985	974	974
Total cold run time: 109135 ms
Total hot run time: 40639 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7375	7230	7248	7230
q2	325	232	235	232
q3	2888	2885	2894	2885
q4	2026	1857	1833	1833
q5	5739	5702	5743	5702
q6	220	142	141	141
q7	2205	1775	1806	1775
q8	3338	3596	3497	3497
q9	8830	8875	8915	8875
q10	3555	3488	3489	3488
q11	608	498	495	495
q12	778	601	580	580
q13	16532	3156	3159	3156
q14	310	273	269	269
q15	558	522	521	521
q16	706	676	678	676
q17	1868	1627	1623	1623
q18	8160	7729	7420	7420
q19	5226	1585	1577	1577
q20	2069	1853	1813	1813
q21	5354	5279	5311	5279
q22	1169	1042	1015	1015
Total cold run time: 79839 ms
Total hot run time: 60082 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195182 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ac602f4957078801e7f01c4bb2e4d8e5326bc364, data reload: false

query1	1240	899	949	899
query2	6233	2185	2049	2049
query3	10805	3879	3750	3750
query4	67502	30217	23530	23530
query5	5669	462	454	454
query6	471	174	170	170
query7	6200	318	312	312
query8	342	238	229	229
query9	9513	2663	2624	2624
query10	519	284	273	273
query11	18531	15521	15864	15521
query12	178	104	109	104
query13	1613	435	428	428
query14	11480	7475	7462	7462
query15	230	200	176	176
query16	7247	476	480	476
query17	1092	562	552	552
query18	1855	308	300	300
query19	201	159	160	159
query20	117	109	109	109
query21	214	102	101	101
query22	4325	4270	3994	3994
query23	34442	33869	33891	33869
query24	5727	2866	2905	2866
query25	522	414	450	414
query26	684	167	170	167
query27	1684	294	298	294
query28	4162	2536	2499	2499
query29	681	447	435	435
query30	243	164	158	158
query31	995	826	797	797
query32	67	56	60	56
query33	459	283	285	283
query34	894	492	501	492
query35	860	736	719	719
query36	1074	951	968	951
query37	119	78	76	76
query38	3933	3870	3815	3815
query39	1487	1438	1431	1431
query40	208	103	103	103
query41	52	51	49	49
query42	110	103	104	103
query43	532	503	496	496
query44	1160	786	808	786
query45	188	169	174	169
query46	1137	730	719	719
query47	1877	1796	1796	1796
query48	461	374	358	358
query49	748	407	400	400
query50	802	414	423	414
query51	7298	7067	7136	7067
query52	108	93	98	93
query53	272	191	187	187
query54	582	454	455	454
query55	82	84	78	78
query56	267	260	283	260
query57	1174	1109	1107	1107
query58	206	204	208	204
query59	3301	3081	3067	3067
query60	277	243	253	243
query61	122	103	101	101
query62	786	668	656	656
query63	214	197	190	190
query64	1710	643	619	619
query65	3265	3170	3200	3170
query66	717	310	307	307
query67	15532	15078	15347	15078
query68	4516	567	541	541
query69	414	264	263	263
query70	1159	1147	1120	1120
query71	446	261	258	258
query72	6495	3892	3917	3892
query73	757	344	338	338
query74	10104	8855	8979	8855
query75	3342	2603	2653	2603
query76	2172	980	988	980
query77	502	271	267	267
query78	10628	9650	9498	9498
query79	8335	581	582	581
query80	1974	419	428	419
query81	574	242	247	242
query82	1390	116	112	112
query83	256	143	135	135
query84	279	81	72	72
query85	1717	293	284	284
query86	459	277	309	277
query87	4444	4234	4189	4189
query88	5571	2372	2378	2372
query89	558	298	291	291
query90	2115	182	174	174
query91	177	145	137	137
query92	60	47	50	47
query93	6825	557	543	543
query94	882	289	271	271
query95	346	248	251	248
query96	638	281	285	281
query97	3397	3106	3107	3106
query98	233	214	201	201
query99	1607	1318	1317	1317
Total cold run time: 339170 ms
Total hot run time: 195182 ms

@dataroaring dataroaring closed this Nov 7, 2024
@dataroaring dataroaring reopened this Nov 7, 2024
@dataroaring dataroaring merged commit 23f7bb9 into branch-3.0 Nov 7, 2024
@gavinchou gavinchou mentioned this pull request Nov 26, 2024
@dataroaring dataroaring deleted the auto-pick-42419-branch-3.0 branch December 27, 2024 07:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants