Skip to content

[fix](auth)fix show load priv bug (#41723) #42109

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
morningman merged 1 commit into from
Nov 6, 2024
Merged

[fix](auth)fix show load priv bug (#41723) #42109

morningman merged 1 commit into from
Nov 6, 2024

Conversation

@zddr
Copy link
Contributor

@zddr zddr commented Oct 18, 2024

pick: #41723

@zddr
[fix](auth)fix show load priv bug (apache#41723)
fb5c8f0 
fix when user have `load_priv` on table,but can not show load about this
table

ps: We will add cases to other PRs as a
whole:apache#41802
@doris-robot
Copy link

doris-robot commented Oct 18, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zddr
Copy link
Contributor Author

zddr commented Oct 18, 2024

run buildall

@github-actions github-actions bot added the area/load Issues or PRs related to all kinds of load label Oct 18, 2024
@doris-robot
Copy link

doris-robot commented Oct 18, 2024

TPC-H: Total hot run time: 49344 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit fb5c8f0645718d3a8f5caff4bc7203478cfb9749, data reload: false

------ Round 1 ----------------------------------
q1	17642	4421	4382	4382
q2	2078	149	146	146
q3	10322	1938	1961	1938
q4	10339	1285	1349	1285
q5	8348	3972	3895	3895
q6	237	131	130	130
q7	1999	1651	1587	1587
q8	9303	2751	2722	2722
q9	10028	9937	9903	9903
q10	8699	3523	3516	3516
q11	415	246	255	246
q12	469	303	303	303
q13	18355	3975	4064	3975
q14	351	317	331	317
q15	506	463	456	456
q16	556	454	453	453
q17	1138	956	955	955
q18	7197	6887	6764	6764
q19	1675	1586	1548	1548
q20	533	307	312	307
q21	4452	4148	4106	4106
q22	493	410	413	410
Total cold run time: 115135 ms
Total hot run time: 49344 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4346	4358	4304	4304
q2	317	229	218	218
q3	4184	4174	4172	4172
q4	2776	2756	2761	2756
q5	7138	7113	7005	7005
q6	244	127	125	125
q7	3220	2849	2835	2835
q8	4402	4477	4501	4477
q9	13731	13609	13618	13609
q10	4200	4286	4305	4286
q11	745	680	697	680
q12	1036	842	851	842
q13	6986	3739	3733	3733
q14	454	440	424	424
q15	509	472	469	469
q16	649	603	603	603
q17	3798	3819	3858	3819
q18	8790	8791	8709	8709
q19	1730	1666	1649	1649
q20	2348	2099	2069	2069
q21	8511	8389	8527	8389
q22	1009	917	917	917
Total cold run time: 81123 ms
Total hot run time: 76090 ms

@doris-robot
Copy link

doris-robot commented Oct 18, 2024

TPC-DS: Total hot run time: 213150 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit fb5c8f0645718d3a8f5caff4bc7203478cfb9749, data reload: false

query1	939	414	379	379
query2	6536	2165	2135	2135
query3	6919	200	200	200
query4	23207	21489	21306	21306
query5	19750	6521	6559	6521
query6	287	226	240	226
query7	4323	298	318	298
query8	267	258	246	246
query9	3047	2658	2583	2583
query10	471	308	321	308
query11	16517	14984	15394	14984
query12	131	82	74	74
query13	1035	445	434	434
query14	17208	13057	13724	13057
query15	363	217	236	217
query16	6478	279	262	262
query17	1740	925	902	902
query18	901	322	318	318
query19	210	146	147	146
query20	98	99	93	93
query21	191	103	103	103
query22	5348	5084	5146	5084
query23	34138	33433	33468	33433
query24	7733	6356	6362	6356
query25	540	432	432	432
query26	1236	163	162	162
query27	2284	293	290	290
query28	6064	2283	2218	2218
query29	2858	2805	2797	2797
query30	238	171	163	163
query31	949	799	732	732
query32	70	64	61	61
query33	448	252	270	252
query34	849	488	472	472
query35	1121	923	913	913
query36	1328	1265	1081	1081
query37	93	62	65	62
query38	3110	2901	2903	2901
query39	1382	1340	1322	1322
query40	315	100	96	96
query41	41	39	38	38
query42	89	90	91	90
query43	613	601	563	563
query44	1184	719	727	719
query45	248	226	233	226
query46	1226	965	936	936
query47	1897	1647	1721	1647
query48	518	408	410	408
query49	656	386	384	384
query50	868	646	624	624
query51	4784	4711	4751	4711
query52	107	85	95	85
query53	228	189	198	189
query54	2697	2496	2483	2483
query55	87	83	86	83
query56	227	217	211	211
query57	1199	1195	1162	1162
query58	221	213	225	213
query59	3720	3467	3306	3306
query60	227	210	220	210
query61	96	95	97	95
query62	842	483	490	483
query63	206	180	186	180
query64	3538	1585	1444	1444
query65	3639	3574	3618	3574
query66	782	421	417	417
query67	16534	18542	16123	16123
query68	7415	653	646	646
query69	506	287	271	271
query70	1644	1467	1359	1359
query71	413	321	321	321
query72	8246	5036	4966	4966
query73	744	321	332	321
query74	6755	6305	5909	5909
query75	4650	3730	3742	3730
query76	5104	1136	1227	1136
query77	1158	270	275	270
query78	12987	11950	11681	11681
query79	8529	663	631	631
query80	2832	395	388	388
query81	533	241	235	235
query82	1638	99	102	99
query83	188	129	134	129
query84	263	71	73	71
query85	1412	316	319	316
query86	360	294	303	294
query87	3204	3056	3027	3027
query88	4774	2310	2312	2310
query89	418	302	285	285
query90	1726	219	215	215
query91	159	134	124	124
query92	61	55	52	52
query93	6167	555	571	555
query94	875	210	208	208
query95	1964	1959	1649	1649
query96	641	329	319	319
query97	6445	6435	6397	6397
query98	222	211	229	211
query99	2762	911	802	802
Total cold run time: 321991 ms
Total hot run time: 213150 ms

@doris-robot
Copy link

doris-robot commented Oct 18, 2024

ClickBench: Total hot run time: 30.23 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit fb5c8f0645718d3a8f5caff4bc7203478cfb9749, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.25	0.05	0.04
query4	1.77	0.07	0.06
query5	0.53	0.53	0.53
query6	1.24	0.62	0.62
query7	0.01	0.01	0.01
query8	0.03	0.03	0.02
query9	0.52	0.50	0.48
query10	0.53	0.54	0.53
query11	0.12	0.09	0.09
query12	0.12	0.10	0.09
query13	0.62	0.61	0.61
query14	0.78	0.81	0.79
query15	0.79	0.76	0.77
query16	0.36	0.35	0.37
query17	1.01	1.01	1.01
query18	0.24	0.24	0.25
query19	1.93	1.86	1.88
query20	0.02	0.01	0.01
query21	15.52	0.56	0.56
query22	2.17	2.61	0.80
query23	16.95	1.08	1.04
query24	4.89	2.16	1.22
query25	0.35	0.09	0.06
query26	0.69	0.16	0.17
query27	0.04	0.04	0.04
query28	7.15	0.73	0.72
query29	12.59	2.19	2.30
query30	0.56	0.52	0.52
query31	2.80	0.39	0.37
query32	3.39	0.48	0.50
query33	3.06	3.04	3.04
query34	15.26	4.80	4.79
query35	4.89	4.83	4.84
query36	1.04	1.02	1.01
query37	0.06	0.05	0.05
query38	0.03	0.02	0.02
query39	0.02	0.02	0.02
query40	0.16	0.14	0.15
query41	0.06	0.02	0.01
query42	0.02	0.02	0.01
query43	0.03	0.01	0.01
Total cold run time: 102.69 s
Total hot run time: 30.23 s

@doris-robot
Copy link

doris-robot commented Oct 18, 2024

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit fb5c8f0645718d3a8f5caff4bc7203478cfb9749 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          57 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.1 seconds inserted 10000000 Rows, about 473K ops/s

@morningman morningman merged commit 97a5b0d into apache:branch-2.0 Nov 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

area/load Issues or PRs related to all kinds of load

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@zddr @doris-robot @morningman