Skip to content

Conversation

@morningman
Copy link
Contributor

Proposed changes

In #25331, I change the behavior of user's default resource tag, that is, if a user does not set resource tag,
it can only use default resource tag.
This PR change this logic. The normal user can only use default resource tag if resource tag is not set,
but root and admin user can use any resource tag if resource tag is not set.

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@morningman
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Tpch sf100 test result on commit d7c6e1ca2b53a5507c9b63836517a9bf8398780d, data reload: false

run tpch-sf100 query with default conf and session variables
q1	4694	4462	4459	4459
q2	365	151	158	151
q3	1456	1245	1252	1245
q4	1113	919	885	885
q5	3143	3173	3183	3173
q6	248	130	129	129
q7	1012	505	489	489
q8	2180	2244	2172	2172
q9	6643	6654	6653	6653
q10	3211	3252	3254	3252
q11	329	205	207	205
q12	355	202	209	202
q13	4516	5421	3828	3828
q14	246	212	214	212
q15	555	516	530	516
q16	443	385	405	385
q17	996	609	559	559
q18	7598	7918	7012	7012
q19	1519	1363	1391	1363
q20	547	348	344	344
q21	3103	2631	2717	2631
q22	351	288	296	288
Total cold run time: 44623 ms
Total hot run time: 40153 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4390	4425	4434	4425
q2	265	167	177	167
q3	3529	3519	3502	3502
q4	2378	2377	2376	2376
q5	5745	5734	5709	5709
q6	240	121	120	120
q7	2390	1837	1828	1828
q8	3505	3494	3502	3494
q9	9011	8949	8960	8949
q10	3923	3979	3998	3979
q11	509	380	389	380
q12	763	589	588	588
q13	4288	3579	3567	3567
q14	285	253	244	244
q15	573	520	517	517
q16	504	473	459	459
q17	1850	1849	1865	1849
q18	8628	8364	8305	8305
q19	1714	1714	1750	1714
q20	2254	1968	1925	1925
q21	6506	6135	6121	6121
q22	502	409	423	409
Total cold run time: 63752 ms
Total hot run time: 60627 ms

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 43.65 seconds
stream load tsv: 578 seconds loaded 74807831229 Bytes, about 123 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.8 seconds inserted 10000000 Rows, about 347K ops/s
storage size: 17194483500 Bytes

Copy link
Contributor

@xiaokang xiaokang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Dec 7, 2023
@github-actions
Copy link
Contributor

github-actions bot commented Dec 7, 2023

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Dec 7, 2023

PR approved by anyone and no changes requested.

@xiaokang xiaokang merged commit 3a7a8bb into apache:master Dec 7, 2023
eldenmoon pushed a commit to eldenmoon/incubator-doris that referenced this pull request Dec 8, 2023
eldenmoon added a commit that referenced this pull request Dec 8, 2023
* [fix](hudi-catalog) fix hudi catalog code (#27966)

backport: #27963

* [fix](Nereids): fix datetime fold-constant-be in Branch-2.0 (#27938)

fix fold-constant-be datetimev2 will lose the scale of datetime.

* [bug](function) fix compound expr coredump problem #27988 (#27989)

* [branch-2.0](cache) Fix partition cache support DATEV2  #27978 (#27990)

* [branch-2.0] delete auto partition docs (#28001)

* [fix](stats) Drop stats or update updated rows after truncate table (#27956)

1. Also clear follower's stats cache when doing drop stats.
2. Drop stats when truncate a table.

backport #27931

* [minor](stats) truncate min/max if too long #27955 (#27997)

* [agg](profile) fix incorrect profile (#28004) (#28035)

* [fix](remote-scanner-pool) missing _remote_thread_pool_max_size value #28057 (#28053)

bp #28057

* [enhance](partitionid) check partition id to avoid unexpected behavior (#28045)

* [opt](resource-tag) root and admin user can use any resource tag by default #28088 (#28080)

bp #28088

* [compile](compile option) add deflate to X86 only (#28089)

* change version to 2.0.3-rc05-var05

* [fix](Nereids): Preserve `""` in single quote strings and `''` in double quote strings. (#27959)

---------

Co-authored-by: Tiewei Fang <43782773+BePPPower@users.noreply.github.com>
Co-authored-by: jakevin <jakevingoo@gmail.com>
Co-authored-by: HappenLee <happenlee@hotmail.com>
Co-authored-by: Xinyi Zou <zouxinyi02@gmail.com>
Co-authored-by: zclllyybb <zhaochangle@selectdb.com>
Co-authored-by: Jibing-Li <64681310+Jibing-Li@users.noreply.github.com>
Co-authored-by: AKIRA <33112463+Kikyou1997@users.noreply.github.com>
Co-authored-by: TengJianPing <18241664+jacktengg@users.noreply.github.com>
Co-authored-by: Mingyu Chen <morningman@163.com>
Co-authored-by: Yongqiang YANG <98214048+dataroaring@users.noreply.github.com>
Co-authored-by: shuke <37901441+shuke987@users.noreply.github.com>
Co-authored-by: 谢健 <jianxie0@gmail.com>
XuJianxu pushed a commit to XuJianxu/doris that referenced this pull request Dec 14, 2023
…efault (apache#28088)

In apache#25331, I change the behavior of user's default resource tag, that is, if a user does not set resource tag,
it can only use default resource tag.
This PR change this logic. The normal user can only use default resource tag if resource tag is not set,
but root and admin user can use any resource tag if resource tag is not set.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.0.3-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants