Skip to content

Conversation

@wsjz
Copy link
Contributor

@wsjz wsjz commented Jan 12, 2024

Proposed changes

from #29291

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@wsjz wsjz marked this pull request as ready for review January 12, 2024 10:12
Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clang-tidy made some suggestions

private:
FileHandleCache _cache;
HdfsFileHandleCache() : _cache(config::max_hdfs_file_handle_cache_num, 16, 3600 * 1000L) {}
HdfsFileHandleCache()
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: use '= default' to define a trivial default constructor [modernize-use-equals-default]

be/src/io/fs/hdfs_file_system.cpp:107:

-                      config::max_hdfs_file_handle_cache_time_sec * 1000L) {};
+                      config::max_hdfs_file_handle_cache_time_sec * 1000L) = default;;

hdfsBuilder* get() { return hdfs_builder; }
bool is_need_kinit() const { return need_kinit; }
Status run_kinit();
bool is_kerberos() const { return kerberos_login; }
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: function 'is_kerberos' should be marked [[nodiscard]] [modernize-use-nodiscard]

Suggested change
bool is_kerberos() const { return kerberos_login; }
[[nodiscard]] bool is_kerberos() const { return kerberos_login; }

@morningman morningman changed the title [fix](kerberos) fix BE kerberos ccache renew, optimize kerbero options [fix](kerberos) optimize kerbero options, remove BE kinit, just use UGI login by newInstanceFromKeytab #29291 Jan 12, 2024
@morningman
Copy link
Contributor

run buildall

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.85% (8028/21208)
Line Coverage: 29.51% (65300/221261)
Region Coverage: 28.97% (33599/115972)
Branch Coverage: 24.83% (17244/69446)
Coverage Report: http://coverage.selectdb-in.cc/coverage/92c552eaf01d745ff17f50e9d77f099499304328_92c552eaf01d745ff17f50e9d77f099499304328/report/index.html

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 51.27 seconds
stream load tsv: 572 seconds loaded 74807831229 Bytes, about 124 MB/s
stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 30.2 seconds inserted 10000000 Rows, about 331K ops/s
storage size: 17162554416 Bytes

Copy link
Contributor

@morningman morningman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 12, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@xiaokang xiaokang merged commit 3641fb2 into apache:branch-2.0 Jan 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants