Skip to content

[0.18.1] Optimize FileWriteOutBytes to avoid high system cpu usage (#9722)#9770

Merged
jihoonson merged 1 commit intoapache:0.18.1from
suneet-s:backport/0.18.1/pr-9722
Apr 24, 2020
Merged

[0.18.1] Optimize FileWriteOutBytes to avoid high system cpu usage (#9722)#9770
jihoonson merged 1 commit intoapache:0.18.1from
suneet-s:backport/0.18.1/pr-9722

Conversation

@suneet-s
Copy link
Copy Markdown
Contributor

Backports the following commits to 0.18.1:

* optimize FileWriteOutBytes to avoid high sys cpu

* optimize FileWriteOutBytes to avoid high sys cpu -- remove IOException

* optimize FileWriteOutBytes to avoid high sys cpu -- remove IOException in writeOutBytes.size

* Revert "optimize FileWriteOutBytes to avoid high sys cpu -- remove IOException in writeOutBytes.size"

This reverts commit 965f742

* Revert "optimize FileWriteOutBytes to avoid high sys cpu -- remove IOException"

This reverts commit 149e08c

* optimize FileWriteOutBytes to avoid high sys cpu -- avoid IOEception never thrown check

* Fix size counting to handle IOE in FileWriteOutBytes + tests

* remove unused throws IOException in WriteOutBytes.size()

* Remove redundant throws IOExcpetion clauses

* Parameterize IndexMergeBenchmark

Co-authored-by: huanghui.bigrey <huanghui.bigrey@bytedance.com>
Co-authored-by: Suneet Saldanha <suneet.saldanha@imply.io>
@suneet-s
Copy link
Copy Markdown
Contributor Author

Clean cherry-pick

Closed out #9762 since it had a merge conflict

@jihoonson jihoonson added this to the 0.18.1 milestone Apr 24, 2020
@jihoonson jihoonson merged commit 29073c5 into apache:0.18.1 Apr 24, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants