Skip to content

[0.18.1] Optimize FileWriteOutBytes to avoid high system cpu usage (#9722)#9762

Closed
suneet-s wants to merge 1 commit intoapache:0.18.1from
suneet-s:backport/0.18.1/pr-9722
Closed

[0.18.1] Optimize FileWriteOutBytes to avoid high system cpu usage (#9722)#9762
suneet-s wants to merge 1 commit intoapache:0.18.1from
suneet-s:backport/0.18.1/pr-9722

Conversation

@suneet-s
Copy link
Copy Markdown
Contributor

Backports the following commits to 0.18.1:

@suneet-s
Copy link
Copy Markdown
Contributor Author

Only conflict in this backport was processing/src/test/java/org/apache/druid/segment/writeout/FileWriteOutBytesTest.java which did not exist in 0.18.1

@clintropolis clintropolis added this to the 0.18.1 milestone Apr 24, 2020
* optimize FileWriteOutBytes to avoid high sys cpu

* optimize FileWriteOutBytes to avoid high sys cpu -- remove IOException

* optimize FileWriteOutBytes to avoid high sys cpu -- remove IOException in writeOutBytes.size

* Revert "optimize FileWriteOutBytes to avoid high sys cpu -- remove IOException in writeOutBytes.size"

This reverts commit 965f742

* Revert "optimize FileWriteOutBytes to avoid high sys cpu -- remove IOException"

This reverts commit 149e08c

* optimize FileWriteOutBytes to avoid high sys cpu -- avoid IOEception never thrown check

* Fix size counting to handle IOE in FileWriteOutBytes + tests

* remove unused throws IOException in WriteOutBytes.size()

* Remove redundant throws IOExcpetion clauses

* Parameterize IndexMergeBenchmark

Co-authored-by: huanghui.bigrey <huanghui.bigrey@bytedance.com>
Co-authored-by: Suneet Saldanha <suneet.saldanha@imply.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants