Skip to content

Allow user to set cost balancer threads more than or equal to the number of cores.#2964

Merged
himanshug merged 2 commits intoapache:masterfrom
metamx:multithreaded-costbalancer
May 13, 2016
Merged

Allow user to set cost balancer threads more than or equal to the number of cores.#2964
himanshug merged 2 commits intoapache:masterfrom
metamx:multithreaded-costbalancer

Conversation

@nishantmonu51
Copy link
Copy Markdown
Member

@nishantmonu51 nishantmonu51 commented May 13, 2016

Allow user to set cost balancer threads more than or equal to the number of cores.
FWIW, I am unable to set balancer threads to 4 on a machine having 2 cpu cores.

Allow user to set cost balancer threads more than the number of cores.
@nishantmonu51 nishantmonu51 reopened this May 13, 2016
@nishantmonu51 nishantmonu51 changed the title Allow user to set cost balancer threads more than the number of cores. Allow user to set cost balancer threads more than or equal to the number of cores. May 13, 2016
@xvrl
Copy link
Copy Markdown
Member

xvrl commented May 13, 2016

👍

@xvrl xvrl added this to the 0.9.1 milestone May 13, 2016
@himanshug
Copy link
Copy Markdown
Contributor

👍 for the code change
but wondering if it helps to have more threads than cores as compute cost appears to be cpu bound really?

@xvrl
Copy link
Copy Markdown
Member

xvrl commented May 13, 2016

@himanshug the current code caps at cores - 1, which is a problem for us when we have 2 cores

@xvrl
Copy link
Copy Markdown
Member

xvrl commented May 13, 2016

we currently spend most of our time doing those cost calculations, so being able to use all cores is beneficial

@himanshug
Copy link
Copy Markdown
Contributor

ok so you really want to set num to be equal to cores not more than that really, that makes sense.

@himanshug himanshug merged commit a9b721a into apache:master May 13, 2016
@drcrallen drcrallen deleted the multithreaded-costbalancer branch May 13, 2016 19:15
xvrl pushed a commit to metamx/druid that referenced this pull request May 18, 2016
…ber of cores. (apache#2964)

* Allow user to set cost balancer threads more than the number of cores.

Allow user to set cost balancer threads more than the number of cores.

* modify test
drcrallen added a commit to metamx/druid that referenced this pull request May 18, 2016
seoeun25 pushed a commit to seoeun25/incubator-druid that referenced this pull request Jan 10, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants