Skip to content

Conversation

@yahoNanJing
Copy link
Contributor

@yahoNanJing yahoNanJing commented Mar 14, 2022

Which issue does this PR close?

Closes #2005 .

Rationale for this change

What changes are included in this PR?

  1. For the first bug:
    We should make sure the returned available_executors should be all with available_task_slots > 0.

  2. For the second bug:
    We should use update_executor_data rather than save_executor_data to update executors' available_task_slots.

Are there any user-facing changes?

return Ok(Some(SchedulerServerEvent::JobSubmitted(job_id)));
}

let mut executors_delta_data: Vec<ExecutorDeltaData> = available_executors
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

executors_delta_data is confused for me, because this just clone/copy some attributes from available_executors

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ResourceChange or SlotsChange probably?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed

Copy link
Contributor

@liukun4515 liukun4515 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LTGM
except for some naming

@yjshen yjshen merged commit 15526f9 into apache:master Mar 16, 2022
@yjshen
Copy link
Member

yjshen commented Mar 16, 2022

Thanks @yahoNanJing @liukun4515

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Ballista] Load testing for Push-based task scheduling get stuck

3 participants