Fix scheduler transition error on memory->erred
#8549
Conversation
| assert ts.exception_blame | ||
| assert not ts.who_has | ||
| assert not ts.waiting_on | ||
| assert not ts.waiters |
There was a problem hiding this comment.
This assertion does not work in two-step transitions.
Unit Test ResultsSee test report for an extended history of previous test failures. This is useful for diagnosing flaky tests. 27 files + 1 27 suites +1 10h 8m 49s ⏱️ + 47m 57s For more details on these failures, see this check. Results for commit 449f447. ± Comparison against base commit e16a7af. ♻️ This comment has been updated with latest results. |
| ) | ||
|
|
||
| v = a_recs.get(key, finish) | ||
| # The inner rec has higher priority? Is that always desired? |
There was a problem hiding this comment.
I don't get this comment?
There was a problem hiding this comment.
This is a general comment about the two-step transitions. The recommendations created by the first step are executed before the second step, which may create weird state (as it did in this case).
| if dts.state == "erred": | ||
| # Does this make sense? | ||
| # This goes via released | ||
| # dts -> released -> waiting |
There was a problem hiding this comment.
Agree this makes no sense to me either. Is there a unit test anywhere to shed light on it?
There was a problem hiding this comment.
I haven't investigated this any further.
distributed/scheduler.py
Outdated
| self, | ||
| key: Key, | ||
| stimulus_id: str, | ||
| worker: str | None = None, |
There was a problem hiding this comment.
How can a task be processing without a worker? Is it when the worker it was processing on died and it caused the task to increase its suspicious count too much? If so, it may be a good idea to note it in a comment?
There was a problem hiding this comment.
It appears that this has been superseded by other changes in this PR. I'll remove it and see if CI complains.
Co-authored-by: crusaderky <crusaderky@gmail.com>
Co-authored-by: crusaderky <crusaderky@gmail.com>
Co-authored-by: crusaderky <crusaderky@gmail.com>
|
@crusaderky: All comments have been addressed. |
distributed/scheduler.py
Outdated
| if worker: | ||
| ts.erred_on.add(worker) |
There was a problem hiding this comment.
I think the type in the function declaration should change to worker: str | None?
There was a problem hiding this comment.
My bad, I didn't clean this up properly.
Co-authored-by: crusaderky <crusaderky@gmail.com>
Co-authored-by: crusaderky <crusaderky@gmail.com>
|
LGTM, however I have no idea if there are any regressions. |
2 participants
Closes #8548
pre-commit run --all-files