The shuffle service has to ensure that all state is gracefully removed in case of released tasks, failures, etc. This behavior is already partially implemented in tests, e.g. test_delete_some_results This is part of https://github.com/dask/distributed/issues/6105 (basically problem 3.)