Reset sketch combiner in AggregatorCombiner#8368
Conversation
|
LGTM but build failure is genuine |
|
For context, #7329 could be used to test |
|
That's weird. I don't seem to hit this issue when I run the tests locally. Let me look into it. |
Coveralls errored with a -2.8% coverage decrease. This seems incorrect: only one line of prod code was changed, and there is a test for it. So I'll merge the patch anyway. |
|
@clintropolis Would it be worth calling this patch out in the Release Notes? It would be useful for the datasketch users to know that existing theta sketch aggregates generated with releases since 0.13.0 may be invalid and would have to be recomputed in 0.16.0 |
Yeah, I think so, I'll be sure to add mention of this, thanks! |
Fixes #7741
This PR fixes an issue where the
AggregateCombiner.reset()withinSketchAggregatorFactorydoes not clear the Sketch union object. As a result, during index merging if the sketches are empty for a set of rows to be combined, the combined sketch value from the previous set of merged rows would be reused in the current combine thereby corrupting the data.This PR has:
@leventov Please review.