Skip to content

MINOR: improved exception/warn logging for stream-stream join store settings#13682

Closed
ableegoldman wants to merge 2 commits intoapache:trunkfrom
ableegoldman:MINOR-improve-assertWindowSettings-error-msg
Closed

MINOR: improved exception/warn logging for stream-stream join store settings#13682
ableegoldman wants to merge 2 commits intoapache:trunkfrom
ableegoldman:MINOR-improve-assertWindowSettings-error-msg

Conversation

@ableegoldman
Copy link
Copy Markdown
Member

@ableegoldman ableegoldman commented May 8, 2023

Trying to configure the underlying state stores in a join is pretty awkward, and getting all the parameters right can be particularly frustrating.

At a minimum, we should break up the verification into each individual check so that it's clear which step has failed. It would also help to actually include in the error message how to fix the store parameters to match what is expected, since this is not necessarily obvious -- for example, that retention period has to be exactly the sum of windowSize + gracePeriod, or that the store's windowSize is actually twice the value passed in to JoinWindows#of (or the newer JoinWindows#ofTimeDifferenceXXX APIs that replaced it)

@ableegoldman ableegoldman changed the title MINOR: improve error messages for join window store settings MINOR: improved exception/warn logging for stream-stream join store settings May 8, 2023
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we extract this and cherry-pick to 3.5 before the release goes out?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good point. Here: #13695

@mjsax mjsax added the streams label May 8, 2023
Copy link
Copy Markdown
Member

@mjsax mjsax left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR Sophie. LGTM.

@ableegoldman ableegoldman force-pushed the MINOR-improve-assertWindowSettings-error-msg branch from f63852b to 15e21f7 Compare May 10, 2023 20:44
Copy link
Copy Markdown
Contributor

@vamossagar12 vamossagar12 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hey @ableegoldman , thanks for the PR. I see it's already approved by Matthias. I had a small comment (you can ignore if it doesn't make sense)

throw new StreamsException(String.format(
"The StoreSupplier for join store %s must set supplier.windowSize = joinWindows.windowSize,"
+ " found supplier.windowSize = %d, joinWindows.size = %d",
supplier.name(), supplier.windowSize(), joinWindows.size()));
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ableegoldman , I am thinking if the exception message can be rephrased to something like =>
Incorrect value {} used for config {} for StoreSupplier for join store. The correct value should be {}. Do you think that sounds slightly more concise?

@github-actions
Copy link
Copy Markdown

This PR is being marked as stale since it has not had any activity in 90 days. If you would like to keep this PR alive, please ask a committer for review. If the PR has merge conflicts, please update it with the latest from trunk (or appropriate release branch)

If this PR is no longer valid or desired, please feel free to close it. If no activity occurrs in the next 30 days, it will be automatically closed.

@github-actions github-actions Bot added the stale Stale PRs label Aug 17, 2023
@github-actions
Copy link
Copy Markdown

github-actions Bot commented Jan 2, 2025

This PR has been closed since it has not had any activity in 120 days. If you feel like this
was a mistake, or you would like to continue working on it, please feel free to re-open the
PR and ask for a review.

@github-actions github-actions Bot added the closed-stale PRs that were closed due to inactivity label Jan 2, 2025
@github-actions github-actions Bot closed this Jan 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

closed-stale PRs that were closed due to inactivity stale Stale PRs streams

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants