Skip to content

Add logging for sketches on workers#16697

Merged
LakshSingla merged 2 commits intoapache:masterfrom
adarshsanjeev:worker-sketch-logging
Jul 9, 2024
Merged

Add logging for sketches on workers#16697
LakshSingla merged 2 commits intoapache:masterfrom
adarshsanjeev:worker-sketch-logging

Conversation

@adarshsanjeev
Copy link
Copy Markdown
Contributor

Small PR to improve the logging of sketches on workers.

This function is already called on the controller to print information regarding the most downsampled sketches. This should give more information on the sketches being downsampled at a worker level.

@github-actions github-actions Bot added Area - Batch Ingestion Area - MSQ For multi stage queries - https://github.com/apache/druid/issues/12262 labels Jul 7, 2024
Copy link
Copy Markdown
Contributor

@LakshSingla LakshSingla left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The controller should also rely on the logSketches() method to explicitly log the sketches. Currently, it's done implicitly in generatePartitionsWithTargetWeight and generatePartitionsWithMaxCount.

@LakshSingla LakshSingla merged commit 7c62535 into apache:master Jul 9, 2024
@LakshSingla
Copy link
Copy Markdown
Contributor

Thanks for the patch!

sreemanamala pushed a commit to sreemanamala/druid that referenced this pull request Aug 6, 2024
Improve the logging of sketches on workers.
@kfaraz kfaraz added this to the 31.0.0 milestone Oct 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Area - Batch Ingestion Area - MSQ For multi stage queries - https://github.com/apache/druid/issues/12262

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants