Skip to content

Do not emit metrics from integration testing client#17867

Merged
kfaraz merged 17 commits intoapache:masterfrom
kfaraz:fix_flaky_compaction_it
Apr 5, 2025
Merged

Do not emit metrics from integration testing client#17867
kfaraz merged 17 commits intoapache:masterfrom
kfaraz:fix_flaky_compaction_it

Conversation

@kfaraz
Copy link
Copy Markdown
Contributor

@kfaraz kfaraz commented Apr 3, 2025

Description

Standard ITs are full of messages like:

2025-04-02T19:03:50,395 INFO [MonitorScheduler-0] org.apache.druid.java.util.emitter.core.LoggingEmitter - {"feed":"metrics","metric":"jetty/numOpenConnections","service":"","host":"","value":0,"timestamp":"2025-04-02T19:03:50.395Z"}
2025-04-02T19:04:50,388 INFO [MonitorScheduler-0] org.apache.druid.java.util.emitter.core.LoggingEmitter - {"feed":"metrics","metric":"zk/connected","service":"","host":"","value":1,"timestamp":"2025-04-02T19:04:50.388Z"}

These messages never provide any useful info. Other than these, no other metrics are emitted
from the integration testing client. So we can just disable the metric emission for now.

Changes

  • Remove unused ZookeeperClient
  • Use NoopEmitter on the client side of standard ITs
  • Deserialize response of /compaction/status API into AutoCompactionSnapshot

@kfaraz kfaraz mentioned this pull request Apr 4, 2025
9 tasks
@kfaraz kfaraz closed this Apr 4, 2025
@kfaraz kfaraz reopened this Apr 4, 2025
@kfaraz
Copy link
Copy Markdown
Contributor Author

kfaraz commented Apr 4, 2025

Had a successful run: https://github.com/apache/druid/actions/runs/14258874576/job/39967371072

Re-triggered the tests.

@kfaraz kfaraz changed the title [WIP] Do not emit metrics from integration testing client Do not emit metrics from integration testing client Apr 4, 2025
@kfaraz
Copy link
Copy Markdown
Contributor Author

kfaraz commented Apr 4, 2025

Failed in the latest run due to some discrepancy in the compaction config.

@kfaraz
Copy link
Copy Markdown
Contributor Author

kfaraz commented Apr 4, 2025

Idenfied the source of flakiness and created PR #17877
Repurposed this PR for IT cleanup.

Copy link
Copy Markdown
Contributor

@Akshat-Jain Akshat-Jain left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Copy Markdown
Contributor

@capistrant capistrant left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm all for less verbose output 💯

@kfaraz
Copy link
Copy Markdown
Contributor Author

kfaraz commented Apr 5, 2025

Thanks for the reviews, @Akshat-Jain , @capistrant !

@kfaraz kfaraz merged commit 8c4ab96 into apache:master Apr 5, 2025
76 checks passed
@kfaraz kfaraz deleted the fix_flaky_compaction_it branch April 5, 2025 03:08
@capistrant capistrant added this to the 34.0.0 milestone Jul 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants