Skip to content

Disable auto compaction config cleanup by default#12201

Merged
maytasm merged 1 commit intoapache:masterfrom
maytasm:disable-compaction-cleanup
Jan 27, 2022
Merged

Disable auto compaction config cleanup by default#12201
maytasm merged 1 commit intoapache:masterfrom
maytasm:disable-compaction-cleanup

Conversation

@maytasm
Copy link
Copy Markdown
Contributor

@maytasm maytasm commented Jan 25, 2022

Disable auto compaction config cleanup by default

Description

This revert part of the config change in #12188
Some user may have a work flow / script that create auto compaction config before the datasource is created. Hence, we should not turn the auto compaction config cleanup on by default as those config may get deleted unexpectedly.

This PR has:

  • been self-reviewed.
  • added documentation for new or modified features or behaviors.
  • added Javadocs for most classes and all non-trivial methods. Linked related entities via Javadoc links.
  • added or updated version, license, or notice information in licenses.yaml
  • added comments explaining the "why" and the intent of the code wherever would not be obvious for an unfamiliar reader.
  • added unit tests or modified existing tests to cover new code paths, ensuring the threshold for code coverage is met.
  • added integration tests.
  • been tested in a test Druid cluster.

Copy link
Copy Markdown
Contributor

@suneet-s suneet-s left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 Thanks for surfacing this use case. I hadn't considered the scenario where compaction configs are created before a datasource has any data

vtlim added a commit to vtlim/druid that referenced this pull request Jan 25, 2022
@maytasm maytasm merged commit fac6a48 into apache:master Jan 27, 2022
@maytasm maytasm deleted the disable-compaction-cleanup branch January 27, 2022 19:40
maytasm added a commit that referenced this pull request Jan 27, 2022
* doc updates for metadata storage/cleanup

* Add comments for disabling cleanup

* Apply suggestions from code review

* updated for #12201

* Apply suggestions from code review

Co-authored-by: Maytas Monsereenusorn <maytasm@apache.org>

* move retention period line earlier; more concise text

* fix typo

Co-authored-by: Maytas Monsereenusorn <maytasm@apache.org>
@abhishekagarwal87 abhishekagarwal87 added this to the 0.23.0 milestone May 11, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants