Skip to content

Druid 30.0.0 release notes#16412

Merged
cryptoe merged 14 commits intoapache:30.0.0from
ektravel:30.0.0-release-notes
May 27, 2024
Merged

Druid 30.0.0 release notes#16412
cryptoe merged 14 commits intoapache:30.0.0from
ektravel:30.0.0-release-notes

Conversation

@ektravel
Copy link
Copy Markdown
Contributor

@ektravel ektravel commented May 7, 2024

Release and upgrade notes for Druid 30.0.0

This PR has:

  • been self-reviewed

@317brian 317brian added this to the 30.0.0 milestone May 8, 2024
@ektravel ektravel marked this pull request as ready for review May 8, 2024 19:44
Copy link
Copy Markdown
Member

@asdf2014 asdf2014 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, also left some comments here

Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
@ektravel ektravel changed the title Druid 30.0.0 release notes - WIP Druid 30.0.0 release notes May 10, 2024
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md
Copy link
Copy Markdown
Contributor

@kfaraz kfaraz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left some suggestions.

Review of release notes for PR #15817 is still pending.

Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
Comment thread docs/release-info/release-notes.md Outdated
@LakshSingla
Copy link
Copy Markdown
Contributor

@ektravel I don't see the changes introduced by this PR #16322 in the release notes. It should be added in SQL-based Ingestion/Querying.
The functionality added by this is:
a. It allows the MSQ engine to sort complex columns.
b. It allows the MSQ engine to group on complex columns (we might omit if it has been iterated already)
c. It allows the MSQ engine to roll up on supported complex columns (JSON columns are the only columns supported for this atm).


#### Selective loading of lookups

Druid now supports selective loading of lookups in the task layer.
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Druid now supports selective loading of lookups in the task layer.
We have built the foundation of selective lookup loading. As part of enabling this, `KillUnusedSegmentsTask` does not load lookups.


This section contains important information about new and existing features.

### Improved native queries
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IMO we should explicitly mention "Support grouping on complex columns and nested arrays"

Comment thread docs/release-info/release-notes.md Outdated

### Improved native queries

Native queries can now group on nested columns and arrays.
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Native queries can now group on nested columns and arrays.
Native queries can now group on supported complex columns and nested arrays.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is it possible to expand upon the feature a bit more - maybe we can add an example and an image.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should mention that rollup on complex columns is supported via MSQ, and the possible advantages of doing so. I think we can combine it in the same section.

@cryptoe cryptoe merged commit 00f91af into apache:30.0.0 May 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

10 participants