Skip to content

optionally dump list of segment-ids used to process the query#3322

Closed
himanshug wants to merge 1 commit intoapache:masterfrom
himanshug:dump_segment_list
Closed

optionally dump list of segment-ids used to process the query#3322
himanshug wants to merge 1 commit intoapache:masterfrom
himanshug:dump_segment_list

Conversation

@himanshug
Copy link
Copy Markdown
Contributor

"/druid/v3" introduced in #3319 can handle larger context objects.

enabled by "dumpSegmentList" flag in the query context.

having the list of all segment-ids returned to user has 2 primary use-cases.

  1. user can see exactly what timelines were found and not found, accordingly user can choose to use the result or error out or appropriately adjust the visualization.
  2. some users have caches on top of druid that cache whole query results, they can use a hash of segments used in the cache key. users typically get the list of loaded segments from coordinator HTTP endpoints (or segment metadata query) and based on that they can check whether to use cached result or not.

i'm leaving this option undocumented intentionally for now as it should only be used with "/druid/v3" really.

@himanshug
Copy link
Copy Markdown
Contributor Author

@cheddar has reservations against exposing this information and believes that "cache" use case should be solved by druid itself, I'm going to check enabling "result" level instead of "segment" level cache on druid brokers itself.

@himanshug himanshug closed this Aug 4, 2016
seoeun25 pushed a commit to seoeun25/incubator-druid that referenced this pull request Feb 25, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant