Skip to content

MSQ: Include worker context maps in WorkOrders.#17076

Merged
gianm merged 2 commits intoapache:masterfrom
gianm:msq-workorder-context-maps
Sep 17, 2024
Merged

MSQ: Include worker context maps in WorkOrders.#17076
gianm merged 2 commits intoapache:masterfrom
gianm:msq-workorder-context-maps

Conversation

@gianm
Copy link
Copy Markdown
Contributor

@gianm gianm commented Sep 16, 2024

This provides a mechanism to send contexts to workers in long-lived, shared JVMs that are not part of the task system.

This provides a mechanism to send contexts to workers in long-lived,
shared JVMs that are not part of the task system.
@github-actions github-actions Bot added Area - Batch Ingestion Area - MSQ For multi stage queries - https://github.com/apache/druid/issues/12262 labels Sep 16, 2024
@gianm gianm merged commit 2e4d596 into apache:master Sep 17, 2024
@gianm gianm deleted the msq-workorder-context-maps branch September 17, 2024 08:37
pranavbhole pushed a commit to pranavbhole/druid that referenced this pull request Sep 17, 2024
* MSQ: Include worker context maps in WorkOrders.

This provides a mechanism to send contexts to workers in long-lived,
shared JVMs that are not part of the task system.

* Style, coverage.
@kfaraz kfaraz added this to the 31.0.0 milestone Oct 4, 2024
kfaraz pushed a commit to kfaraz/druid that referenced this pull request Oct 4, 2024
* MSQ: Include worker context maps in WorkOrders.

This provides a mechanism to send contexts to workers in long-lived,
shared JVMs that are not part of the task system.

* Style, coverage.
kfaraz added a commit that referenced this pull request Oct 4, 2024
…) (#17074) (#17076) (#17077) (#17193) (#17243)

Backport the following patches for a clean backport of Dart changes
1. Add "targetPartitionsPerWorker" setting for MSQ. (#17048)
2. MSQ: Improved worker cancellation. (#17046)
3. Add "includeAllCounters()" to WorkerContext. (#17047)
4. MSQ: Include worker context maps in WorkOrders. (#17076)
5. TableInputSpecSlicer changes to support running on Brokers. (#17074)
6. Fix call to MemoryIntrospector in IndexerControllerContext. (#17066)
7. MSQ: Add QueryKitSpec to encapsulate QueryKit params. (#17077)
8. MSQ: Use task context flag useConcurrentLocks to determine task lock type (#17193)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Area - Batch Ingestion Area - MSQ For multi stage queries - https://github.com/apache/druid/issues/12262

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants