Skip to content

Update docs for K8s TaskRunner Dynamic Config#16600

Merged
suneet-s merged 6 commits intoapache:masterfrom
suneet-s:k8s-docs
Jun 21, 2024
Merged

Update docs for K8s TaskRunner Dynamic Config#16600
suneet-s merged 6 commits intoapache:masterfrom
suneet-s:k8s-docs

Conversation

@suneet-s
Copy link
Copy Markdown
Contributor

@suneet-s suneet-s commented Jun 13, 2024

Description

Mostly a refactor of the docs added in #16510

While writing these docs, I realized that the use of a defaultKey in the dynamic config (that I suggested in the original patch) is not actually that helpful, so I removed it from the docs and the code.


This PR has:

  • been self-reviewed.
  • added documentation for new or modified features or behaviors.

Comment thread docs/development/extensions-contrib/k8s-jobs.md Outdated
@suneet-s
Copy link
Copy Markdown
Contributor Author

@YongGang fyi

Comment thread docs/development/extensions-contrib/k8s-jobs.md Outdated
Comment thread docs/development/extensions-contrib/k8s-jobs.md Outdated
Comment thread docs/development/extensions-contrib/k8s-jobs.md Outdated
Comment thread docs/development/extensions-contrib/k8s-jobs.md Outdated
Comment thread docs/development/extensions-contrib/k8s-jobs.md
Comment thread docs/development/extensions-contrib/k8s-jobs.md Outdated
Comment thread docs/development/extensions-contrib/k8s-jobs.md Outdated
Comment thread docs/development/extensions-contrib/k8s-jobs.md Outdated
Comment thread docs/development/extensions-contrib/k8s-jobs.md Outdated
Comment thread docs/development/extensions-contrib/k8s-jobs.md Outdated
@suneet-s
Copy link
Copy Markdown
Contributor Author

thanks for the reviews @vtlim @asdf2014 and @YongGang I believe this patch should have addressed all the comments

.orElse("base");

return templates.getOrDefault(templateKey, templates.get("base"));
PodTemplate podTemplate = templates.getOrDefault(templateKey, templates.get("base"));
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A non-null podTemplate will always be returned in this line of code as when loading templates it will make sure base template get configured here

match any selector in the list, it will use the `base` pod template.

For a task to match a selector, all the conditions within the selector must match. A selector can match on
- `type`: Type of the task
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- `type`: Type of the task
- `type`: Type of the task.

Copy link
Copy Markdown
Member

@vtlim vtlim left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding these docs! 🦖

|`SelectorBasedPodTemplateSelectStrategy`| This strategy evaluates a series of selectors, known as `selectors`, which are aligned with potential task properties. | false |
#### Pod template selection

The pod template adapapter can select which pod template should be used for a task using the [task runner execution config](#dynamic-config)
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
The pod template adapapter can select which pod template should be used for a task using the [task runner execution config](#dynamic-config)
The pod template adapter can select which pod template should be used for a task using the [task runner execution config](#dynamic-config)

Raised by spell checker

@suneet-s
Copy link
Copy Markdown
Contributor Author

Overruling CI because the k8s extension is not tested in these integration tests

@suneet-s suneet-s merged commit 4e0ea78 into apache:master Jun 21, 2024
@suneet-s suneet-s deleted the k8s-docs branch June 21, 2024 13:02
@kfaraz kfaraz added this to the 31.0.0 milestone Oct 4, 2024
FrankChen021 pushed a commit that referenced this pull request Feb 3, 2025
* Update docs for K8s TaskRunner Dynamic Config

* touchups

* code review

* npe

* oopsies
GabrielCWT pushed a commit to GabrielCWT/druid that referenced this pull request Sep 9, 2025
* Update docs for K8s TaskRunner Dynamic Config

* touchups

* code review

* npe

* oopsies
RonShub pushed a commit to singular-labs/druid that referenced this pull request Oct 19, 2025
* Update docs for K8s TaskRunner Dynamic Config

* touchups

* code review

* npe

* oopsies
RonShub pushed a commit to singular-labs/druid that referenced this pull request Oct 20, 2025
* Update docs for K8s TaskRunner Dynamic Config

* touchups

* code review

* npe

* oopsies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants