Skip to content

Conversation

@uranusjr
Copy link
Member

@uranusjr uranusjr commented Dec 26, 2025

I started out trying to fix #59780 but ended up doing a big operation planned for later.

The original intention was to find a way to make #59780 pass all version combinations, but the provider tests have so many leftover quirks from before 3.0, I decided to take apart all of those instead, to keep the compat layer simpler and easier to understand. This also allows us to do a couple of long-waited cleanups in Core:

  1. RenderedTaskInstanceField no longer contains template rendering logic. After the 3.0 task runner implementation, this logic is no longer used anywhere (rendering is now done in the worker and sent via execution API to be stored literally instead). I removed the feature entirely, deleted a bunch of tests on it, and rewrote a number of provider tests so they render things properly.
  2. TaskInstance.render_templates() and TaskInstance.run() are removed. These are also never used in 3.x (they are re-implemented in the SDK on RuntimeTaskInstance), but a bunch of tests rely heavily on them. I created a helper module (test_utils.taskinstance) with free functions that implement a compat layer to be used in providers instead. This contributes to most changes in this PR.

This is a very big one, but should not be logically difficult to review. Just the same changes over and over again across all providers.

I want to also remove TaskInstance.get_template_context() after this is removed. That one is also never used in 3.x.

@uranusjr uranusjr added the full tests needed We need to run full set of tests for this PR to merge label Dec 26, 2025
@uranusjr uranusjr force-pushed the try-fix-priority-weight branch from db312d8 to af353e9 Compare December 26, 2025 22:27
@uranusjr uranusjr added the all versions If set, the CI build will be forced to use all versions of Python/K8S/DBs label Dec 26, 2025
@uranusjr uranusjr force-pushed the try-fix-priority-weight branch 3 times, most recently from b1471e5 to 10fad34 Compare December 27, 2025 10:09
@uranusjr uranusjr marked this pull request as draft December 27, 2025 10:10
@uranusjr uranusjr force-pushed the try-fix-priority-weight branch 5 times, most recently from 4c643c3 to 4c587bc Compare December 28, 2025 07:25
@uranusjr uranusjr force-pushed the try-fix-priority-weight branch 9 times, most recently from 10e9bd9 to a1553bc Compare December 28, 2025 13:53
@kaxil
Copy link
Member

kaxil commented Dec 29, 2025

#protm

@uranusjr uranusjr force-pushed the try-fix-priority-weight branch 2 times, most recently from 095d1f5 to e9c29f0 Compare December 29, 2025 16:37
Copy link
Member

@potiuk potiuk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. One small question - but I think it's more important to merge this one and fix any follow-ups later

@potiuk
Copy link
Member

potiuk commented Dec 29, 2025

I think some e2e (related) tests fail with this change:

Screenshot 2025-12-29 at 22 55 26

@uranusjr uranusjr force-pushed the try-fix-priority-weight branch from e9c29f0 to a227559 Compare December 30, 2025 05:57
@uranusjr uranusjr changed the title Try to set priority_weight unconditionally TaskInstance unused method cleanup Dec 30, 2025
@uranusjr uranusjr merged commit 960973b into apache:main Dec 30, 2025
209 checks passed
@uranusjr uranusjr deleted the try-fix-priority-weight branch December 30, 2025 07:30
Subham-KRLX pushed a commit to Subham-KRLX/airflow that referenced this pull request Jan 2, 2026
* Fix Pytest plugin

* Simplify serialized dag access

* Fix core test

* Replace ti.run() with test util

* Remove ti.render_templates() and clean up providers
stegololz pushed a commit to stegololz/airflow that referenced this pull request Jan 9, 2026
* Fix Pytest plugin

* Simplify serialized dag access

* Fix core test

* Replace ti.run() with test util

* Remove ti.render_templates() and clean up providers
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

all versions If set, the CI build will be forced to use all versions of Python/K8S/DBs full tests needed We need to run full set of tests for this PR to merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants