Skip to content

Conversation

@amoghrajesh
Copy link
Contributor

@amoghrajesh amoghrajesh commented Jun 3, 2025

closes: #51337

Usage of async fixtures with pytest 8.4.0 has changed as mentioned here: https://github.com/pytest-dev/pytest/releases and is generally a problem for autouse fixtures. mock_aws was one such one of them leading to issues like:

E       fixture 'patch_hook' not found
>       available fixtures: _clear_db, _disable_redact, _mock_plugins, ...

Moving the async decorator out of the fixture to keep it independent.

  • The patch_hook fixture creates a boto3 client which needed aws clieng to be mocked
  • When the decorator was on the fixture, pytest 8.4.0 had issues finding/resolving the fixture
  • By moving @mock_aws to the test class, the AWS mocking is active for everything inside the class, including when fixtures are being resolvez
  • Also we separate fixture definition and patching of conf vars in the AWS test classes.

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

@amoghrajesh amoghrajesh changed the title Allow migration to pytest 8.4.0 Allow test migration to pytest 8.4.0 Jun 3, 2025
@potiuk
Copy link
Member

potiuk commented Jun 3, 2025

Doc failures unrelated

@potiuk potiuk added the backport-to-v3-1-test Mark PR with this label to backport to v3-1-test branch label Jun 3, 2025
@potiuk potiuk added this to the Airflow 3.0.2 milestone Jun 3, 2025
@potiuk potiuk merged commit be59eda into apache:main Jun 3, 2025
95 of 97 checks passed
@github-actions
Copy link

github-actions bot commented Jun 3, 2025

Backport failed to create: v3-0-test. View the failure log Run details

Status Branch Result
v3-0-test Commit Link

You can attempt to backport this manually by running:

cherry_picker be59eda v3-0-test

This should apply the commit to the v3-0-test branch and leave the commit in conflict state marking
the files that need manual conflict resolution.

After you have resolved the conflicts, you can continue the backport process by running:

cherry_picker --continue

potiuk added a commit to potiuk/airflow that referenced this pull request Jun 3, 2025
* Allow migration to pytest 8.4.0

* fixup! Allow migration to pytest 8.4.0

---------

Co-authored-by: Jarek Potiuk <jarek@potiuk.com>
(cherry picked from commit be59eda)
potiuk added a commit to potiuk/airflow that referenced this pull request Jun 3, 2025
* Allow migration to pytest 8.4.0

* fixup! Allow migration to pytest 8.4.0

---------
(cherry picked from commit be59eda)

Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
Co-authored-by: Jarek Potiuk <jarek@potiuk.com>
potiuk added a commit to potiuk/airflow that referenced this pull request Jun 3, 2025
* Allow migration to pytest 8.4.0

* fixup! Allow migration to pytest 8.4.0

---------
(cherry picked from commit be59eda)

Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
Co-authored-by: Jarek Potiuk <jarek@potiuk.com>
potiuk added a commit that referenced this pull request Jun 3, 2025
* Allow migration to pytest 8.4.0

* fixup! Allow migration to pytest 8.4.0

---------
(cherry picked from commit be59eda)

Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
kaxil pushed a commit that referenced this pull request Jun 3, 2025
* Allow migration to pytest 8.4.0

* fixup! Allow migration to pytest 8.4.0

---------
(cherry picked from commit be59eda)

Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
kaxil added a commit that referenced this pull request Jun 3, 2025
…#51306) (#51313)

* Add Release notes for 3.0.2

* [v3-0-test] Allow test migration to pytest 8.4.0 (#51349) (#51359)

* Allow migration to pytest 8.4.0

* fixup! Allow migration to pytest 8.4.0

---------
(cherry picked from commit be59eda)

Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>

* [v3-0-test] Bump structlog min to 25.4.0 and handle tests accordingly (#51306)
(cherry picked from commit be50a01)

Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>

---------

Co-authored-by: Kaxil Naik <kaxilnaik@gmail.com>
Co-authored-by: Jarek Potiuk <jarek@potiuk.com>
Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
potiuk added a commit to potiuk/airflow that referenced this pull request Jun 3, 2025
Follow-up after apache#51349 - merged after the fix for 8.4.0
kaxil pushed a commit that referenced this pull request Jun 3, 2025
* Allow migration to pytest 8.4.0

* fixup! Allow migration to pytest 8.4.0

---------
(cherry picked from commit be59eda)

Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
kaxil added a commit that referenced this pull request Jun 3, 2025
…#51306) (#51313)

* Add Release notes for 3.0.2

* [v3-0-test] Allow test migration to pytest 8.4.0 (#51349) (#51359)

* Allow migration to pytest 8.4.0

* fixup! Allow migration to pytest 8.4.0

---------
(cherry picked from commit be59eda)

Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>

* [v3-0-test] Bump structlog min to 25.4.0 and handle tests accordingly (#51306)
(cherry picked from commit be50a01)

Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>

---------

Co-authored-by: Kaxil Naik <kaxilnaik@gmail.com>
Co-authored-by: Jarek Potiuk <jarek@potiuk.com>
Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
potiuk added a commit to potiuk/airflow that referenced this pull request Jun 3, 2025
Follow-up after apache#51349 - merged after the fix for 8.4.0
potiuk added a commit that referenced this pull request Jun 3, 2025
Follow-up after #51349 - merged after the fix for 8.4.0
kaxil pushed a commit that referenced this pull request Jun 3, 2025
* Allow migration to pytest 8.4.0

* fixup! Allow migration to pytest 8.4.0

---------
(cherry picked from commit be59eda)

Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
kaxil added a commit that referenced this pull request Jun 3, 2025
…#51306) (#51313)

* Add Release notes for 3.0.2

* [v3-0-test] Allow test migration to pytest 8.4.0 (#51349) (#51359)

* Allow migration to pytest 8.4.0

* fixup! Allow migration to pytest 8.4.0

---------
(cherry picked from commit be59eda)

Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>

* [v3-0-test] Bump structlog min to 25.4.0 and handle tests accordingly (#51306)
(cherry picked from commit be50a01)

Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>

---------

Co-authored-by: Kaxil Naik <kaxilnaik@gmail.com>
Co-authored-by: Jarek Potiuk <jarek@potiuk.com>
Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
sanederchik pushed a commit to sanederchik/airflow that referenced this pull request Jun 7, 2025
* Allow migration to pytest 8.4.0

* fixup! Allow migration to pytest 8.4.0

---------

Co-authored-by: Jarek Potiuk <jarek@potiuk.com>
sanederchik pushed a commit to sanederchik/airflow that referenced this pull request Jun 7, 2025
potiuk added a commit to potiuk/airflow that referenced this pull request Jun 15, 2025
* Allow migration to pytest 8.4.0

* fixup! Allow migration to pytest 8.4.0

---------
(cherry picked from commit be59eda)

Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
Co-authored-by: Jarek Potiuk <jarek@potiuk.com>
potiuk added a commit to potiuk/airflow that referenced this pull request Jun 15, 2025
* Allow migration to pytest 8.4.0

* fixup! Allow migration to pytest 8.4.0

---------
(cherry picked from commit be59eda)

Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
Co-authored-by: Jarek Potiuk <jarek@potiuk.com>
potiuk added a commit that referenced this pull request Jun 15, 2025
* Allow migration to pytest 8.4.0

* fixup! Allow migration to pytest 8.4.0

---------
(cherry picked from commit be59eda)

Co-authored-by: Amogh Desai <amoghrajesh1999@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:dev-tools area:providers backport-to-v3-1-test Mark PR with this label to backport to v3-1-test branch provider:amazon AWS/Amazon - related issues

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Fix failing tests to work with PyTest 8.4.0

2 participants