Skip to content

Conversation

@potiuk
Copy link
Member

@potiuk potiuk commented Mar 27, 2024

When running compatibility check of providers with airflow, we install airflow first (with constraints) and providers as the next step (without constraints). This might - in some cases lead to accidental upgrade of airflow if pip decides to do so.

By adding airflow package to the list of providers to install, we will keep it from being accidentally upgraded.


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@potiuk potiuk added canary When set on PR running from apache repo - behave as canary run all versions If set, the CI build will be forced to use all versions of Python/K8S/DBs labels Mar 27, 2024
@potiuk potiuk requested a review from ashb as a code owner March 27, 2024 20:41
@potiuk potiuk force-pushed the fix-broken-compatibility-check branch 2 times, most recently from 6acd515 to c1e39a2 Compare March 27, 2024 23:14
@potiuk
Copy link
Member Author

potiuk commented Mar 27, 2024

Turned out that the root cause of it was cohere provider that was already excluded for 3.8 but - because of limiting it to <5 in #38348 it needs "importlib_metadata" in a version that was not supported by airflow 2.6.0. So it looks like cohere will be >= 2.6.0 only for Python 3.10+. No big issue IMHO and we are going to soon update min airflow version to 2.7.0 so it is very temporary state.

When running compatibility check of providers with airflow, we install
airflow first (with constraints) and providers as the next step (without
constraints). This might - in some cases lead to accidental upgrade of
airflow if `pip` decides to do so.

By adding airflow package to the list of providers to install, we will
keep it from being accidentally upgraded.
@potiuk potiuk force-pushed the fix-broken-compatibility-check branch from c1e39a2 to 3b5cc36 Compare March 27, 2024 23:29
@potiuk potiuk added this to the Airflow 2.9.0 milestone Mar 27, 2024
@potiuk potiuk merged commit c855f1f into main Mar 28, 2024
@ephraimbuddy ephraimbuddy added the changelog:skip Changes that should be skipped from the changelog (CI, tests, etc..) label Mar 31, 2024
ephraimbuddy pushed a commit that referenced this pull request Mar 31, 2024
When running compatibility check of providers with airflow, we install
airflow first (with constraints) and providers as the next step (without
constraints). This might - in some cases lead to accidental upgrade of
airflow if `pip` decides to do so.

By adding airflow package to the list of providers to install, we will
keep it from being accidentally upgraded.

(cherry picked from commit c855f1f)
@potiuk potiuk deleted the fix-broken-compatibility-check branch October 1, 2024 08:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

all versions If set, the CI build will be forced to use all versions of Python/K8S/DBs area:dev-tools canary When set on PR running from apache repo - behave as canary run changelog:skip Changes that should be skipped from the changelog (CI, tests, etc..)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants