Skip to content

Conversation

@potiuk
Copy link
Member

@potiuk potiuk commented Jan 8, 2024

Previously we limited grpcio minimum version to stop backtracking of pip from happening and we could not do it in the limits of spark provider, becaue some google dependencies used it and conflicted with it. This problem is now gone as we have newer versions of google dependencies and we can not only safely move it to spark provider but also bump it slightly higher to limit the amount of backtracking we need to do.

Extracted from #36537


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

Previously we limited grpcio minimum version to stop backtracking
of `pip` from happening and we could not do it in the limits of
spark provider, becaue some google dependencies used it and
conflicted with it. This problem is now gone as we have newer
versions of google dependencies and we can not only safely move
it to spark provider but also bump it slightly higher to limit
the amount of backtracking we need to do.

Extracted from apache#36537
@potiuk potiuk merged commit ded01a5 into apache:main Jan 8, 2024
@potiuk potiuk deleted the bump-grcpio-status-min-version branch January 8, 2024 17:51
@potiuk potiuk added this to the Airflow 2.8.1 milestone Jan 13, 2024
@potiuk potiuk added the changelog:skip Changes that should be skipped from the changelog (CI, tests, etc..) label Jan 13, 2024
potiuk added a commit that referenced this pull request Jan 13, 2024
Previously we limited grpcio minimum version to stop backtracking
of `pip` from happening and we could not do it in the limits of
spark provider, becaue some google dependencies used it and
conflicted with it. This problem is now gone as we have newer
versions of google dependencies and we can not only safely move
it to spark provider but also bump it slightly higher to limit
the amount of backtracking we need to do.

Extracted from #36537

(cherry picked from commit ded01a5)
ephraimbuddy pushed a commit that referenced this pull request Jan 15, 2024
Previously we limited grpcio minimum version to stop backtracking
of `pip` from happening and we could not do it in the limits of
spark provider, becaue some google dependencies used it and
conflicted with it. This problem is now gone as we have newer
versions of google dependencies and we can not only safely move
it to spark provider but also bump it slightly higher to limit
the amount of backtracking we need to do.

Extracted from #36537

(cherry picked from commit ded01a5)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:dev-tools area:providers changelog:skip Changes that should be skipped from the changelog (CI, tests, etc..) provider:apache-spark

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants