Skip to content

Conversation

@potiuk
Copy link
Member

@potiuk potiuk commented Jul 2, 2025

We started to copy more and more code from breeze utils to the constraint generation script - including using github token for pulling constraints files, reading python version, running command etc - so it's now the time to move the constraint check to become a regular breeze command and import utils from breeze utils.

We are running the command in the CI image which has both advantages and disadvantages - it's a bit slower and requires the CI image to be built for the right Python version but it makes sure that the outputs are reproducible across different OS's and system libraries.


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

@boring-cyborg boring-cyborg bot added area:dev-tools backport-to-v3-1-test Mark PR with this label to backport to v3-1-test branch labels Jul 2, 2025
@potiuk potiuk requested a review from bugraoz93 July 2, 2025 09:51
@potiuk potiuk added the upgrade to newer dependencies If set, upgrade to newer dependencies is forced label Jul 2, 2025
@potiuk potiuk force-pushed the move-constraints-check-to-breeze branch from 00c1937 to 02a1099 Compare July 2, 2025 09:52
@potiuk potiuk requested a review from eladkal July 2, 2025 10:05
@potiuk potiuk force-pushed the move-constraints-check-to-breeze branch from 02a1099 to 4e74276 Compare July 2, 2025 10:43
@potiuk
Copy link
Member Author

potiuk commented Jul 2, 2025

Also this one will fix v3-0-test failures when cherry-picked (because Python version mismatch between those two branches - one of the main motivators to move it to breeze because with breeze we have built-in "per-branch" python version selection

We started to copy more and more code from breeze utils to the
constraint generation script - including using github token for
pulling constraints files, reading python version, running command
etc - so it's now the time to move the constraint check to become
a regular breeze command and import utils from breeze utils.

We are running the command in the CI image which has both
advantages and disadvantages - it's a bit slower and requires
the CI image to be built for the right Python version but it
makes sure that the outputs are reproducible across different
OS's and system libraries.
@potiuk potiuk force-pushed the move-constraints-check-to-breeze branch from 4e74276 to 49f39f4 Compare July 2, 2025 10:56
@potiuk potiuk merged commit 906da03 into apache:main Jul 2, 2025
103 checks passed
@potiuk potiuk deleted the move-constraints-check-to-breeze branch July 2, 2025 14:25
@potiuk
Copy link
Member Author

potiuk commented Jul 2, 2025

Really nice reports !

github-actions bot pushed a commit that referenced this pull request Jul 2, 2025
We started to copy more and more code from breeze utils to the
constraint generation script - including using github token for
pulling constraints files, reading python version, running command
etc - so it's now the time to move the constraint check to become
a regular breeze command and import utils from breeze utils.

We are running the command in the CI image which has both
advantages and disadvantages - it's a bit slower and requires
the CI image to be built for the right Python version but it
makes sure that the outputs are reproducible across different
OS's and system libraries.
(cherry picked from commit 906da03)

Co-authored-by: Jarek Potiuk <jarek@potiuk.com>
@github-actions
Copy link

github-actions bot commented Jul 2, 2025

Backport successfully created: v3-0-test

Status Branch Result
v3-0-test PR Link

potiuk added a commit that referenced this pull request Jul 2, 2025
We started to copy more and more code from breeze utils to the
constraint generation script - including using github token for
pulling constraints files, reading python version, running command
etc - so it's now the time to move the constraint check to become
a regular breeze command and import utils from breeze utils.

We are running the command in the CI image which has both
advantages and disadvantages - it's a bit slower and requires
the CI image to be built for the right Python version but it
makes sure that the outputs are reproducible across different
OS's and system libraries.
(cherry picked from commit 906da03)

Co-authored-by: Jarek Potiuk <jarek@potiuk.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:dev-tools backport-to-v3-1-test Mark PR with this label to backport to v3-1-test branch upgrade to newer dependencies If set, upgrade to newer dependencies is forced

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants