Skip to content

Conversation

@vatsrahul1001
Copy link
Contributor

@vatsrahul1001 vatsrahul1001 commented Feb 3, 2025

closes:#46188
depends: #46295

API request with the logical date as null

image

API request with the logical date as not null
image


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

vatsrahul1001 and others added 28 commits January 29, 2025 14:44
…stronomer/airflow into restore-unique-constraint-logical-date
…stronomer/airflow into restore-unique-constraint-logical-date
…stronomer/airflow into refactor-backfill-reprocess-logic
…omer/airflow into refactor-backfill-reprocess-logic
vatsrahul1001 and others added 3 commits February 7, 2025 14:19
… of github.com:astronomer/airflow into make-logical-date-as-required-field-to-trigger-dag-api
Copy link
Member

@pierrejeambrun pierrejeambrun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking good from the AIP stand point.

Logic looks good too but I would be more confortable if some AIP-83 owner could double check.

cc: @dstandish @uranusjr

I think we need to wait for #46398 before merging so we don't have to create a new PR afterwards.

Copy link
Collaborator

@sunank200 sunank200 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

Copy link
Member

@uranusjr uranusjr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Almost good, just one question on removed run_id logic.

@vatsrahul1001
Copy link
Contributor Author

Almost good, just one question on removed run_id logic.

Replied here

@vatsrahul1001
Copy link
Contributor Author

@uranusjr I was testing this and found that the DAG run is being inserted into the dagrun table with a None logical date, but it remains in the queued state.

@vatsrahul1001
Copy link
Contributor Author

vatsrahul1001 commented Feb 10, 2025

@uranusjr I was testing this and found that the DAG run is being inserted into the dagrun table with a None logical date, but it remains in the queued state.

This would be fixed bt @Lee-W in #46460

@vatsrahul1001 vatsrahul1001 requested a review from Lee-W February 10, 2025 14:47
@Lee-W
Copy link
Member

Lee-W commented Feb 10, 2025

@uranusjr I was testing this and found that the DAG run is being inserted into the dagrun table with a None logical date, but it remains in the queued state.

This would be fixed bt @wei in #46460

ah... my ID is Lee-W

Co-authored-by: Wei Lee <weilee.rx@gmail.com>
@uranusjr uranusjr merged commit aa6f76c into apache:main Feb 10, 2025
45 checks passed
@uranusjr uranusjr deleted the make-logical-date-as-required-field-to-trigger-dag-api branch February 10, 2025 16:41
ambika-garg pushed a commit to ambika-garg/airflow that referenced this pull request Feb 17, 2025
…API (apache#46390)

* restore unique constraint on logical date and make it nullable

* restore unique constraint on logical date and make it nullable

* fix migration file

* fix migration file

* refactor backfill reprocess logic

* fixing tests

* fix tests

* remove default date from logical date in dag run model

* fix task_filter

* fix failing tests

* make logical date as required field

* refactor

* remove backfill related changes

* implement review comments

* add time now to var

* fix tests

* fix review comments

* Update tests/api_fastapi/core_api/routes/public/test_dag_run.py

Co-authored-by: Wei Lee <weilee.rx@gmail.com>

---------

Co-authored-by: Wei Lee <weilee.rx@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

AIP-83 Remove Execution Date Unique Constraint from DAG Run area:db-migrations PRs with DB migration area:UI Related to UI/UX. For Frontend Developers. area:webserver Webserver related Issues kind:documentation

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

7 participants