Skip to content

Conversation

@Lee-W
Copy link
Member

@Lee-W Lee-W commented Mar 20, 2024

Why

#37570 introduces an API endpoint for users to create a dataset event. However, these dataset events are not shown in Details on the web UI

What

This PR modifies the following to include the Dataset Events that do not have a source_dag_run attribute (created through RESTful API)

dataset_events = session.scalars(
select(DatasetEvent)
.join(
DagScheduleDatasetReference,
DatasetEvent.dataset_id == DagScheduleDatasetReference.dataset_id,
)
.join(DatasetEvent.source_dag_run)
.where(*dataset_event_filters)
).all()


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@boring-cyborg boring-cyborg bot added the area:Scheduler including HA (high availability) scheduler label Mar 20, 2024
@Lee-W Lee-W force-pushed the fix-missing-rest-api-dataset-event-in-grid-view branch 2 times, most recently from b003eda to 0418797 Compare March 21, 2024 07:08
@Lee-W Lee-W marked this pull request as ready for review March 21, 2024 07:18
@Lee-W Lee-W changed the title fix(dataset_event): retrieve dataset event created through RESTful API when creating dag run retrieve dataset event created through RESTful API when creating dag run Mar 21, 2024
@Lee-W Lee-W force-pushed the fix-missing-rest-api-dataset-event-in-grid-view branch from 47d9c09 to b2de05f Compare March 21, 2024 11:24
Lee-W added 2 commits March 21, 2024 19:56
…I when creating dag run

currently dataset event created throught RESTful API will be ignored as there's no source_dag_run atttribute
@phanikumv phanikumv force-pushed the fix-missing-rest-api-dataset-event-in-grid-view branch from b2de05f to 3927339 Compare March 21, 2024 14:26
@pankajkoti pankajkoti merged commit a1671f1 into apache:main Mar 21, 2024
@pankajkoti pankajkoti deleted the fix-missing-rest-api-dataset-event-in-grid-view branch March 21, 2024 15:44
@ephraimbuddy ephraimbuddy added the changelog:skip Changes that should be skipped from the changelog (CI, tests, etc..) label Mar 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:Scheduler including HA (high availability) scheduler changelog:skip Changes that should be skipped from the changelog (CI, tests, etc..)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants