Skip to content

Conversation

@Lee-W
Copy link
Member

@Lee-W Lee-W commented Dec 25, 2023

While running a task in deferrable mode, the condition might already be met before we defer the task into the trigger. This PR intends to check the redshift cluster status before deferring the task to trigger.


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@boring-cyborg boring-cyborg bot added area:providers provider:amazon AWS/Amazon - related issues labels Dec 25, 2023
@Lee-W Lee-W changed the title Check cluster state before defer to triggerer Check redshift cluster state before deferring to triggerer Dec 25, 2023
@Lee-W Lee-W force-pushed the check-cluster-state-before-defer-to-triggerer branch from f52ba51 to a0a9cda Compare December 25, 2023 15:43
@Lee-W Lee-W force-pushed the check-cluster-state-before-defer-to-triggerer branch from 8abfc67 to d1e50b4 Compare December 26, 2023 11:12
@Lee-W Lee-W requested a review from pankajkoti December 28, 2023 02:09
@Lee-W Lee-W force-pushed the check-cluster-state-before-defer-to-triggerer branch from d1e50b4 to ad12d5c Compare December 28, 2023 02:32
@Lee-W Lee-W force-pushed the check-cluster-state-before-defer-to-triggerer branch 2 times, most recently from 0310ade to 40f8e08 Compare January 2, 2024 02:19
@vincbeck
Copy link
Contributor

vincbeck commented Jan 2, 2024

Same comment as #36523, I am not sure we want to do that

@Lee-W
Copy link
Member Author

Lee-W commented Jan 3, 2024

Same comment as #36523, I am not sure we want to do that

Replied in #36523 (comment)

@Lee-W Lee-W force-pushed the check-cluster-state-before-defer-to-triggerer branch from 40f8e08 to 07d21e7 Compare January 4, 2024 00:41
@Lee-W Lee-W force-pushed the check-cluster-state-before-defer-to-triggerer branch from 07d21e7 to d412b50 Compare January 6, 2024 03:26
@Lee-W
Copy link
Member Author

Lee-W commented Jan 6, 2024

@pankajkoti Please let me know if there's any other concern on this PR when you're available. Thanks!

@Lee-W Lee-W force-pushed the check-cluster-state-before-defer-to-triggerer branch from d412b50 to 28f4a03 Compare January 6, 2024 15:09
Copy link
Member

@pankajkoti pankajkoti left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think good to wait for another pair of eyes.

Copy link
Member

@potiuk potiuk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@potiuk potiuk merged commit 1d41fc7 into apache:main Jan 6, 2024
@Lee-W Lee-W deleted the check-cluster-state-before-defer-to-triggerer branch June 5, 2024 06:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:providers provider:amazon AWS/Amazon - related issues

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants