Skip to content

Conversation

@dejii
Copy link
Contributor

@dejii dejii commented Oct 5, 2025

PubsubPullTrigger caught exceptions and yielded error events, creating unwanted DAG runs for asset watchers when exceptions are thrown in the trigger.

This fix is to let exceptions propagate to the triggerer framework, which handles them appropriately #54804 (comment)

  • Removed error handling from PubsubPullTrigger.run()
  • Added tests for exception scenarios

related: #54804

This fix also enables the Google Pub/Sub messaging queue feature #54494


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

@boring-cyborg boring-cyborg bot added area:providers provider:google Google (including GCP) related issues labels Oct 5, 2025
@jason810496 jason810496 self-requested a review October 5, 2025 01:36
Copy link
Member

@jason810496 jason810496 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice! Thanks for the PR!

Based on the context in the issue description, maybe we could create e issue for standardizing the TriggerEvent usage.

@dejii
Copy link
Contributor Author

dejii commented Oct 5, 2025

Nice! Thanks for the PR!

Based on the context in the issue description, maybe we could create e issue for standardizing the TriggerEvent usage.

I can create one – though I’m also wondering if this behavior was actually intended. Maybe once the issue is open, others can share their thoughts. This change will likely affect all triggers across all providers

@potiuk potiuk merged commit 02cea46 into apache:main Oct 21, 2025
80 checks passed
Jonpaco23 pushed a commit to Jonpaco23/airflow that referenced this pull request Oct 21, 2025
…ache#56400)

* fix: let PubsubPullTrigger exceptions propagate to triggerer framework

* revert break statement to return
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:providers provider:google Google (including GCP) related issues

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants