Skip to content

Conversation

@Taragolis
Copy link
Contributor

closes: #35034

Default method which we use for upload files into the slack might failed with timeout error or gateway errors in case of upload huge files, for resolve this implement optional ability to switch to client.files_upload_v2 which should resolve this issue.

Unfortunetly it is not 100% builtin replacement and required some changes in scope of application, so I keep v1 (client.files_upload) as default when we consider to bump major version we also could switch default uploader method.

In addition some minor (or not) changes into the execute method signature, which doesn't follow BaseOperator signature


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

Copy link
Contributor

@eladkal eladkal left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@eladkal eladkal merged commit 9758acf into apache:main Jan 20, 2024
potiuk pushed a commit that referenced this pull request Feb 7, 2024
* Optionally use `client.files_upload_v2` in Slack Provider

* Revert  default value for method

* Remove redundand assigment

(cherry picked from commit 9758acf)
@potiuk potiuk added the changelog:skip Changes that should be skipped from the changelog (CI, tests, etc..) label Feb 8, 2024
@potiuk potiuk added this to the Airflow 2.8.2 milestone Feb 8, 2024
ephraimbuddy pushed a commit that referenced this pull request Feb 22, 2024
* Optionally use `client.files_upload_v2` in Slack Provider

* Revert  default value for method

* Remove redundand assigment

(cherry picked from commit 9758acf)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:providers area:system-tests changelog:skip Changes that should be skipped from the changelog (CI, tests, etc..) kind:documentation provider:slack

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Implement files_upload_v2 in Slack Provider

3 participants