Skip to content

Databricks hook: Retry also on HTTP Status 429 - rate limit exceeded #21559

@alexott

Description

@alexott

Apache Airflow Provider(s)

databricks

Versions of Apache Airflow Providers

2.2.0

Apache Airflow version

2.2.3 (latest released)

Operating System

Any

Deployment

Other

Deployment details

No response

What happened

Operations aren't retried when Databricks API returns HTTP Status 429 - rate limit exceeded

What you expected to happen

the operation should retry

How to reproduce

this happens when you have multiple calls to API, especially when it happens outside of Airflow

Anything else

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions