Google Cloud Transfer operators: add an operator to run a transfer job

[abhinavraj23]

Description

For the airflow operators made corresponding to google cloud storage transfer service, there isn't any operator available to directly run a pre-configured transfer job. The storage transfer service provides the API for this use case, here the link to the API. Corresponding to this API an operator can be added to cloud_storage_transfer_service.py

Use case/motivation

There's a quota limit in transfer job creation, which is that one can only create at max 1000 transfer job/day, but there isn't any quota on running an already created transfer job, in such a case updating a preconfigured transfer job and running it would be a recurring use case for data pipelines and thus this operator would be helpful

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[boring-cyborg]

Thanks for opening your first issue here! Be sure to follow the issue template!

[potiuk]

Feel free.

[mandoolala]

@abhinavraj23 are you willing to submit a PR?

[tainangao]

I'd like to work on this issue. Can I submit a PR?

[boraberke]

Hi,

I have implemented a basic operator named CloudDataTransferServiceRunJobOperator in #39154. It might be also useful to add a sensor CloudDataTransferServiceRunJobSensor similar to BigQueryDataTransferServiceTransferRunSensor so that this job can be polled after triggered.

What do you think?