Skip to content

Conversation

@e-galan
Copy link
Contributor

@e-galan e-galan commented Jul 8, 2024

Fix the default value setting for the job_name in DataflowConfiguration class.

The previous default value attempted to use Airflow templating features, which didn't work because the default value was never calculated on the DAG level. This caused some of the system tests to fail.

This PR should address #40515
fixes: #40515


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@boring-cyborg boring-cyborg bot added area:providers area:system-tests provider:google Google (including GCP) related issues labels Jul 8, 2024
@e-galan e-galan closed this Jul 8, 2024
@e-galan e-galan reopened this Jul 8, 2024
@e-galan e-galan marked this pull request as draft July 8, 2024 08:21
@e-galan e-galan changed the title Update default job_name value in DataflowConfiguration, fix dataflow_native_java test Update default value for job_name in DataflowConfiguration Jul 9, 2024
@e-galan e-galan marked this pull request as ready for review July 9, 2024 07:51
@e-galan e-galan marked this pull request as draft July 11, 2024 11:40
@e-galan e-galan marked this pull request as ready for review July 11, 2024 12:23
@e-galan e-galan marked this pull request as draft July 11, 2024 12:45
@e-galan e-galan force-pushed the fix-apache-beam-dict-config branch from 02722d6 to 5815ebc Compare July 11, 2024 15:02
@e-galan e-galan marked this pull request as ready for review July 11, 2024 15:04
@e-galan
Copy link
Contributor Author

e-galan commented Jul 16, 2024

Hi @potiuk , @eladkal ! Could you have a look at the PR?

@eladkal eladkal merged commit 519b0d0 into apache:main Jul 16, 2024
romsharon98 pushed a commit to romsharon98/airflow that referenced this pull request Jul 26, 2024
)

Co-authored-by: Ryan Hatter <25823361+RNHTTR@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:providers area:system-tests provider:google Google (including GCP) related issues

Projects

None yet

Development

Successfully merging this pull request may close these issues.

BeamRunJavaPipelineOperator fails without job_name set

4 participants