Skip to content

Log the reason for failure for BigQuery jobs #18419

@kennknowles

Description

@kennknowles

For BigQuery load jobs we currently retry few times and log the job ID.

It might be good to get the reason for the failure from BigQuery (prob. this is available through status poll) and log that as well. For example, failed load jobs are logged at following location.
https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/WriteTables.java#L202

Imported from Jira BEAM-2843. Original Jira may contain additional context.
Reported by: chamikara.

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions