Skip to content

Conversation

@hengfengli
Copy link
Contributor

This change removes the metadata table after the pipeline finishes. But note that if the pipeline is cancelled, the metadata table would not be deleted.

@thiagotnunes
Copy link
Contributor

retest this please

@hengfengli hengfengli changed the title [BEAM-12164]: remove the metadata table after the pipeline finishes for Spanner Change Streams Connector [BEAM-14185]: remove the metadata table after the pipeline finishes for Spanner Change Streams Connector Mar 28, 2022
Modifies integration test to check that metadata table is dropped in the
end of the execution of the SpannerIO.readChangeStream connector.
@thiagotnunes
Copy link
Contributor

retest this please

@thiagotnunes
Copy link
Contributor

Test failures are unrelated (BigQuery test)

@thiagotnunes
Copy link
Contributor

Run Java PostCommit

@thiagotnunes
Copy link
Contributor

Run Java PostCommit

1 similar comment
@pabloem
Copy link
Member

pabloem commented Mar 29, 2022

Run Java PostCommit

Disable flaky tests for SpannerIO.readChangeStream.
@thiagotnunes
Copy link
Contributor

Disabled flaky SpannerIO.readChangeStream tests. Created a ticket to re-enable them (https://issues.apache.org/jira/browse/BEAM-14195)

@thiagotnunes
Copy link
Contributor

R: @pabloem

@pabloem
Copy link
Member

pabloem commented Mar 29, 2022

LGTM

@pabloem pabloem merged commit 48557d0 into apache:master Mar 29, 2022
@thiagotnunes thiagotnunes deleted the remove-metadata-table branch March 29, 2022 05:52
youngoli pushed a commit to youngoli/beam that referenced this pull request Mar 30, 2022
…a table after the pipeline finishes for Spanner Change Streams Connector

[BEAM-14185]: remove the metadata table after the pipeline finishes for Spanner Change Streams Connector
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants