Skip to content

Conversation

@Technoboy-
Copy link
Contributor

Cherry pick #11293

Motivation

The Debezium requires pulsar a service URL for history database usage.

In #11056 , the service.url field from PulsarKafkaWorkerConfig is no longer available. And the value is also deleted from multiple yaml config files in this commit. This causes the integration test for Debezium connector to fail.

Based on the Debezium paradigm, all configurations should be passed as strings. There's no easy way to inject a PulsarClient via configuration.

We need to ask user to provide the pulsar url explicitly and probably auth info also.

Modifications

Make the database.history.pulsar.service.url field required
Add the config value back to example yaml files
Update the integration test config

@Technoboy-
Copy link
Contributor Author

This pr is a little different with the original one.
Original SourceContext extends ConnectorContext
But this or make it extends : SourceContext extends Context

@Technoboy- Technoboy- changed the title [Cherry-pick] Pass client builder to debezium database history [Cherry-pick & WIP] Pass client builder to debezium database history Sep 21, 2021
Copy link
Contributor

@eolivelli eolivelli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@Technoboy-
Copy link
Contributor Author

/pulsarbot run-failure-checks

@Anonymitaet Anonymitaet added the doc-not-needed Your PR changes do not impact docs label Sep 22, 2021
@Technoboy- Technoboy- changed the title [Cherry-pick & WIP] Pass client builder to debezium database history [Cherry-pick] Pass client builder to debezium database history Sep 24, 2021
@Technoboy-
Copy link
Contributor Author

/pulsarbot run-failure-checks

1 similar comment
@Technoboy-
Copy link
Contributor Author

/pulsarbot run-failure-checks

@codelipenghui codelipenghui merged commit ed771af into apache:branch-2.8 Jan 25, 2022
@codelipenghui codelipenghui added cherry-picked/branch-2.9 Archived: 2.9 is end of life cherry-picked/branch-2.8 Archived: 2.8 is end of life and removed cherry-picked/branch-2.9 Archived: 2.9 is end of life labels Jan 25, 2022
@Technoboy- Technoboy- deleted the cherry-pick-11293 branch August 10, 2022 05:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/connector cherry-picked/branch-2.8 Archived: 2.8 is end of life doc-not-needed Your PR changes do not impact docs release/2.8.3

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants