Skip to content

[Feature] kafka_sync_database supports whitelist and blacklsit of database. #4722

@JackeyLee007

Description

@JackeyLee007

Search before asking

  • I searched in the issues and found nothing similar.

Motivation

We have a public kafka topic which ingests all infrequent data from different databases.
But to sink the data, they needs routed to diffrent paimon databases. For exmaple:

mdm_db --> ods_mdm
reatail_db --> ods_retail

Solution

Adding new options for database whitelist and blacklist, like the following:

kafka_sync_database
...
--including_database mdm_db|mdm_other.*
--excluding_database retail_db|other.*
...

Anything else?

No response

Are you willing to submit a PR?

  • I'm willing to submit a PR!

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions