Skip to content

[hotfix] [doc] Fix some typo and add a three-level catalogue #4858

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
JingsongLi merged 1 commit into from
Jan 8, 2025
Merged

[hotfix] [doc] Fix some typo and add a three-level catalogue #4858

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 7 additions & 8 deletions docs/content/cdc-ingestion/mysql-cdc.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -52,7 +52,7 @@ To use this feature through `flink run`, run the following shell command.
```bash
<FLINK_HOME>/bin/flink run \
/path/to/paimon-flink-action-{{< version >}}.jar \
mysql_sync_table
mysql_sync_table \
--warehouse <warehouse-path> \
--database <database-name> \
--table <table-name> \
Expand All @@ -70,7 +70,7 @@ To use this feature through `flink run`, run the following shell command.

If the Paimon table you specify does not exist, this action will automatically create the table. Its schema will be derived from all specified MySQL tables. If the Paimon table already exists, its schema will be compared against the schema of all specified MySQL tables.

Example 1: synchronize tables into one Paimon table
### Example 1: synchronize tables into one Paimon table

```bash
<FLINK_HOME>/bin/flink run \
Expand All @@ -97,7 +97,7 @@ Example 1: synchronize tables into one Paimon table
As example shows, the mysql_conf's table-name supports regular expressions to monitor multiple tables that satisfy
the regular expressions. The schemas of all the tables will be merged into one Paimon table schema.

Example 2: synchronize shards into one Paimon table
### Example 2: synchronize shards into one Paimon table

You can also set 'database-name' with a regular expression to capture multiple databases. A typical scenario is that a
table 'source_table' is split into database 'source_db1', 'source_db2' ..., then you can synchronize data of all the
Expand Down Expand Up @@ -134,7 +134,7 @@ To use this feature through `flink run`, run the following shell command.
```bash
<FLINK_HOME>/bin/flink run \
/path/to/paimon-flink-action-{{< version >}}.jar \
mysql_sync_database
mysql_sync_database \
--warehouse <warehouse-path> \
--database <database-name> \
[--ignore_incompatible <true/false>] \
Expand All @@ -159,7 +159,7 @@ Only tables with primary keys will be synchronized.

For each MySQL table to be synchronized, if the corresponding Paimon table does not exist, this action will automatically create the table. Its schema will be derived from all specified MySQL tables. If the Paimon table already exists, its schema will be compared against the schema of all specified MySQL tables.

Example 1: synchronize entire database
### Example 1: synchronize entire database

```bash
<FLINK_HOME>/bin/flink run \
Expand All @@ -178,7 +178,7 @@ Example 1: synchronize entire database
--table_conf sink.parallelism=4
```

Example 2: synchronize newly added tables under database
### Example 2: synchronize newly added tables under database

Let's say at first a Flink job is synchronizing tables [product, user, address]
under database `source_db`. The command to submit the job looks like:
Expand Down Expand Up @@ -209,7 +209,6 @@ position automatically.

The command to recover from previous snapshot and add new tables to synchronize looks like:


```bash
<FLINK_HOME>/bin/flink run \
--fromSavepoint savepointPath \
Expand All @@ -231,7 +230,7 @@ The command to recover from previous snapshot and add new tables to synchronize
You can set `--mode combined` to enable synchronizing newly added tables without restarting job.
{{< /hint >}}

Example 3: synchronize and merge multiple shards
### Example 3: synchronize and merge multiple shards

Let's say you have multiple database shards `db1`, `db2`, ... and each database has tables `tbl1`, `tbl2`, .... You can
synchronize all the `db.+.tbl.+` into tables `test_db.tbl1`, `test_db.tbl2` ... by following command:
Expand Down
Loading