MogDB as a Source Database

Supported Version

Database version: 2.0 or later version

Dependency plug-in: wal2json

Note: MogDB is the source database and does not support object synchronization. Please set skipMigrationObject: ON as the advanced parameter of the channel.

Database Configuration

Install wal2json

For details, see wal2json.

Modify the WAL Parameter of the Source Database

Modify the parameter configuration file postgresql.conf of the source database. The parameter file is located in the data/ directory of the database.

Use gsql to log in to the MogDB database. Run the following command to query the data directory:

gsql -d postgres -U $USER -c 'show data_directory'

Modify the postgresql.conf file in the data/ directory.

# Relace <data_directory> with the actual data directory
vi <data_directory>/postgresql.conf

Find the following parameters in the postgresql.conf file and set them to specified values.

1. wal_level=logical #Use logical decoding to read pre-write logs.
2. wal_sender_timeout = 0s #Customize the timeout.

Modify the HBA Configuration of the Source Database

In the data directory, find the pg_hba.conf configuration file, add the following content to add the replication permission.

Note: mdb_user indicates the user for using the replication function. It needs to be modified based on actual requirement.

# Replace <data_directory> with the actual data directory. 
cat >> <data_directory>/pg_hba.conf <"EOF"

# Add for MDB replication
host  replication  mdb_user   0.0.0.0/0  sha256
EOF

Set User Permission

Create the mdb_user user for logging in to and replicate source MogDB data. The username and password need to be modified based on the actual requirement.

• The login permission is used for logging in to the database.
• The replication permission is used for synchronizing incremental data.
• The sysadmin permission is used for initializing objects and synchronizing full data.

create user mdb_user with login replication sysadmin PASSWORD 'Enmo@123';

Enable the REPLICA IDENTITY Mode of the Table

For all tables to be synchronized, enable the REPLICA IDENTITY mode.

Note: The following is the command example.

ALTER TABLE public.customers REPLICA IDENTITY FULL;

Enable Heartbeat Configuration

Sending a heartbeat message enables the connector to send the latest retrieved LSN to the database slot, allowing the database to reclaim disk space used by WAL files that are no longer needed.

To enable the heartbeat configuration, see Channel-related Advanced Parameters. You need to set heartbeatIntervalMs to a positive integer, and run the following command on the source node.

Note: The following is only an example. The table name heartbeat needs to be consistent with the heartbeatTableName value.

CREATE TABLE heartbeat (ts TIMESTAMP WITH TIME ZONE);
INSERT INTO heartbeat (ts) VALUES (NOW());

Character Set Mapping