Skip to content

Tune Bucardo replication for large migrations #7

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
jessehanley wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Tune Bucardo replication for large migrations #7

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 5 additions & 2 deletions entrypoint.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -187,8 +187,11 @@ RCEOF
--db-port "$PGPORT" \
--verbose 2>/dev/null || true

echo "Configuring Bucardo verbose logging..."
bucardo set log_level=verbose
echo "Configuring Bucardo logging and TCP keepalives..."
bucardo set log_level=verbose rebuild_index=1
bucardo set tcp_keepalives_idle=60
bucardo set tcp_keepalives_interval=10
bucardo set tcp_keepalives_count=6

echo "Starting Bucardo daemon..."
bucardo start || bucardo restart
Expand Down
8 changes: 7 additions & 1 deletion scripts/mk-bucardo-repl.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -112,7 +112,13 @@ fi
# Give Bucardo enough time to validate all tables across both databases.
# The default 30s timeout is too short for databases with many tables, since
# each table is inspected on both source and target over remote connections.
bucardo set reload_config_timeout=180 log_level=verbose
bucardo set reload_config_timeout=180 log_level=verbose rebuild_index=1

# Keep remote database connections alive across infrastructure with aggressive
# idle TCP timeouts, such as EC2 network paths.
bucardo set tcp_keepalives_idle=60
bucardo set tcp_keepalives_interval=10
bucardo set tcp_keepalives_count=6

# Reload Bucardo, which starts the sync we just added.
bucardo reload
Expand Down