Skip to content

fix: Document PostgreSQL replication parameters for WAL streaming#1531

Merged
lukekim merged 6 commits into
trunkfrom
fix/docs-pg-replication-params
Apr 20, 2026
Merged

fix: Document PostgreSQL replication parameters for WAL streaming#1531
lukekim merged 6 commits into
trunkfrom
fix/docs-pg-replication-params

Conversation

@claudespice
Copy link
Copy Markdown
Collaborator

Summary

  • The PostgreSQL connector recently added logical replication (WAL streaming) support via feat(postgres): stream WAL directly to Spice accelerators spiceai#10364
  • Five new parameters (pg_replication_slot, pg_publication, pg_replication_initial_snapshot, pg_replication_temporary_slot, pg_replication_status_interval) were defined in the ParameterSpec but not yet documented

Changes

  • Added a "Replication parameters" subsection to the vNext Postgres connector docs with all 5 parameters, their defaults, and descriptions

Reference

Verified against spiceai/spiceai at trunkcrates/data-connectors/connector-postgres/src/lib.rs (lines 100–128)

This is a vNext-only change since the feature was just merged to trunk and is not in any released version.

Claude added 5 commits April 18, 2026 03:11
…rsioned docs

Commit d5341c4 documented the Arrow nanosecond timestamp range
limitation (~1677–2262) for MSSQL and Oracle connectors, but only
in website/docs/ (vNext). The limitation existed in all prior versions
too — in versions 1.5.x–1.11.x, out-of-range timestamps silently
returned 1970-01-01 UTC instead of erroring.

Propagate the limitation note to all 7 versioned doc directories
(14 files total) with version-appropriate wording.
…d defaults

The docs listed pg_connection_pool_min_idle (default 1) and connection_pool_size
(default 5), but the code uses pg_connection_pool_min (default 5) and
connection_pool_size (default 10).
The docs stated the default ssl_mode is tls, but the code has always
used auto as the default since at least v1.5.0.
The docs showed the default time format as 2006-01-02T15:04:05Z07:00
but the code uses 2006-01-02T15:04:05.000Z07:00 (with .000 milliseconds).
This matters because Go format strings are exact patterns — without .000,
timestamps with millisecond precision would not parse correctly.
The PostgreSQL connector added logical replication (WAL streaming) support
in PR #10364 with 5 new parameters (pg_replication_slot, pg_publication,
pg_replication_initial_snapshot, pg_replication_temporary_slot,
pg_replication_status_interval) that were not yet documented.
@claudespice claudespice added the enhancement New feature or request label Apr 19, 2026
@github-actions
Copy link
Copy Markdown

github-actions Bot commented Apr 19, 2026

✅ Pull with Spice Passed

Passing checks:

  • ✅ Title meets minimum length requirement (10 characters)
  • ✅ Has at least one of the required labels: area/blog, area/docs, area/cookbook, dependencies
  • ✅ No banned labels detected
  • ✅ Has at least one assignee: lukekim

@github-actions
Copy link
Copy Markdown

🔍 Pull with Spice Failed

Passing checks:

  • ✅ Title meets minimum length requirement (10 characters)
  • ✅ No banned labels detected

Failed checks:

  • ❌ Please select at least one of the required labels for this pull request: area/blog, area/docs, area/cookbook, dependencies
  • ❌ At least one assignee is required for this pull request.

Please address these issues and update your pull request.

@github-actions
Copy link
Copy Markdown

🚀 deployed to https://3571d6ac.spiceai-org-website.pages.dev

@lukekim lukekim self-assigned this Apr 20, 2026
@lukekim lukekim enabled auto-merge (squash) April 20, 2026 18:27
@github-actions
Copy link
Copy Markdown

🚀 deployed to https://1e9764b3.spiceai-org-website.pages.dev

@lukekim lukekim added this to the v2.0 milestone Apr 20, 2026
@lukekim lukekim merged commit 6df6517 into trunk Apr 20, 2026
6 of 7 checks passed
@lukekim lukekim deleted the fix/docs-pg-replication-params branch April 20, 2026 23:48
Copilot AI pushed a commit that referenced this pull request Apr 21, 2026
)

* fix: Add nanosecond timestamp range limitation to MSSQL and Oracle versioned docs

Commit d5341c4 documented the Arrow nanosecond timestamp range
limitation (~1677–2262) for MSSQL and Oracle connectors, but only
in website/docs/ (vNext). The limitation existed in all prior versions
too — in versions 1.5.x–1.11.x, out-of-range timestamps silently
returned 1970-01-01 UTC instead of erroring.

Propagate the limitation note to all 7 versioned doc directories
(14 files total) with version-appropriate wording.

* fix: Correct PostgreSQL accelerator connection pool parameter name and defaults

The docs listed pg_connection_pool_min_idle (default 1) and connection_pool_size
(default 5), but the code uses pg_connection_pool_min (default 5) and
connection_pool_size (default 10).

* fix: Correct IMAP ssl_mode default from tls to auto

The docs stated the default ssl_mode is tls, but the code has always
used auto as the default since at least v1.5.0.

* fix: Correct DynamoDB default time_format to include milliseconds

The docs showed the default time format as 2006-01-02T15:04:05Z07:00
but the code uses 2006-01-02T15:04:05.000Z07:00 (with .000 milliseconds).
This matters because Go format strings are exact patterns — without .000,
timestamps with millisecond precision would not parse correctly.

* fix: Document PostgreSQL replication parameters for WAL streaming

The PostgreSQL connector added logical replication (WAL streaming) support
in PR #10364 with 5 new parameters (pg_replication_slot, pg_publication,
pg_replication_initial_snapshot, pg_replication_temporary_slot,
pg_replication_status_interval) that were not yet documented.

---------

Co-authored-by: Claude <claude@Claudes-Mini.localdomain>
Co-authored-by: lukekim <80174+lukekim@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/docs enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants