You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/connectors/postgres/index.mdx
+14-2Lines changed: 14 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -77,7 +77,7 @@ For users who previously set up jobs using the wal2json plugin: [wal2json plugin
77
77
| Replication Slot `required for CDC`| Logical replication slot (pgoutput) that retains WAL segments until read, ensuring consistent CDC. |`olake-repl-slot`|
78
78
| Publication `required for CDC`| Name of the PostgreSQL publication that defines which tables and operations (INSERT, UPDATE, DELETE, TRUNCATE) to replicate. Must exist in the same database as the replication slot and include all tables for CDC capture. |`postgres_pub`|
79
79
| JDBC URL Parameters | Extra [JDBC URL parameters](https://jdbc.postgresql.org/documentation/use/) for fine-tuning the connection. |`{"connectTimeout":"20"}`|
80
-
| SSL Mode | SSL configuration for the database connection. Contains details such as the SSL mode. |`disable`|
80
+
| SSL Mode | SSL configuration for the database connection. Contains details such as the SSL mode. |<ul> <li>`require`</li> <li>`disable`</li> <li>`verify-ca`</li> <li>`verify-full`</li> </ul>|
81
81
| SSH Config | Configure OLake to connect through an SSH tunnel. See [SSH Config details](/docs/understanding/terminologies/olake#1-ssh-configuration) for the list of supported parameters. | <ul> <li>`No Tunnel`</li> <li>`SSH Key Authentication`</li> <li>`SSH Password Authentication`</li> </ul> |
@@ -120,7 +120,7 @@ An example `source.json` file will look like this:
120
120
| max_threads | Maximum number of worker threads the connector can spin up for parallel tasks. |`10`| Integer |
121
121
| retry_count | Number of times the retry will take place incase of timeout before failing the sync. |`3`| Integer |
122
122
| jdbc_url_params | Extra [JDBC URL parameters](https://jdbc.postgresql.org/documentation/use/) for fine-tuning the connection. |`{"connectTimeout":"20"}`| Object |
123
-
| ssl | SSL configuration for the database connection. Contains details such as the SSL mode. |`{"mode": "disable"}`| Object |
123
+
| ssl | SSL configuration for the database connection. Contains details such as the SSL mode. | <ul> <li>`require`</li> <li>`disable`</li> <li>`verify-ca`</li> <li>`verify-full`</li> </ul>| Object |
124
124
| ssh_config | Configure OLake to connect through an SSH tunnel. See [SSH Config details](/docs/understanding/terminologies/olake#1-ssh-configuration) for parameter descriptions. |`{"host": "my-tunnel-host", "port": 22 , "username": "my-tunnel-user", "password": "tunnel-password"}`| Object |
125
125
126
126
@@ -226,6 +226,18 @@ To allow a specific role to bypass RLS entirely, execute the following command (
226
226
ALTERUSER<rolename> WITH BYPASSRLS;
227
227
```
228
228
229
+
### 3. Failed with non retryable error: LSN not updated after `X` mins
230
+
231
+
```logs
232
+
Failed with non retryable error: LSN not updated after `X` mins
233
+
```
234
+
235
+
This issue occurs when `wal_sender_timeout` is set too low (for example, `30s`). If CDC processing takes longer than that, PostgreSQL closes the replication connection before LSN acknowledgment is completed.
236
+
237
+
It is more likely to happen on databases with concurrent writes or heavier CDC load.
238
+
239
+
**Solution**: Set `wal_sender_timeout` to `0` (recommended) or a sufficiently large value.
240
+
229
241
**If the issue is not listed here, post the query on Slack to get it resolved within a few hours.**
0 commit comments