Skip to content

IGNORE - DO NOT MERGE: Renable RDS PSQL tests#4214

Closed
pfcoperez wants to merge 1 commit into
mainfrom
ci-test/enable-rds-psql-tests
Closed

IGNORE - DO NOT MERGE: Renable RDS PSQL tests#4214
pfcoperez wants to merge 1 commit into
mainfrom
ci-test/enable-rds-psql-tests

Conversation

@pfcoperez

@pfcoperez pfcoperez commented Apr 22, 2026

Copy link
Copy Markdown
Member

This is a PR to force CI execution of PG RDS tests. Won't be merged

@pfcoperez pfcoperez self-assigned this Apr 22, 2026
@codecov

codecov Bot commented Apr 22, 2026 •
edited
Loading

Copy link
Copy Markdown

❌ 2 Tests Failed:

Tests completed Failed Passed Skipped
2227 2 2225 201
View the top 3 failed test(s) by shortest run time 
github.com/PeerDB-io/peerdb/flow/e2e::TestApiPg
Stack Traces | 0.01s run time 
=== RUN   TestApiPg
=== PAUSE TestApiPg
=== CONT  TestApiPg
--- FAIL: TestApiPg (0.01s)

github.com/PeerDB-io/peerdb/flow/e2e::TestPeerFlowE2ETestSuitePG_CH
Stack Traces | 0.01s run time 
=== RUN   TestPeerFlowE2ETestSuitePG_CH
=== PAUSE TestPeerFlowE2ETestSuitePG_CH
=== CONT  TestPeerFlowE2ETestSuitePG_CH
--- FAIL: TestPeerFlowE2ETestSuitePG_CH (0.01s)
2026/04/22 10:27:23 INFO fetched schema x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} table=e2e_test_mychcl_uiigpjjm.test_extra_ch_cols

github.com/PeerDB-io/peerdb/flow/e2e::TestApiPg/TestCreateCDCFlowAttachConcurrentRequestsToxi
Stack Traces | 2.14s run time 
=== RUN   TestApiPg/TestCreateCDCFlowAttachConcurrentRequestsToxi
=== PAUSE TestApiPg/TestCreateCDCFlowAttachConcurrentRequestsToxi
=== CONT  TestApiPg/TestCreateCDCFlowAttachConcurrentRequestsToxi
2026/04/22 11:00:36 INFO Received AWS credentials from peer for connector: ci x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/22 11:00:36 INFO Received AWS credentials from peer for connector: clickhouse x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/22 11:00:36 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_auhzwyqd.\"table1\" ORDER BY id"
2026/04/22 11:00:36 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_auhzwyqd.\"table1\" ORDER BY id"
2026/04/22 11:00:36 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_9810351814949656710 CURSOR FOR SELECT id,val FROM e2e_test_api_auhzwyqd.\"table1\" ORDER BY id" args=[]
2026/04/22 11:00:36 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_auhzwyqd.\"table1\" ORDER BY id" channelLen=0
2026/04/22 11:00:36 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9810351814949656710
2026/04/22 11:00:36 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9810351814949656710 records=2 bytes=19 channelLen=1
2026/04/22 11:00:36 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_auhzwyqd.\"table1\" ORDER BY id" rows=2 bytes=19 channelLen=1
2026/04/22 11:00:36 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9810351814949656710
2026/04/22 11:00:36 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9810351814949656710 records=0 bytes=0 channelLen=0
2026/04/22 11:00:36 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_auhzwyqd.\"table1\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/22 11:00:36 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/22 11:00:36 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_auhzwyqd.\"table1\" ORDER BY id" rows=2 bytes=19 channelLen=0
    api_test.go:2756: 
        	Error Trace:	.../flow/e2e/api_test.go:2756
        	Error:      	Received unexpected error:
        	            	failed to get workflow_id for flow concurrent_toxi_race_api_w1jgnuxd: FATAL: terminating connection due to administrator command (SQLSTATE 57P01)
        	Test:       	TestApiPg/TestCreateCDCFlowAttachConcurrentRequestsToxi
    api_test.go:2665: begin tearing down postgres schema race_api_w1jgnuxd
    api_test.go:49: begin tearing down postgres schema api_w1jgnuxd
--- FAIL: TestApiPg/TestCreateCDCFlowAttachConcurrentRequestsToxi (2.14s)

github.com/PeerDB-io/peerdb/flow/e2e::TestApiPg/TestCancelAddCancel
Stack Traces | 26.1s run time 
=== RUN   TestApiPg/TestCancelAddCancel
=== PAUSE TestApiPg/TestCancelAddCancel
=== CONT  TestApiPg/TestCancelAddCancel
2026/04/22 10:45:47 INFO fetched schema x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} table=e2e_test_api_0kcmmfjx.t1
    cancel_table_addition_test.go:787: WaitFor wait for initial load to finish 2026-04-22 10:45:52.03767249 +0000 UTC m=+474.237827404
    cancel_table_addition_test.go:791: WaitFor t1 2026-04-22 10:45:52.038229771 +0000 UTC m=+474.238384685
2026/04/22 10:45:52 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_hwl38csv.\"t1\" ORDER BY id"
2026/04/22 10:45:52 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_hwl38csv.\"t1\" ORDER BY id"
2026/04/22 10:45:52 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_1208773534611625777 CURSOR FOR SELECT id,val FROM e2e_test_api_hwl38csv.\"t1\" ORDER BY id" args=[]
2026/04/22 10:45:52 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_hwl38csv.\"t1\" ORDER BY id" channelLen=0
2026/04/22 10:45:52 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_1208773534611625777
2026/04/22 10:45:52 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_1208773534611625777 records=1 bytes=9 channelLen=0
2026/04/22 10:45:52 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_hwl38csv.\"t1\" ORDER BY id" rows=1 bytes=9 channelLen=0
2026/04/22 10:45:52 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_1208773534611625777
2026/04/22 10:45:52 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_1208773534611625777 records=0 bytes=0 channelLen=0
2026/04/22 10:45:52 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_hwl38csv.\"t1\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/22 10:45:52 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/22 10:45:52 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_hwl38csv.\"t1\" ORDER BY id" rows=1 bytes=9 channelLen=0
    cancel_table_addition_test.go:127: WaitFor wait for pause for add e2e_test_api_hwl38csv.t2 2026-04-22 10:45:52.074174035 +0000 UTC m=+474.274328949
2026/04/22 10:45:52 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_c7kmzbpv.\"t1\" ORDER BY id"
2026/04/22 10:45:52 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_c7kmzbpv.\"t1\" ORDER BY id"
2026/04/22 10:45:52 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_16602270315548977598 CURSOR FOR SELECT id,val FROM e2e_test_api_c7kmzbpv.\"t1\" ORDER BY id" args=[]
2026/04/22 10:45:52 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_c7kmzbpv.\"t1\" ORDER BY id" channelLen=0
2026/04/22 10:45:52 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_16602270315548977598
2026/04/22 10:45:52 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_16602270315548977598 records=2 bytes=19 channelLen=1
2026/04/22 10:45:52 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_c7kmzbpv.\"t1\" ORDER BY id" rows=2 bytes=19 channelLen=1
2026/04/22 10:45:52 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_16602270315548977598
2026/04/22 10:45:52 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_16602270315548977598 records=0 bytes=0 channelLen=0
2026/04/22 10:45:52 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_c7kmzbpv.\"t1\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/22 10:45:52 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/22 10:45:52 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_c7kmzbpv.\"t1\" ORDER BY id" rows=2 bytes=19 channelLen=0
    cancel_table_addition_test.go:825: WaitFor wait for stuck snapshot of t2 add table 2026-04-22 10:45:54.082230448 +0000 UTC m=+476.282385362
2026/04/22 10:45:54 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_c7kmzbpv.\"t1\" ORDER BY id"
2026/04/22 10:45:54 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_c7kmzbpv.\"t1\" ORDER BY id"
2026/04/22 10:45:54 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_11041499162162666508 CURSOR FOR SELECT id,val FROM e2e_test_api_c7kmzbpv.\"t1\" ORDER BY id" args=[]
2026/04/22 10:45:54 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_c7kmzbpv.\"t1\" ORDER BY id" channelLen=0
2026/04/22 10:45:54 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_11041499162162666508
2026/04/22 10:45:54 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_11041499162162666508 records=2 bytes=19 channelLen=1
2026/04/22 10:45:54 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_c7kmzbpv.\"t1\" ORDER BY id" rows=2 bytes=19 channelLen=1
2026/04/22 10:45:54 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_11041499162162666508
2026/04/22 10:45:54 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_11041499162162666508 records=0 bytes=0 channelLen=0
2026/04/22 10:45:54 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_c7kmzbpv.\"t1\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/22 10:45:54 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/22 10:45:54 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_c7kmzbpv.\"t1\" ORDER BY id" rows=2 bytes=19 channelLen=0
    cancel_table_addition_test.go:828: WaitFor waiting for initial load MV error messages for t2 2026-04-22 10:45:55.083995561 +0000 UTC m=+477.284150476
2026/04/22 10:45:55 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_c7kmzbpv.\"t1\" ORDER BY id"
2026/04/22 10:45:55 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_c7kmzbpv.\"t1\" ORDER BY id"
2026/04/22 10:45:55 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_7054855068331488469 CURSOR FOR SELECT id,val FROM e2e_test_api_c7kmzbpv.\"t1\" ORDER BY id" args=[]
2026/04/22 10:45:55 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_c7kmzbpv.\"t1\" ORDER BY id" channelLen=0
2026/04/22 10:45:55 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_7054855068331488469
2026/04/22 10:45:55 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_7054855068331488469 records=2 bytes=19 channelLen=1
2026/04/22 10:45:55 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_c7kmzbpv.\"t1\" ORDER BY id" rows=2 bytes=19 channelLen=1
2026/04/22 10:45:55 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_7054855068331488469
2026/04/22 10:45:55 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_7054855068331488469 records=0 bytes=0 channelLen=0
2026/04/22 10:45:55 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_c7kmzbpv.\"t1\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/22 10:45:55 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/22 10:45:55 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_c7kmzbpv.\"t1\" ORDER BY id" rows=2 bytes=19 channelLen=0
    cancel_table_addition_test.go:859: WaitFor wait for running after t2 cancel 2026-04-22 10:45:59.022796518 +0000 UTC m=+481.222951422
    cancel_table_addition_test.go:127: WaitFor wait for pause for add e2e_test_api_hwl38csv.t2 2026-04-22 10:45:59.03616456 +0000 UTC m=+481.236319464
    cancel_table_addition_test.go:128: UNEXPECTED ERROR unable to establish connection with catalog: FATAL: terminating connection due to administrator command (SQLSTATE 57P01)
    api_test.go:49: begin tearing down postgres schema api_hwl38csv
--- FAIL: TestApiPg/TestCancelAddCancel (26.15s)

github.com/PeerDB-io/peerdb/flow/connectors/postgres::TestAwsRDSIAMAuthConnectForPostgres
Stack Traces | 73.7s run time 
=== RUN   TestAwsRDSIAMAuthConnectForPostgres
2026/04/22 10:54:55 INFO Setting up IAM auth for Postgres x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/22 10:54:55 INFO Generating new RDS token for connector x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} connector=POSTGRES
2026/04/22 10:54:55 INFO Received AWS credentials with chained role from peer for connector: POSTGRES x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/22 10:56:09 ERROR Failed to create connection x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} error="failed to connect to `user=peerdb_oss_test_iam_user database=postgres`: 34.216.16.103:5432 (peerdb-oss-flow-tests-rds-postgres.cncm0s2i8m05.us-west-2.rds.amazonaws.com): failed to receive message: unexpected EOF"
2026/04/22 10:56:09 ERROR failed to create connection x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} error="failed to connect to `user=peerdb_oss_test_iam_user database=postgres`: 34.216.16.103:5432 (peerdb-oss-flow-tests-rds-postgres.cncm0s2i8m05.us-west-2.rds.amazonaws.com): failed to receive message: unexpected EOF"
    rds_test.go:38: 
        	Error Trace:	.../connectors/postgres/rds_test.go:38
        	Error:      	Received unexpected error:
        	            	failed to create connection: failed to connect to `user=peerdb_oss_test_iam_user database=postgres`: 34.216.16.103:5432 (peerdb-oss-flow-tests-rds-postgres.cncm0s2i8m05.us-west-2.rds.amazonaws.com): failed to receive message: unexpected EOF
        	Test:       	TestAwsRDSIAMAuthConnectForPostgres
--- FAIL: TestAwsRDSIAMAuthConnectForPostgres (73.70s)

github.com/PeerDB-io/peerdb/flow/connectors/postgres::TestAwsRDSIAMAuthConnectForPostgresViaProxy
Stack Traces | 103s run time 
=== RUN   TestAwsRDSIAMAuthConnectForPostgresViaProxy
2026/04/22 10:56:09 INFO Setting up IAM auth for Postgres x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/22 10:56:09 INFO Generating new RDS token for connector x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} connector=POSTGRES
2026/04/22 10:56:09 INFO Received AWS credentials with chained role from peer for connector: POSTGRES x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/22 10:57:52 ERROR Failed to create connection x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} error="failed to connect to `user=peerdb_oss_test_iam_user database=postgres`: 34.216.16.103:5432 (postgres.rds-iam-auth.flow.tests.github.ci.peerdb.io): failed to receive message: unexpected EOF"
2026/04/22 10:57:52 ERROR failed to create connection x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} error="failed to connect to `user=peerdb_oss_test_iam_user database=postgres`: 34.216.16.103:5432 (postgres.rds-iam-auth.flow.tests.github.ci.peerdb.io): failed to receive message: unexpected EOF"
    rds_test.go:81: 
        	Error Trace:	.../connectors/postgres/rds_test.go:81
        	Error:      	Received unexpected error:
        	            	failed to create connection: failed to connect to `user=peerdb_oss_test_iam_user database=postgres`: 34.216.16.103:5432 (postgres.rds-iam-auth.flow.tests.github.ci.peerdb.io): failed to receive message: unexpected EOF
        	Test:       	TestAwsRDSIAMAuthConnectForPostgresViaProxy
--- FAIL: TestAwsRDSIAMAuthConnectForPostgresViaProxy (102.59s)

github.com/PeerDB-io/peerdb/flow/e2e::TestPeerFlowE2ETestSuitePG_CH/Test_Normalize_Metadata_With_Retry
Stack Traces | 201s run time 
=== RUN   TestPeerFlowE2ETestSuitePG_CH/Test_Normalize_Metadata_With_Retry
=== PAUSE TestPeerFlowE2ETestSuitePG_CH/Test_Normalize_Metadata_With_Retry
=== CONT  TestPeerFlowE2ETestSuitePG_CH/Test_Normalize_Metadata_With_Retry
2026/04/22 10:24:03 INFO Received AWS credentials from peer for connector: ci x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/22 10:24:03 INFO Received AWS credentials from peer for connector: clickhouse x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
    clickhouse_test.go:2208: WaitFor waiting on initial 2026-04-22 10:24:09.204965355 +0000 UTC m=+279.588776849
2026/04/22 10:24:09 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,\"key\" FROM e2e_test_pgch_fyw1o1rh.\"test_normalize_metadata_with_retry_1\" ORDER BY id"
2026/04/22 10:24:09 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,\"key\" FROM e2e_test_pgch_fyw1o1rh.\"test_normalize_metadata_with_retry_1\" ORDER BY id"
2026/04/22 10:24:09 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_14138193637441004987 CURSOR FOR SELECT id,\"key\" FROM e2e_test_pgch_fyw1o1rh.\"test_normalize_metadata_with_retry_1\" ORDER BY id" args=[]
2026/04/22 10:24:09 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,\"key\" FROM e2e_test_pgch_fyw1o1rh.\"test_normalize_metadata_with_retry_1\" ORDER BY id" channelLen=0
2026/04/22 10:24:09 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_14138193637441004987
2026/04/22 10:24:09 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_14138193637441004987 records=4 bytes=29 channelLen=3
2026/04/22 10:24:09 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,\"key\" FROM e2e_test_pgch_fyw1o1rh.\"test_normalize_metadata_with_retry_1\" ORDER BY id" rows=4 bytes=29 channelLen=3
2026/04/22 10:24:09 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_14138193637441004987
2026/04/22 10:24:09 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_14138193637441004987 records=0 bytes=0 channelLen=0
2026/04/22 10:24:09 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,\"key\" FROM e2e_test_pgch_fyw1o1rh.\"test_normalize_metadata_with_retry_1\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/22 10:24:09 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/22 10:24:09 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,\"key\" FROM e2e_test_pgch_fyw1o1rh.\"test_normalize_metadata_with_retry_1\" ORDER BY id" rows=4 bytes=29 channelLen=0
    clickhouse_test.go:2222: WaitFor waiting for first sync to complete 2026-04-22 10:24:09.219445345 +0000 UTC m=+279.603256849
2026/04/22 10:24:09 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,ky,val,n,t FROM e2e_test_pgch_ndzkvyqt.\"test_nullable_column\" ORDER BY id"
2026/04/22 10:24:09 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,ky,val,n,t FROM e2e_test_pgch_ndzkvyqt.\"test_nullable_column\" ORDER BY id"
2026/04/22 10:24:09 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_13150260851694730822 CURSOR FOR SELECT id,ky,val,n,t FROM e2e_test_pgch_ndzkvyqt.\"test_nullable_column\" ORDER BY id" args=[]
2026/04/22 10:24:09 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,ky,val,n,t FROM e2e_test_pgch_ndzkvyqt.\"test_nullable_column\" ORDER BY id" channelLen=0
2026/04/22 10:24:09 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_13150260851694730822
2026/04/22 10:24:09 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_13150260851694730822 records=2 bytes=15 channelLen=1
2026/04/22 10:24:09 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,ky,val,n,t FROM e2e_test_pgch_ndzkvyqt.\"test_nullable_column\" ORDER BY id" rows=2 bytes=15 channelLen=1
2026/04/22 10:24:09 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_13150260851694730822
2026/04/22 10:24:09 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_13150260851694730822 records=0 bytes=0 channelLen=0
2026/04/22 10:24:09 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,ky,val,n,t FROM e2e_test_pgch_ndzkvyqt.\"test_nullable_column\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/22 10:24:09 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/22 10:24:09 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,ky,val,n,t FROM e2e_test_pgch_ndzkvyqt.\"test_nullable_column\" ORDER BY id" rows=2 bytes=15 channelLen=0
    clickhouse_test.go:2233: WaitFor waiting for raw table push to complete 2026-04-22 10:24:25.234525061 +0000 UTC m=+295.618336565
    clickhouse_test.go:2246: WaitFor waiting for normalize error 2026-04-22 10:24:25.237895815 +0000 UTC m=+295.621707319
    clickhouse_test.go:2259: WaitFor waiting for second sync to complete 2026-04-22 10:24:25.245135755 +0000 UTC m=+295.628947259
2026/04/22 10:24:25 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,json,jsonb FROM e2e_test_pgch_wzgotsnq.\"test_json\" ORDER BY id"
2026/04/22 10:24:25 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,json,jsonb FROM e2e_test_pgch_wzgotsnq.\"test_json\" ORDER BY id"
2026/04/22 10:24:25 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_16523573973962197131 CURSOR FOR SELECT id,json,jsonb FROM e2e_test_pgch_wzgotsnq.\"test_json\" ORDER BY id" args=[]
2026/04/22 10:24:25 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,json,jsonb FROM e2e_test_pgch_wzgotsnq.\"test_json\" ORDER BY id" channelLen=0
2026/04/22 10:24:25 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_16523573973962197131
2026/04/22 10:24:25 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_16523573973962197131 records=14 bytes=1516 channelLen=13
2026/04/22 10:24:25 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,json,jsonb FROM e2e_test_pgch_wzgotsnq.\"test_json\" ORDER BY id" rows=14 bytes=1516 channelLen=13
2026/04/22 10:24:25 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_16523573973962197131
2026/04/22 10:24:25 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_16523573973962197131 records=0 bytes=0 channelLen=0
2026/04/22 10:24:25 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,json,jsonb FROM e2e_test_pgch_wzgotsnq.\"test_json\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/22 10:24:25 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/22 10:24:25 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,json,jsonb FROM e2e_test_pgch_wzgotsnq.\"test_json\" ORDER BY id" rows=14 bytes=1516 channelLen=0
    clickhouse_test.go:2270: WaitFor waiting for second raw table push to complete 2026-04-22 10:24:40.256557332 +0000 UTC m=+310.640368836
    clickhouse.go:115: 
        	Error Trace:	.../flow/e2e/congen.go:44
        	            				.../flow/e2e/clickhouse.go:115
        	            				.../flow/e2e/clickhouse.go:97
        	            				.../flow/e2e/clickhouse.go:172
        	            				.../flow/e2e/clickhouse_test.go:2271
        	            				.../flow/e2e/test_utils.go:852
        	            				.../flow/e2e/clickhouse_test.go:2270
        	Error:      	Received unexpected error:
        	            	unable to establish connection with catalog: FATAL: terminating connection due to administrator command (SQLSTATE 57P01)
        	Test:       	TestPeerFlowE2ETestSuitePG_CH/Test_Normalize_Metadata_With_Retry
    clickhouse.go:125: begin tearing down postgres schema pgch_fyw1o1rh
2026/04/22 10:25:23 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_njmbbk8d.\"table1\" ORDER BY id"
2026/04/22 10:25:23 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_njmbbk8d.\"table1\" ORDER BY id"
2026/04/22 10:25:23 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_3460350066636325227 CURSOR FOR SELECT id,val FROM e2e_test_api_njmbbk8d.\"table1\" ORDER BY id" args=[]
2026/04/22 10:25:23 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_njmbbk8d.\"table1\" ORDER BY id" channelLen=0
2026/04/22 10:25:23 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_3460350066636325227
2026/04/22 10:25:23 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_3460350066636325227 records=2 bytes=19 channelLen=1
2026/04/22 10:25:23 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_njmbbk8d.\"table1\" ORDER BY id" rows=2 bytes=19 channelLen=1
2026/04/22 10:25:23 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_3460350066636325227
2026/04/22 10:25:23 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_3460350066636325227 records=0 bytes=0 channelLen=0
2026/04/22 10:25:23 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_njmbbk8d.\"table1\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/22 10:25:23 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/22 10:25:23 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_njmbbk8d.\"table1\" ORDER BY id" rows=2 bytes=19 channelLen=0
    clickhouse.go:125: 
        	Error Trace:	.../flow/e2e/pg.go:148
        	            				.../flow/e2e/clickhouse.go:125
        	            				.../flow/e2eshared/e2eshared.go:38
        	            				.../hostedtoolcache/go/1.26.2.../src/testing/testing.go:1317
        	            				.../hostedtoolcache/go/1.26.2.../src/testing/testing.go:1667
        	            				.../hostedtoolcache/go/1.26.2.../src/testing/testing.go:2030
        	            				.../hostedtoolcache/go/1.26.2.../src/runtime/panic.go:694
        	            				.../hostedtoolcache/go/1.26.2.../src/testing/testing.go:1022
        	            				.../flow/e2e/congen.go:44
        	            				.../flow/e2e/clickhouse.go:115
        	            				.../flow/e2e/clickhouse.go:97
        	            				.../flow/e2e/clickhouse.go:172
        	            				.../flow/e2e/clickhouse_test.go:2271
        	            				.../flow/e2e/test_utils.go:852
        	            				.../flow/e2e/clickhouse_test.go:2270
        	            				.../hostedtoolcache/go/1.26.2.../src/reflect/value.go:369
        	            				.../flow/e2eshared/e2eshared.go:40
        	Error:      	failed to teardown postgres schema
        	Test:       	TestPeerFlowE2ETestSuitePG_CH/Test_Normalize_Metadata_With_Retry
        	Messages:   	pgch_fyw1o1rh: failed to drop replication slots: ERROR: replication slot "peerflow_slot_test_normalize_metadata_with_retry_pgch_fyw1o1rh" is active for PID 8132 (SQLSTATE 55006)
--- FAIL: TestPeerFlowE2ETestSuitePG_CH/Test_Normalize_Metadata_With_Retry (200.54s)

To view more test analytics, go to the Test Analytics Dashboard
📋 Got 3 mins? Take this short survey to help us improve Test Analytics.

@github-actions

github-actions Bot commented Apr 22, 2026

Copy link
Copy Markdown
Contributor

🔄 Flaky Test Detected

Analysis: TestAwsRDSIAMAuthConnectForPostgres failed with a network error ("unexpected EOF" connecting to external AWS RDS at 34.216.16.103:5432) across all CI matrix variants at the same timestamp, indicating a transient external connectivity issue rather than a code bug.
Confidence: 0.95

✅ Automatically retrying the workflow

View workflow run

@github-actions

github-actions Bot commented Apr 22, 2026

Copy link
Copy Markdown
Contributor

🔄 Flaky Test Detected

Analysis: All failures are network errors (unexpected EOF) connecting to an external AWS RDS host (34.216.16.103:5432) for IAM auth tests — the external RDS instance was unreachable during the run, not a code regression.
Confidence: 0.97

✅ Automatically retrying the workflow

View workflow run

@pfcoperez pfcoperez mentioned this pull request Apr 22, 2026
Merged
2 tasks
@pfcoperez

pfcoperez commented Apr 22, 2026

Copy link
Copy Markdown
Member Author

Closing as I've been able to verify test unreliability in #4192 (comment)

@pfcoperez pfcoperez closed this Apr 22, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@pfcoperez pfcoperez

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@pfcoperez