classify mysql client transient error by jgao54 · Pull Request #4197 · PeerDB-io/peerdb

jgao54 · 2026-04-18T23:42:48Z

Retry transient auth error that can happen occasionally when creating a binlogSyncer:

MySQL streaming error: handleAuthResult: readAuthResult: ReadPacket: invalid sequence 2 != 3

MySQL client received package with sequence number 2 when it expected 3 during auth handshake, then succeeds on retry. Suggest a bug in the auth handshake code in go-mysql-org client.

We've seen similar issue in the past with invalid sequence 4 != 5 that also succeeded on retry

Fixes: DBI-414

codecov · 2026-04-19T00:00:26Z

❌ 2 Tests Failed:

Tests completed	Failed	Passed	Skipped
2234	2	2232	187

View the top 3 failed test(s) by shortest run time

github.com/PeerDB-io/peerdb/flow/e2e::TestApiPg

Stack Traces | 0s run time

=== RUN   TestApiPg
=== PAUSE TestApiPg
=== CONT  TestApiPg
--- FAIL: TestApiPg (0.00s)
2026/04/21 07:22:10 INFO Received AWS credentials from peer for connector: ci x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/21 07:22:10 INFO Received AWS credentials from peer for connector: clickhouse x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}

github.com/PeerDB-io/peerdb/flow/e2e::TestGenericBQ

Stack Traces | 0s run time

=== RUN   TestGenericBQ
=== PAUSE TestGenericBQ
=== CONT  TestGenericBQ
--- FAIL: TestGenericBQ (0.00s)

github.com/PeerDB-io/peerdb/flow/e2e::TestPeerFlowE2ETestSuitePG_CH

Stack Traces | 0.01s run time

=== RUN   TestPeerFlowE2ETestSuitePG_CH
=== PAUSE TestPeerFlowE2ETestSuitePG_CH
=== CONT  TestPeerFlowE2ETestSuitePG_CH
--- FAIL: TestPeerFlowE2ETestSuitePG_CH (0.01s)
2026/04/21 07:33:19 INFO fetched schema x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} table=e2e_test_api_9hshy6vy.t1

github.com/PeerDB-io/peerdb/flow/e2e::TestGenericBQ/Test_Inheritance_Table_With_Dynamic_Setting

Stack Traces | 33.8s run time

=== RUN   TestGenericBQ/Test_Inheritance_Table_With_Dynamic_Setting
=== PAUSE TestGenericBQ/Test_Inheritance_Table_With_Dynamic_Setting
=== CONT  TestGenericBQ/Test_Inheritance_Table_With_Dynamic_Setting
2026/04/21 07:24:34 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,ky,value,myh FROM e2e_test_bq_hmkymq54_20260421072359.\"test_simple\" ORDER BY id"
2026/04/21 07:24:34 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,ky,value,myh FROM e2e_test_bq_hmkymq54_20260421072359.\"test_simple\" ORDER BY id"
2026/04/21 07:24:34 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_6878080990854747064 CURSOR FOR SELECT id,ky,value,myh FROM e2e_test_bq_hmkymq54_20260421072359.\"test_simple\" ORDER BY id" args=[]
2026/04/21 07:24:34 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,ky,value,myh FROM e2e_test_bq_hmkymq54_20260421072359.\"test_simple\" ORDER BY id" channelLen=0
2026/04/21 07:24:34 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_6878080990854747064
2026/04/21 07:24:34 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_6878080990854747064 records=20 bytes=680 channelLen=19
2026/04/21 07:24:34 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,ky,value,myh FROM e2e_test_bq_hmkymq54_20260421072359.\"test_simple\" ORDER BY id" rows=20 bytes=680 channelLen=19
2026/04/21 07:24:34 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_6878080990854747064
2026/04/21 07:24:34 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_6878080990854747064 records=0 bytes=0 channelLen=0
2026/04/21 07:24:34 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,ky,value,myh FROM e2e_test_bq_hmkymq54_20260421072359.\"test_simple\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/21 07:24:34 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/21 07:24:34 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,ky,value,myh FROM e2e_test_bq_hmkymq54_20260421072359.\"test_simple\" ORDER BY id" rows=20 bytes=680 channelLen=0
    generic_test.go:1103: UNEXPECTED STATUS TIMEOUT STATUS_SNAPSHOT
    bigquery.go:86: begin tearing down postgres schema bq_9bryyrcd_20260421072434
--- FAIL: TestGenericBQ/Test_Inheritance_Table_With_Dynamic_Setting (33.75s)

github.com/PeerDB-io/peerdb/flow/e2e::TestApiPg/TestQRep

Stack Traces | 63.4s run time

=== RUN   TestApiPg/TestQRep
=== PAUSE TestApiPg/TestQRep
=== CONT  TestApiPg/TestQRep
    api_test.go:2149: WaitFor qrep initial load 2026-04-21 07:20:21.290395255 +0000 UTC m=+0.463923447
2026/04/21 07:20:21 INFO Received AWS credentials from peer for connector: ci x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/21 07:20:21 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_h61fj2tr.\"qrepapi_api_h61fj2tr\" ORDER BY id"
2026/04/21 07:20:21 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_h61fj2tr.\"qrepapi_api_h61fj2tr\" ORDER BY id"
2026/04/21 07:20:21 INFO Received AWS credentials from peer for connector: ci x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/21 07:20:21 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_5180389690515611114 CURSOR FOR SELECT id,val FROM e2e_test_api_h61fj2tr.\"qrepapi_api_h61fj2tr\" ORDER BY id" args=[]
2026/04/21 07:20:21 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_h61fj2tr.\"qrepapi_api_h61fj2tr\" ORDER BY id" channelLen=0
2026/04/21 07:20:21 INFO Received AWS credentials from peer for connector: clickhouse x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/21 07:20:21 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_5180389690515611114
2026/04/21 07:20:21 INFO Received AWS credentials from peer for connector: ci x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/21 07:20:21 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_5180389690515611114 records=1 bytes=9 channelLen=0
2026/04/21 07:20:21 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_h61fj2tr.\"qrepapi_api_h61fj2tr\" ORDER BY id" rows=1 bytes=9 channelLen=0
2026/04/21 07:20:21 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_5180389690515611114
2026/04/21 07:20:21 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_5180389690515611114 records=0 bytes=0 channelLen=0
2026/04/21 07:20:21 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_h61fj2tr.\"qrepapi_api_h61fj2tr\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/21 07:20:21 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/21 07:20:21 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_h61fj2tr.\"qrepapi_api_h61fj2tr\" ORDER BY id" rows=1 bytes=9 channelLen=0
2026/04/21 07:20:21 INFO Received AWS credentials from peer for connector: clickhouse x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
    api_test.go:2149: code: 60, message: Unknown table expression identifier 'qrepapi_api_h61fj2tr' in scope SELECT id, val FROM qrepapi_api_h61fj2tr FINAL WHERE _peerdb_is_deleted = 0 ORDER BY 1 ASC SETTINGS use_query_cache = false
    api_test.go:2154: WaitFor insert post qrep initial load 2026-04-21 07:20:22.33215994 +0000 UTC m=+1.505688142
2026/04/21 07:20:22 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_h61fj2tr.\"qrepapi_api_h61fj2tr\" ORDER BY id"
2026/04/21 07:20:22 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_h61fj2tr.\"qrepapi_api_h61fj2tr\" ORDER BY id"
2026/04/21 07:20:22 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_13758568062541709656 CURSOR FOR SELECT id,val FROM e2e_test_api_h61fj2tr.\"qrepapi_api_h61fj2tr\" ORDER BY id" args=[]
2026/04/21 07:20:22 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_h61fj2tr.\"qrepapi_api_h61fj2tr\" ORDER BY id" channelLen=0
2026/04/21 07:20:22 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_13758568062541709656
2026/04/21 07:20:22 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_13758568062541709656 records=2 bytes=19 channelLen=1
2026/04/21 07:20:22 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_h61fj2tr.\"qrepapi_api_h61fj2tr\" ORDER BY id" rows=2 bytes=19 channelLen=1
2026/04/21 07:20:22 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_13758568062541709656
2026/04/21 07:20:22 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_13758568062541709656 records=0 bytes=0 channelLen=0
2026/04/21 07:20:22 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_h61fj2tr.\"qrepapi_api_h61fj2tr\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/21 07:20:22 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/21 07:20:22 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_h61fj2tr.\"qrepapi_api_h61fj2tr\" ORDER BY id" rows=2 bytes=19 channelLen=0
    api_test.go:2154: q.NumRecords: 2
    api_test.go:2154: other.NumRecords: 1
2026/04/21 07:20:22 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_dx5rgmkj.\"dropqrep_api_dx5rgmkj\" ORDER BY id"
2026/04/21 07:20:22 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_dx5rgmkj.\"dropqrep_api_dx5rgmkj\" ORDER BY id"
2026/04/21 07:20:22 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_7061877625215204680 CURSOR FOR SELECT id,val FROM e2e_test_api_dx5rgmkj.\"dropqrep_api_dx5rgmkj\" ORDER BY id" args=[]
2026/04/21 07:20:22 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_dx5rgmkj.\"dropqrep_api_dx5rgmkj\" ORDER BY id" channelLen=0
2026/04/21 07:20:22 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_7061877625215204680
2026/04/21 07:20:22 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_7061877625215204680 records=1 bytes=9 channelLen=0
2026/04/21 07:20:22 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_dx5rgmkj.\"dropqrep_api_dx5rgmkj\" ORDER BY id" rows=1 bytes=9 channelLen=0
2026/04/21 07:20:22 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_7061877625215204680
2026/04/21 07:20:22 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_7061877625215204680 records=0 bytes=0 channelLen=0
2026/04/21 07:20:22 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_dx5rgmkj.\"dropqrep_api_dx5rgmkj\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/21 07:20:22 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/21 07:20:22 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_dx5rgmkj.\"dropqrep_api_dx5rgmkj\" ORDER BY id" rows=1 bytes=9 channelLen=0
    api_test.go:2154: q.NumRecords: 2
    api_test.go:2154: other.NumRecords: 1
2026/04/21 07:20:23 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_dx5rgmkj.\"dropqrep_api_dx5rgmkj\" ORDER BY id"
2026/04/21 07:20:23 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_dx5rgmkj.\"dropqrep_api_dx5rgmkj\" ORDER BY id"
2026/04/21 07:20:23 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_9568329059798642484 CURSOR FOR SELECT id,val FROM e2e_test_api_dx5rgmkj.\"dropqrep_api_dx5rgmkj\" ORDER BY id" args=[]
2026/04/21 07:20:23 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_dx5rgmkj.\"dropqrep_api_dx5rgmkj\" ORDER BY id" channelLen=0
2026/04/21 07:20:23 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9568329059798642484
2026/04/21 07:20:23 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9568329059798642484 records=1 bytes=9 channelLen=0
2026/04/21 07:20:23 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_dx5rgmkj.\"dropqrep_api_dx5rgmkj\" ORDER BY id" rows=1 bytes=9 channelLen=0
2026/04/21 07:20:23 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9568329059798642484
2026/04/21 07:20:23 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9568329059798642484 records=0 bytes=0 channelLen=0
2026/04/21 07:20:23 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_dx5rgmkj.\"dropqrep_api_dx5rgmkj\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/21 07:20:23 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/21 07:20:23 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_dx5rgmkj.\"dropqrep_api_dx5rgmkj\" ORDER BY id" rows=1 bytes=9 channelLen=0
    api_test.go:2173: WaitFor finish 2026-04-21 07:20:24.359845861 +0000 UTC m=+3.533374053
2026/04/21 07:20:24 INFO Received AWS credentials from peer for connector: ci x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/21 07:20:24 INFO Received AWS credentials from peer for connector: clickhouse x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
    api_test.go:2173: UNEXPECTED TIMEOUT finish 2026-04-21 07:21:24.485941927 +0000 UTC m=+63.659470119
    api_test.go:48: begin tearing down postgres schema api_h61fj2tr
--- FAIL: TestApiPg/TestQRep (63.44s)

github.com/PeerDB-io/peerdb/flow/e2e::TestPeerFlowE2ETestSuitePG_CH/Test_Binary_Format_Raw

Stack Traces | 129s run time

=== RUN   TestPeerFlowE2ETestSuitePG_CH/Test_Binary_Format_Raw
=== PAUSE TestPeerFlowE2ETestSuitePG_CH/Test_Binary_Format_Raw
=== CONT  TestPeerFlowE2ETestSuitePG_CH/Test_Binary_Format_Raw
2026/04/21 07:29:32 INFO Received AWS credentials from peer for connector: ci x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/21 07:29:32 INFO Received AWS credentials from peer for connector: clickhouse x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
    clickhouse_test.go:1064: WaitFor waiting for CDC count 2026-04-21 07:29:36.285511068 +0000 UTC m=+472.498384050
    clickhouse_test.go:1068: WaitFor waiting for CDC count 2026-04-21 07:29:36.290235508 +0000 UTC m=+472.503108510
    clickhouse.go:115: 
        	Error Trace:	.../flow/e2e/congen.go:44
        	            				.../flow/e2e/clickhouse.go:115
        	            				.../flow/e2e/clickhouse.go:97
        	            				.../flow/e2e/clickhouse.go:172
        	            				.../flow/e2e/test_utils.go:240
        	            				.../flow/e2e/test_utils.go:852
        	            				.../flow/e2e/test_utils.go:237
        	            				.../flow/e2e/clickhouse_test.go:1068
        	            				.../flow/e2e/clickhouse_test.go:1083
        	Error:      	Received unexpected error:
        	            	unable to establish connection with catalog: FATAL: terminating connection due to administrator command (SQLSTATE 57P01)
        	Test:       	TestPeerFlowE2ETestSuitePG_CH/Test_Binary_Format_Raw
    clickhouse.go:125: begin tearing down postgres schema pgch_b84odofs
2026/04/21 07:29:41 INFO fetched schema x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} table=e2e_test_mych_dut7jn7d.test_nullengine
    clickhouse.go:125: 
        	Error Trace:	.../flow/e2e/pg.go:148
        	            				.../flow/e2e/clickhouse.go:125
        	            				.../flow/e2eshared/e2eshared.go:38
        	            				.../hostedtoolcache/go/1.26.2.../src/testing/testing.go:1317
        	            				.../hostedtoolcache/go/1.26.2.../src/testing/testing.go:1667
        	            				.../hostedtoolcache/go/1.26.2.../src/testing/testing.go:2030
        	            				.../hostedtoolcache/go/1.26.2.../src/runtime/panic.go:694
        	            				.../hostedtoolcache/go/1.26.2.../src/testing/testing.go:1022
        	            				.../flow/e2e/congen.go:44
        	            				.../flow/e2e/clickhouse.go:115
        	            				.../flow/e2e/clickhouse.go:97
        	            				.../flow/e2e/clickhouse.go:172
        	            				.../flow/e2e/test_utils.go:240
        	            				.../flow/e2e/test_utils.go:852
        	            				.../flow/e2e/test_utils.go:237
        	            				.../flow/e2e/clickhouse_test.go:1068
        	            				.../flow/e2e/clickhouse_test.go:1083
        	Error:      	failed to teardown postgres schema
        	Test:       	TestPeerFlowE2ETestSuitePG_CH/Test_Binary_Format_Raw
        	Messages:   	pgch_b84odofs: failed to drop replication slots: ERROR: replication slot "peerflow_slot_ch_binary_format_raw_pgch_b84odofs" is active for PID 21032 (SQLSTATE 55006)
--- FAIL: TestPeerFlowE2ETestSuitePG_CH/Test_Binary_Format_Raw (129.36s)

To view more test analytics, go to the Test Analytics Dashboard
_{📋 Got 3 mins? Take this short survey to help us improve Test Analytics.}

github-actions · 2026-04-19T01:03:45Z

🔄 Flaky Test Detected

Analysis: The test failed due to a PostgreSQL catalog connection being forcibly terminated by an admin command (SQLSTATE 57P01 admin_shutdown), a transient infrastructure error unrelated to the test logic — all functional steps of the test completed successfully before this connection drop.
Confidence: 0.93

✅ Automatically retrying the workflow

View workflow run

github-actions · 2026-04-21T07:36:06Z

🔄 Flaky Test Detected

Analysis: Three different e2e tests failed across different matrix configurations with timing-related errors (ClickHouse table-not-ready race, snapshot status timeout, schema teardown failure), all consistent with flaky distributed-system integration tests rather than a code regression.
Confidence: 0.88

✅ Automatically retrying the workflow

View workflow run

Invalid sequence error is a known issue in the go-mysql-org client that needs to be classified. Previously fixed for cdc (#4197) but missing for snapshot during ExecuteSelectStreaming. Fixes: DBI-743

jgao54 requested a review from ilidemi April 18, 2026 23:42

classify mysql client transient error

fe52dc9

jgao54 force-pushed the mysql-sequence-err branch from 0754569 to fe52dc9 Compare April 19, 2026 00:44

ilidemi approved these changes Apr 20, 2026

View reviewed changes

lint

853df59

jgao54 enabled auto-merge (squash) April 21, 2026 07:17

jgao54 merged commit aff3b36 into main Apr 21, 2026
14 of 17 checks passed

jgao54 deleted the mysql-sequence-err branch April 21, 2026 07:52

github-actions Bot mentioned this pull request Apr 21, 2026

Tests reliability improvements: Connection parameters extraction logic unification #4192

Merged

2 tasks

jgao54 mentioned this pull request May 14, 2026

make sure streaming query handle invalid sequence error #4307

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

classify mysql client transient error#4197

classify mysql client transient error#4197
jgao54 merged 2 commits into
mainfrom
mysql-sequence-err

jgao54 commented Apr 18, 2026 •

edited

Loading

Uh oh!

codecov Bot commented Apr 19, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Apr 19, 2026

Uh oh!

github-actions Bot commented Apr 21, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

jgao54 commented Apr 18, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

codecov Bot commented Apr 19, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

❌ 2 Tests Failed:

Uh oh!

github-actions Bot commented Apr 19, 2026

🔄 Flaky Test Detected

Uh oh!

github-actions Bot commented Apr 21, 2026

🔄 Flaky Test Detected

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

jgao54 commented Apr 18, 2026 •

edited

Loading

codecov Bot commented Apr 19, 2026 •

edited

Loading