Skip to content

Unable to re-sync a cluster #208

@Loumy

Description

@Loumy

When galera is not sync, unable to re-sync

openstack-galera-2                                                0/1     CrashLoopBackOff   6 (3m49s ago)   10m

So I delete resource and wait to get it again

oc delete pod/openstack-galera-2 pvc/mysql-db-openstack-galera-2

Here the log

2024-03-11 14:50:31 2 [Note] WSREP: Server status change connected -> joiner
2024-03-11 14:50:31 0 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address 'openstack-galera-2.openstack-galera' --datadir '/var/lib/mysql/' --parent 7 --progress 0 --mysqld-args --wsrep-cluster-address=gcomm://openstack-galera-0.openstack-galera.openstack.svc,openstack-galera-1.openstack-galera.openstack.svc,openstack-galera-2.openstack-galera.openstack.svc'
2024-03-11 14:50:31 0 [Note] WSREP: Joiner monitor thread started to monitor
WSREP_SST: [INFO] rsync SST started on joiner (20240311 14:50:31.622)
WSREP_SST: [INFO] Using stunnel for SSL encryption: CA: '/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem', CAPATH='', ssl-mode='REQUIRED' (20240311 14:50:31.752)
2024-03-11 14:50:31 2 [Note] WSREP: ####### IST uuid:00000000-0000-0000-0000-000000000000 f: 0, l: 150462, STRv: 3
2024-03-11 14:50:31 2 [Note] WSREP: IST receiver addr using ssl://openstack-galera-2.openstack-galera:4568
2024-03-11 14:50:31 2 [Note] WSREP: IST receiver using ssl
2024-03-11 14:50:31 2 [Note] WSREP: Prepared IST receiver for 0-150462, listening at: ssl://10.129.0.220:4568
2024-03-11 14:50:31 0 [Note] WSREP: Member 2.0 (openstack-galera-2) requested state transfer from '*any*'. Selected 0.0 (openstack-galera-1)(SYNCED) as donor.
2024-03-11 14:50:31 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 150462)
2024-03-11 14:50:31 2 [Note] WSREP: Requesting state transfer: success, donor: 0
2024-03-11 14:50:31 2 [Note] WSREP: Resetting GCache seqno map due to different histories.
2024-03-11 14:50:31 2 [Note] WSREP: GCache history reset: 20dd30fa-d64d-11ee-82fd-8b93fd252e8c:0 -> 20dd30fa-d64d-11ee-82fd-8b93fd252e8c:150462
2024-03-11 14:50:32 0 [Warning] WSREP: 0.0 (openstack-galera-1): State transfer to 2.0 (openstack-galera-2) failed: -1 (Operation not permitted)
2024-03-11 14:50:32 0 [ERROR] WSREP: /builddir/build/BUILD/galera-26.4.16/gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():1207: Will never receive state. Need to abort.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions