Got geo-rep session work with gluster 12dev but got error 12 and faulty status.

[gilbertoferreira]

Hi.
I have compile gluster 12dev and create geo-replication session between 2 gluster servers, with replicated volume.

I was able to create a session but got Faulty status

And /var/log/glusterfs/geo-replication/VMS_gluster3_VMS-REP/gsyncd.log show me this:

[2025-11-01 20:39:38.511597] E [syncdutils(worker /mnt/pve/data1/vms):845:errlog] Popen: command returned error [{cmd=rsync -aR0 --inplace --files-from=- --super --stats --numeric-ids --no-implied-dirs --existing --xattrs --acls --ignore-missing-args . -e ssh -oPasswordAuthentication=no -oStrictHostKeyChecking=no -i /var/lib/glusterd/geo-replication/secret.pem -p 22 -oControlMaster=auto -S /tmp/gsyncd-aux-ssh-qmhoz1_8/5afb71218219138854b3c5a8eab300a4.sock -caes128-ctr gluster3:/proc/1974/cwd}, {error=12}]

Any clue about this error=12?

Thanks a lot.

[gilbertoferreira]

Is there anybody here that can help this out?

[gilbertoferreira]

UPDATE:
I tried to create a sharedvolume, like explained here:

https://docs.redhat.com/en/documentation/red_hat_gluster_storage/3.3/html/administration_guide/chap-managing_red_hat_storage_volumes-shared_volume

But still got error 12

[2025-11-03 13:37:31.459012] I [gsyncdstatus(monitor):247:set_worker_status] GeorepStatus: Worker Status Change [{status=Initializing...}] [2025-11-03 13:37:31.459268] I [monitor(monitor):158:monitor] Monitor: starting gsyncd worker [{brick=/mnt/pve/data1/vms}, {secondary_node=gluster3}] [2025-11-03 13:37:31.527064] I [resource(worker /mnt/pve/data1/vms):1388:connect_remote] SSH: Initializing SSH connection between primary and secondary... [2025-11-03 13:37:32.545265] I [gsyncdstatus(monitor):247:set_worker_status] GeorepStatus: Worker Status Change [{status=Initializing...}] [2025-11-03 13:37:32.545449] I [monitor(monitor):158:monitor] Monitor: starting gsyncd worker [{brick=/mnt/pve/data2/vms}, {secondary_node=gluster3}] [2025-11-03 13:37:32.614946] I [resource(worker /mnt/pve/data2/vms):1388:connect_remote] SSH: Initializing SSH connection between primary and secondary... [2025-11-03 13:37:32.771637] I [resource(worker /mnt/pve/data1/vms):1436:connect_remote] SSH: SSH connection between primary and secondary established. [{duration=1.2444}] [2025-11-03 13:37:32.771819] I [resource(worker /mnt/pve/data1/vms):1117:connect] GLUSTER: Mounting gluster volume locally... [2025-11-03 13:37:33.798618] I [resource(worker /mnt/pve/data1/vms):1139:connect] GLUSTER: Mounted gluster volume [{duration=1.0267}] [2025-11-03 13:37:33.798823] I [subcmds(worker /mnt/pve/data1/vms):84:subcmd_worker] <top>: Worker spawn successful. Acknowledging back to monitor [2025-11-03 13:37:33.869329] I [resource(worker /mnt/pve/data2/vms):1436:connect_remote] SSH: SSH connection between primary and secondary established. [{duration=1.2542}] [2025-11-03 13:37:33.869484] I [resource(worker /mnt/pve/data2/vms):1117:connect] GLUSTER: Mounting gluster volume locally... [2025-11-03 13:37:34.896835] I [resource(worker /mnt/pve/data2/vms):1139:connect] GLUSTER: Mounted gluster volume [{duration=1.0273}] [2025-11-03 13:37:34.897061] I [subcmds(worker /mnt/pve/data2/vms):84:subcmd_worker] <top>: Worker spawn successful. Acknowledging back to monitor [2025-11-03 13:37:35.815670] I [primary(worker /mnt/pve/data1/vms):1662:register] _GPrimary: Working dir [{path=/var/lib/misc/gluster/gsyncd/VMS_gluster3_VMS-REP/mnt-pve-data1-vms}] [2025-11-03 13:37:35.815912] I [resource(worker /mnt/pve/data1/vms):1292:service_loop] GLUSTER: Register time [{time=1762177055}] [2025-11-03 13:37:35.822542] I [gsyncdstatus(worker /mnt/pve/data1/vms):280:set_active] GeorepStatus: Worker Status Change [{status=Active}] [2025-11-03 13:37:35.895263] I [gsyncdstatus(worker /mnt/pve/data1/vms):252:set_worker_crawl_status] GeorepStatus: Crawl Status Change [{status=History Crawl}] [2025-11-03 13:37:35.895486] I [primary(worker /mnt/pve/data1/vms):1573:crawl] _GPrimary: starting history crawl [{turns=1}, {stime=(1762175304, 0)}, {etime=1762177055}, {entry_stime=None}] [2025-11-03 13:37:36.896279] I [primary(worker /mnt/pve/data1/vms):1605:crawl] _GPrimary: secondary's time [{stime=(1762175304, 0)}] [2025-11-03 13:37:36.914763] I [primary(worker /mnt/pve/data2/vms):1662:register] _GPrimary: Working dir [{path=/var/lib/misc/gluster/gsyncd/VMS_gluster3_VMS-REP/mnt-pve-data2-vms}] [2025-11-03 13:37:36.914991] I [resource(worker /mnt/pve/data2/vms):1292:service_loop] GLUSTER: Register time [{time=1762177056}] [2025-11-03 13:37:36.921146] I [gsyncdstatus(worker /mnt/pve/data2/vms):280:set_active] GeorepStatus: Worker Status Change [{status=Active}] [2025-11-03 13:37:36.988434] I [gsyncdstatus(worker /mnt/pve/data2/vms):252:set_worker_crawl_status] GeorepStatus: Crawl Status Change [{status=History Crawl}] [2025-11-03 13:37:36.988660] I [primary(worker /mnt/pve/data2/vms):1573:crawl] _GPrimary: starting history crawl [{turns=1}, {stime=(1762175304, 0)}, {etime=1762177056}, {entry_stime=None}] [2025-11-03 13:37:37.330523] I [primary(worker /mnt/pve/data1/vms):2010:syncjob] Syncer: Sync Time Taken [{job=1}, {num_files=3}, {return_code=12}, {duration=0.0293}] [2025-11-03 13:37:37.330739] E [syncdutils(worker /mnt/pve/data1/vms):845:errlog] Popen: command returned error [{cmd=rsync -aR0 --inplace --files-from=- --super --stats --numeric-ids --no-implied-dirs --existing --xattrs --acls --ignore-missing-args . -e ssh -oPasswordAuthentication=no -oStrictHostKeyChecking=no -i /var/lib/glusterd/geo-replication/secret.pem -p 22 -oControlMaster=auto -S /tmp/gsyncd-aux-ssh-_w0zcap_/5afb71218219138854b3c5a8eab300a4.sock -caes128-ctr gluster3:/proc/12571/cwd}, {error=12}] [2025-11-03 13:37:37.799707] I [monitor(monitor):227:monitor] Monitor: worker died in startup phase [{brick=/mnt/pve/data1/vms}] [2025-11-03 13:37:37.802125] I [gsyncdstatus(monitor):247:set_worker_status] GeorepStatus: Worker Status Change [{status=Faulty}] [2025-11-03 13:37:37.989516] I [primary(worker /mnt/pve/data2/vms):1605:crawl] _GPrimary: secondary's time [{stime=(1762175304, 0)}] [2025-11-03 13:37:38.429188] I [primary(worker /mnt/pve/data2/vms):2010:syncjob] Syncer: Sync Time Taken [{job=1}, {num_files=3}, {return_code=12}, {duration=0.0294}] [2025-11-03 13:37:38.429350] E [syncdutils(worker /mnt/pve/data2/vms):845:errlog] Popen: command returned error [{cmd=rsync -aR0 --inplace --files-from=- --super --stats --numeric-ids --no-implied-dirs --existing --xattrs --acls --ignore-missing-args . -e ssh -oPasswordAuthentication=no -oStrictHostKeyChecking=no -i /var/lib/glusterd/geo-replication/secret.pem -p 22 -oControlMaster=auto -S /tmp/gsyncd-aux-ssh-lrbn0s_8/5afb71218219138854b3c5a8eab300a4.sock -caes128-ctr gluster3:/proc/12622/cwd}, {error=12}] [2025-11-03 13:37:38.897872] I [monitor(monitor):227:monitor] Monitor: worker died in startup phase [{brick=/mnt/pve/data2/vms}] [2025-11-03 13:37:38.900359] I [gsyncdstatus(monitor):247:set_worker_status] GeorepStatus: Worker Status Change [{status=Faulty}]

[gilbertoferreira]

Today I relize that the geo-replication session in fact create the VM file in the other side, dispite the faulty warnning.
But the file has 0 size!
How could that be?

[gilbertoferreira]

Hi there.

Any news about this issue?

Thanks