cannot take volumesnapshot

[saqibzaib]

time="2022-07-18T19:30:43Z" level=error msg="Error getting volume snapshotter for volume snapshot location" backup=velero/mysql-backup error="rpc error: code = Unknown desc = Error fetching OpenEBS rest client address" error.file="/home/travis/gopath/src/github.com/openebs/velero-plugin/pkg/cstor/cstor.go:192" error.function="github.com/openebs/velero-plugin/pkg/cstor.(*Plugin).Init" logSource="pkg/backup/item_backupper.go:453" name=pvc-5df7dc7e-2f9f-4566-9a76-ac5a278893aa namespace= persistentVolume=pvc-5df7dc7e-2f9f-4566-9a76-ac5a278893aa resource=persistentvolumes volumeSnapshotLocation=default

[jadsy2107]

time="2022-11-16T01:41:39Z" level=error msg="Error getting volume snapshotter for volume snapshot location" backup=velero/npm error="rpc error: code = Unknown desc = Error fetching OpenEBS rest client address" error.file="/home/travis/gopath/src/github.com/openebs/velero-plugin/pkg/cstor/cstor.go:192" error.function="github.com/openebs/velero-plugin/pkg/cstor.(*Plugin).Init" logSource="pkg/backup/item_backupper.go:470" name=pvc-bb7f6461-315f-4976-8fdd-100e5139fb21 namespace= persistentVolume=pvc-bb7f6461-315f-4976-8fdd-100e5139fb21 resource=persistentvolumes volumeSnapshotLocation=default
time="2022-11-16T01:41:39Z" level=error msg="Error getting volume snapshotter for volume snapshot location" backup=velero/npm error="rpc error: code = Unknown desc = Error fetching OpenEBS rest client address" error.file="/home/travis/gopath/src/github.com/openebs/velero-plugin/pkg/cstor/cstor.go:192" error.function="github.com/openebs/velero-plugin/pkg/cstor.(*Plugin).Init" logSource="pkg/backup/item_backupper.go:470" name=pvc-e383c200-6da8-416b-95c0-a6365eaa7961 namespace= persistentVolume=pvc-e383c200-6da8-416b-95c0-a6365eaa7961 resource=persistentvolumes volumeSnapshotLocation=default

Having same issue

[jadsy2107]

Any known fix / work around ?

[Langhalsdino]

I have the same issue. How did you solve it @jadsy2107 @saqibzaib ?

[lizhifengones]

I also encountered this problem in 1.9, and it was solved by upgrading to 1.11.0

openebs/velero-plugin:1.11.0

# kubectl exec -n velero $(kubectl get po -n velero -l component=velero -oname | head -n 1)  -it -- /velero backup logs nginx-backup-with-pv-6 |grep -iE  "resource=persistentvolumes|velero-blockstore-cstor"
time="2023-09-21T07:22:54Z" level=info msg="Getting items for resource" backup=velero/nginx-backup-with-pv-6 group=v1 logSource="pkg/backup/item_collector.go:198" resource=persistentvolumes
time="2023-09-21T07:22:54Z" level=info msg="Skipping resource because it's excluded" backup=velero/nginx-backup-with-pv-6 group=v1 logSource="pkg/backup/item_collector.go:254" resource=persistentvolumes
time="2023-09-21T07:22:56Z" level=info msg="Backing up item" backup=velero/nginx-backup-with-pv-6 logSource="pkg/backup/item_backupper.go:173" name=pvc-c38130fb-a765-4aa4-96e8-cfce81e8c3de namespace= resource=persistentvolumes
time="2023-09-21T07:22:56Z" level=info msg="Executing takePVSnapshot" backup=velero/nginx-backup-with-pv-6 logSource="pkg/backup/item_backupper.go:461" name=pvc-c38130fb-a765-4aa4-96e8-cfce81e8c3de namespace= resource=persistentvolumes
time="2023-09-21T07:22:56Z" level=info msg="label \"topology.kubernetes.io/zone\" is not present on PersistentVolume, checking deprecated label..." backup=velero/nginx-backup-with-pv-6 logSource="pkg/backup/item_backupper.go:504" name=pvc-c38130fb-a765-4aa4-96e8-cfce81e8c3de namespace= persistentVolume=pvc-c38130fb-a765-4aa4-96e8-cfce81e8c3de resource=persistentvolumes
time="2023-09-21T07:22:56Z" level=info msg="label \"failure-domain.beta.kubernetes.io/zone\" is not present on PersistentVolume" backup=velero/nginx-backup-with-pv-6 logSource="pkg/backup/item_backupper.go:508" name=pvc-c38130fb-a765-4aa4-96e8-cfce81e8c3de namespace= persistentVolume=pvc-c38130fb-a765-4aa4-96e8-cfce81e8c3de resource=persistentvolumes
time="2023-09-21T07:22:56Z" level=info msg="zone info not available in nodeAffinity requirements" backup=velero/nginx-backup-with-pv-6 logSource="pkg/backup/item_backupper.go:513" name=pvc-c38130fb-a765-4aa4-96e8-cfce81e8c3de namespace= persistentVolume=pvc-c38130fb-a765-4aa4-96e8-cfce81e8c3de resource=persistentvolumes
time="2023-09-21T07:22:56Z" level=info msg="Initializing velero plugin for CStor" backup=velero/nginx-backup-with-pv-6 cmd=/plugins/velero-blockstore-cstor logSource="/home/travis/gopath/src/github.com/openebs/velero-plugin/pkg/snapshot/snap.go:36" pluginName=velero-blockstore-cstor
time="2023-09-21T07:22:56Z" level=info msg="Ip address of velero-plugin server: 10.42.0.50" backup=velero/nginx-backup-with-pv-6 cmd=/plugins/velero-blockstore-cstor logSource="/home/travis/gopath/src/github.com/openebs/velero-plugin/pkg/cstor/cstor.go:182" pluginName=velero-blockstore-cstor
time="2023-09-21T07:22:56Z" level=info msg="Got volume ID for persistent volume" backup=velero/nginx-backup-with-pv-6 logSource="pkg/backup/item_backupper.go:541" name=pvc-c38130fb-a765-4aa4-96e8-cfce81e8c3de namespace= persistentVolume=pvc-c38130fb-a765-4aa4-96e8-cfce81e8c3de resource=persistentvolumes volumeSnapshotLocation=minio
time="2023-09-21T07:22:56Z" level=info msg="Getting volume information" backup=velero/nginx-backup-with-pv-6 logSource="pkg/backup/item_backupper.go:562" name=pvc-c38130fb-a765-4aa4-96e8-cfce81e8c3de namespace= persistentVolume=pvc-c38130fb-a765-4aa4-96e8-cfce81e8c3de resource=persistentvolumes volumeID=pvc-c38130fb-a765-4aa4-96e8-cfce81e8c3de
time="2023-09-21T07:22:56Z" level=info msg="Snapshotting persistent volume" backup=velero/nginx-backup-with-pv-6 logSource="pkg/backup/item_backupper.go:568" name=pvc-c38130fb-a765-4aa4-96e8-cfce81e8c3de namespace= persistentVolume=pvc-c38130fb-a765-4aa4-96e8-cfce81e8c3de resource=persistentvolumes volumeID=pvc-c38130fb-a765-4aa4-96e8-cfce81e8c3de
time="2023-09-21T07:22:56Z" level=info msg="Writing to {backup/backups/nginx-backup-with-pv-6/pvc-c38130fb-a765-4aa4-96e8-cfce81e8c3de-nginx-backup-with-pv-6.pvc} with provider{aws} to bucket{velero}" backup=velero/nginx-backup-with-pv-6 cmd=/plugins/velero-blockstore-cstor logSource="/home/travis/gopath/src/github.com/openebs/velero-plugin/pkg/clouduploader/operation.go:91" pluginName=velero-blockstore-cstor
time="2023-09-21T07:22:56Z" level=info msg="successfully writtern object{backup/backups/nginx-backup-with-pv-6/pvc-c38130fb-a765-4aa4-96e8-cfce81e8c3de-nginx-backup-with-pv-6.pvc} to {aws}" backup=velero/nginx-backup-with-pv-6 cmd=/plugins/velero-blockstore-cstor logSource="/home/travis/gopath/src/github.com/openebs/velero-plugin/pkg/clouduploader/operation.go:111" pluginName=velero-blockstore-cstor
time="2023-09-21T07:22:56Z" level=info msg="creating snapshot{nginx-backup-with-pv-6}" backup=velero/nginx-backup-with-pv-6 cmd=/plugins/velero-blockstore-cstor logSource="/home/travis/gopath/src/github.com/openebs/velero-plugin/pkg/cstor/cstor.go:408" pluginName=velero-blockstore-cstor
time="2023-09-21T07:22:58Z" level=info msg="Snapshot Successfully Created" backup=velero/nginx-backup-with-pv-6 cmd=/plugins/velero-blockstore-cstor logSource="/home/travis/gopath/src/github.com/openebs/velero-plugin/pkg/cstor/cstor.go:415" pluginName=velero-blockstore-cstor
time="2023-09-21T07:22:58Z" level=info msg="Uploading snapshot to 'backup/backups/nginx-backup-with-pv-6/pvc-c38130fb-a765-4aa4-96e8-cfce81e8c3de-nginx-backup-with-pv-6' with provider{aws} to bucket{velero}" backup=velero/nginx-backup-with-pv-6 cmd=/plugins/velero-blockstore-cstor logSource="/home/travis/gopath/src/github.com/openebs/velero-plugin/pkg/clouduploader/operation.go:30" pluginName=velero-blockstore-cstor
time="2023-09-21T07:23:04Z" level=info msg="Client{16} operation completed.. completed count{1}" backup=velero/nginx-backup-with-pv-6 cmd=/plugins/velero-blockstore-cstor logSource="/home/travis/gopath/src/github.com/openebs/velero-plugin/pkg/clouduploader/server_utils.go:178" pluginName=velero-blockstore-cstor
time="2023-09-21T07:23:08Z" level=info msg="executing clean-up request.. snapshot=nginx-backup-with-pv-6 volume=pvc-c38130fb-a765-4aa4-96e8-cfce81e8c3de ns=nginx-example backup=nginx-backup-with-pv-6" backup=velero/nginx-backup-with-pv-6 cmd=/plugins/velero-blockstore-cstor logSource="/home/travis/gopath/src/github.com/openebs/velero-plugin/pkg/cstor/status.go:156" pluginName=velero-blockstore-cstor
time="2023-09-21T07:23:09Z" level=info msg="Transfer done.. closing the server" backup=velero/nginx-backup-with-pv-6 cmd=/plugins/velero-blockstore-cstor logSource="/home/travis/gopath/src/github.com/openebs/velero-plugin/pkg/clouduploader/server.go:309" pluginName=velero-blockstore-cstor
time="2023-09-21T07:23:09Z" level=info msg="successfully uploaded object{backup/backups/nginx-backup-with-pv-6/pvc-c38130fb-a765-4aa4-96e8-cfce81e8c3de-nginx-backup-with-pv-6} to {aws}" backup=velero/nginx-backup-with-pv-6 cmd=/plugins/velero-blockstore-cstor logSource="/home/travis/gopath/src/github.com/openebs/velero-plugin/pkg/clouduploader/operation.go:56" pluginName=velero-blockstore-cstor