Assistance Required: Issue with Bank-Vaults Deployment Using Multiple Replicas

[mallikharjunrao]

Hello Team,

I am reaching out to seek your assistance regarding an issue we are encountering with the Bank-Vaults Helm chart deployment in our Kubernetes cluster.

When we deploy with a single replica, everything works as expected. However, when we increase the replicas to more than one, we face intermittent issues when reading secrets from Vault. We tried with multiple backends like file system, mysql and azure container registry but the issues is same across. Specifically:

1. Sometimes, secrets cannot be fetched or read.
2. After a few refreshes or retries, the secrets becomes accessible.

It seems that the backend is not properly synced across all replicas, causing inconsistency in secret retrieval.

Here are the steps we’ve already taken:

1. Tested with all the latest versions of Bank-Vaults.
2. Tried the same setup with HCP Vault but encountered the same issue.

Currently, to avoid disruptions in our production environment, we are running the deployment with a single replica.

I am enclosing the values.yaml file used for the deployment to help you better understand the configuration.

Could you please guide us on how to address this issue and ensure proper synchronization across replicas? Your assistance in resolving this would be greatly appreciated.
values.yaml.zip

Looking forward to your response.