Keyvault access is not working until app is restarted

Following the readme here:
https://github.com/Azure-Samples/acme-fitness-store/#activate-applications-to-load-secrets-from-azure-key-vault

It seems that the apps are in a failing state due to access permissions to key vault.
Only after restarting the apps I was able to connect to key vault and the app will run.