Ensure secret store cleanup

We don't seem to be properly disposing the secret stores created in the integration tests, and as a result we regularly hit the maximum number of secret stores limit.

Fixing this will improving CI reliability, instead of having to manually delete these.