Description
What happened?
I'm writing Pulumi stacks using C#. When explicitly defining Kubernetes providers, the calculated state depends on the KUBECONFIG
environment variable. If the variable is set, Pulumi will store its value to a state as a kubeconfig
parameter for a kubernetes provider.
This behavior causes issues during the refresh phase. The stored kubeconfig
value points to the path of the kubeconfig file from the original environment. If the refresh operation is executed on another machine where the kubeconfig file is located at a different path, the operation fails.
I believe that the kubeconfig localion should only be stored in the state if it's explicitly defined in the provider code, rather than relying on environment variables. Additionally, I could not reproduce this issue with YAML-defined stacks, so the behavior is not consistent between languages.
Example
On a Linux/MacOS:
- Create a new project with
pulumi new kubernetes-csharp
- Update
Program.cs
to contain just a one-liner:
return await Pulumi.Deployment.RunAsync(() => new Pulumi.Kubernetes.Provider("k8s"));
- Make sure the
KUBECONFIG
is not set:
unset KUBECONFIG
- Deploy the stack with
pulumi up
:
Type Name Status
+ pulumi:pulumi:Stack pulmi-kubeconfig-dev created (2s)
+ └─ pulumi:providers:kubernetes k8s created (0.29s)
Resources:
+ 2 created
- Set some
KUBECONFIG
value:
export KUBECONFIG=~/.kube/config
- Update the stack with
pulumi up
. It will try to update the k8s provider with a newkubeconfig
value:
Type Name Plan Info
pulumi:pulumi:Stack pulmi-kubeconfig-dev
~ └─ pulumi:providers:kubernetes k8s update [diff: +kubeconfig]
Resources:
~ 1 to update
1 unchanged
Output of pulumi about
CLI
Version 3.124.0
Go Version go1.22.5
Go Compiler gc
Plugins
KIND NAME VERSION
language dotnet unknown
resource kubernetes 4.18.1
Host
OS darwin
Version 14.6.1
Arch x86_64
This project is written in dotnet: executable='/usr/local/share/dotnet/dotnet' version='8.0.204'
Current Stack: my_org/pulmi-kubeconfig/dev
TYPE URN
pulumi:pulumi:Stack urn:pulumi:dev::pulmi-kubeconfig::pulumi:pulumi:Stack::pulmi-kubeconfig-dev
pulumi:providers:kubernetes urn:pulumi:dev::pulmi-kubeconfig::pulumi:providers:kubernetes::k8s
Found no pending operations associated with dev
Backend
Name pulumi.com
URL https://app.pulumi.com/serhii_samoilenko
User serhii_samoilenko
Organizations serhii_samoilenko
Token type personal
Dependencies:
NAME VERSION
Pulumi 3.67.1
Pulumi.Kubernetes 4.18.1
Additional context
No response
Contributing
Vote on this issue by adding a 👍 reaction.
To contribute a fix for this issue, leave a comment (and link to your pull request, if you've opened one already).