proxmox_virtual_environment_file source_raw does not work

[nakamorichi]

Describe the bug

source_raw property of proxmox_virtual_environment_file resource does not work. By 'does not work' I mean I'm not able to get it to work in any kind of way at all.

How to reproduce

resource "proxmox_virtual_environment_file" "test_snippet" {
  node_name    = var.pve_node_name
  datastore_id = "local"
  content_type = "snippets"

  source_raw {
    data = "test"

    file_name = "test.txt"
  }
}

and the output of terraform|tofu apply.

When applying changes to proxmox_virtual_environment_file.test_snippet, provider "provider[\"registry.opentofu.org/bpg/proxmox\"]" produced an unexpected new value: Root object was present, but now absent.

Expected behavior
Snippet created with the content provided via source_raw.

Additional context
Add any other context about the problem here.

• Single or clustered Proxmox: single
• Proxmox version: 8.3.4
• Provider version (ideally it should be the latest version): 0.73
• Terraform/OpenTofu version: OpenTofu v1.9.0
• OS (where you run Terraform/OpenTofu from): macOS 15.3.1
• Debug logs (TF_LOG=DEBUG terraform apply): see relevant part below

2025-02-27T23:52:37.613+0900 [WARN]  Provider "provider[\"registry.opentofu.org/bpg/proxmox\"]" produced an invalid plan for proxmox_virtual_environment_file.test_snippet, but we are tolerating it because it is using the legacy plugin SDK.
    The following problems may be the cause of any confusing errors from downstream operations:
      - .overwrite: planned value cty.True for a non-computed attribute
      - .timeout_upload: planned value cty.NumberIntVal(1800) for a non-computed attribute
      - .source_raw[0].resize: planned value cty.NumberIntVal(0) for a non-computed attribute

#1749 (comment)

[bpg]

Hey @nakamorichi! 👋🏼

Your example works in my environment without any issues.

❯ tofu apply -auto-approve

OpenTofu used the selected providers to generate the following execution plan. Resource actions are indicated with the following symbols:
  + create

OpenTofu will perform the following actions:

  # proxmox_virtual_environment_file.test_snippet will be created
  + resource "proxmox_virtual_environment_file" "test_snippet" {
      + content_type           = "snippets"
      + datastore_id           = "local"
      + file_modification_date = (known after apply)
      + file_name              = (known after apply)
      + file_size              = (known after apply)
      + file_tag               = (known after apply)
      + id                     = (known after apply)
      + node_name              = "pve"
      + overwrite              = true
      + timeout_upload         = 1800

      + source_raw {
          + data      = "test"
          + file_name = "test.txt"
          + resize    = 0
        }
    }

Plan: 1 to add, 0 to change, 0 to destroy.
proxmox_virtual_environment_file.test_snippet: Creating...
proxmox_virtual_environment_file.test_snippet: Creation complete after 1s [id=local:snippets/test.txt]

Apply complete! Resources: 1 added, 0 changed, 0 destroyed.

In fact, all examples (like here or here) are regularly tested, at least once before each release.

The snippet upload is using SSH, so there could be some specifics of your configuration that prevent provider from successfully upload the file. Unfortunately, the log you provided is not enough to investigate further. There should be records above that line containing information about the ssh connection establishment and commands used to copy the file. Could you provide those, and also additional details about your ssh config? If you can paste your provider's config that would be great.

Also please check https://registry.terraform.io/providers/bpg/proxmox/latest/docs#ssh-connection
Make sure you can do ssh terraform@<target-node> sudo pvesm apiinfo (or root@<target-node> if you haven't set up a separate user account for the provider) without a password prompt.

[nakamorichi]

@bpg I tried running the command also from a Linux VM, but same result. source_file argument works, though. In case the issue is related to SSH, is source_file argument not using SSH?

[nakamorichi]

Is it possible that this could be related? #211

[frostyfab]

Seeing the same issue. I tried to downgrade to v0.70 but to no avail. The reason for the downgrade was that it worked less than a week ago for me. I suspect something is funky with Proxmox 8.3 ...

Single or clustered Proxmox: single
Proxmox version: 8.3.4/65224a0f9cd294a3 (running kernel: 6.8.12-8-pve)
Provider version (ideally it should be the latest version): 0.73
Terraform/OpenTofu version: Terraform v1.10.5
OS (where you run Terraform/OpenTofu from): Manjaro Linux 6.12.12-2
Debug logs (TF_LOG=DEBUG terraform apply): see relevant part below

I tried to isolate my failure case to one VM and provided a log that is more complete. From what I gleam from it the SSH connection is fine but then the file just does not exist:

module.dev_cluster.module.worker[0].proxmox_virtual_environment_file.cloud_config: Creating...
2025-03-03T20:41:39.062+0100 [INFO]  Starting apply for module.dev_cluster.module.worker[0].proxmox_virtual_environment_file.cloud_config
2025-03-03T20:41:39.062+0100 [DEBUG] module.dev_cluster.module.worker[0].proxmox_virtual_environment_file.cloud_config: applying the planned Create change
2025-03-03T20:41:39.064+0100 [DEBUG] provider.terraform-provider-proxmox_v0.73.0: Sending authentication request: tf_mux_provider=tf5to6server.v5tov6Server tf_req_id=d1b1af95-39f3-90bd-4b7e-147ab2445137 @module=proxmox path=/api2/json/access/ticket tf_provider_addr=registry.terraform.io/bpg/proxmox tf_resource_type=proxmox_virtual_environment_file tf_rpc=ApplyResourceChange @caller=/home/runner/work/terraform-provider-proxmox/terraform-provider-proxmox/proxmox/api/user_auth.go:77 timestamp="2025-03-03T20:41:39.063+0100"
2025-03-03T20:41:39.064+0100 [DEBUG] provider.terraform-provider-proxmox_v0.73.0: Sending HTTP Request: tf_http_req_version=HTTP/1.1 tf_http_trans_id=ddd7f624-7044-3726-8dad-3476f4fed10b tf_mux_provider=tf5to6server.v5tov6Server tf_http_req_body="username=root%40pam&password=coldlab20250303" tf_resource_type=proxmox_virtual_environment_file Accept-Encoding=gzip Content-Length=44 Host=192.168.2.135:8006 User-Agent=Go-http-client/1.1 tf_http_req_uri=/api2/json/access/ticket @caller=/home/runner/go/pkg/mod/github.com/hashicorp/terraform-plugin-sdk/v2@v2.36.1/helper/logging/logging_http_transport.go:162 Content-Type=application/x-www-form-urlencoded tf_http_op_type=request tf_http_req_method=POST tf_provider_addr=registry.terraform.io/bpg/proxmox tf_req_id=d1b1af95-39f3-90bd-4b7e-147ab2445137 tf_rpc=ApplyResourceChange @module=proxmox timestamp="2025-03-03T20:41:39.064+0100"
2025-03-03T20:41:39.130+0100 [DEBUG] provider.terraform-provider-proxmox_v0.73.0: Received HTTP Response: Expires="Mon, 03 Mar 2025 19:41:39 GMT" Pragma=no-cache Server=pve-api-daemon/3.0 tf_req_id=d1b1af95-39f3-90bd-4b7e-147ab2445137 @caller=/home/runner/go/pkg/mod/github.com/hashicorp/terraform-plugin-sdk/v2@v2.36.1/helper/logging/logging_http_transport.go:162 @module=proxmox tf_http_op_type=response tf_http_res_status_code=200 tf_http_res_status_reason="200 OK" tf_mux_provider=tf5to6server.v5tov6Server Cache-Control=max-age=0 Date="Mon, 03 Mar 2025 19:41:39 GMT" tf_http_res_body="{\"data\":{\"username\":\"root@pam\",\"ticket\":\"PVE:root@pam:67C605F3::zVRwaQm5IpF/G2Bh/O6kkjF35lSwFc/pUoZzB112CHTnX2j1cGsJ2I9MWUIXosDG8Ngsfz3wNz08M+gTe0xgMhkadK5EzUSiLwUkXNaZpl12feFFtQPoysqve7gBob+uVT8gMFBoW4Uo579or5ZjOu1WnTld6qL/99ZT1vZ/2bUUquYnyj+D1+MiCNItVugT1W7wNQQfRfvu5PBz6neb4ThzNgtIB2cFOcBuXypT0r6Z5yOhnYJhfQM25MwvLZ3scM26YZCtUOeDeF5X6F67fZwFuR3IkYPX2KY4umecIJOpQ10kv1b0l6cKjx5FlP+5IpTlD0mEhiEPPZz2hX2vbg==\",\"cap\":{\"sdn\":{\"SDN.Use\":1,\"Permissions.Modify\":1,\"SDN.Allocate\":1,\"SDN.Audit\":1},\"storage\":{\"Datastore.AllocateSpace\":1,\"Datastore.Audit\":1,\"Permissions.Modify\":1,\"Datastore.Allocate\":1,\"Datastore.AllocateTemplate\":1},\"nodes\":{\"Sys.Syslog\":1,\"Sys.PowerMgmt\":1,\"Sys.AccessNetwork\":1,\"Sys.Modify\":1,\"Sys.Incoming\":1,\"Sys.Audit\":1,\"Permissions.Modify\":1,\"Sys.Console\":1},\"vms\":{\"VM.Monitor\":1,\"VM.PowerMgmt\":1,\"VM.Snapshot\":1,\"Permissions.Modify\":1,\"VM.Migrate\":1,\"VM.Config.Memory\":1,\"VM.Clone\":1,\"VM.Config.CPU\":1,\"VM.Snapshot.Rollback\":1,\"VM.Allocate\":1,\"VM.Config.Disk\":1,\"VM.Config.HWType\":1,\"VM.Config.Options\":1,\"VM.Config.CDROM\":1,\"VM.Config.Cloudinit\":1,\"VM.Config.Network\":1,\"VM.Console\":1,\"VM.Audit\":1,\"VM.Backup\":1},\"mapping\":{\"Mapping.Use\":1,\"Permissions.Modify\":1,\"Mapping.Modify\":1,\"Mapping.Audit\":1},\"access\":{\"Permissions.Modify\":1,\"Group.Allocate\":1,\"User.Modify\":1},\"dc\":{\"Sys.Audit\":1,\"SDN.Use\":1,\"Sys.Modify\":1,\"SDN.Allocate\":1,\"SDN.Audit\":1}},\"CSRFPreventionToken\":\"67C605F3:Kj9CDrOjtF3y6ikn82EqEYh/fiZMsKyoYQNPY+pgVpg\"}}" tf_http_res_version=HTTP/1.1 tf_provider_addr=registry.terraform.io/bpg/proxmox tf_resource_type=proxmox_virtual_environment_file Content-Type=application/json;charset=UTF-8 tf_http_trans_id=ddd7f624-7044-3726-8dad-3476f4fed10b tf_rpc=ApplyResourceChange timestamp="2025-03-03T20:41:39.130+0100"
2025-03-03T20:41:39.131+0100 [DEBUG] provider.terraform-provider-proxmox_v0.73.0: Sending HTTP Request: Host=192.168.2.135:8006 User-Agent=Go-http-client/1.1 tf_http_req_method=GET tf_http_trans_id=1b856556-6609-135e-e2a3-cdce22e841f8 tf_provider_addr=registry.terraform.io/bpg/proxmox tf_req_id=d1b1af95-39f3-90bd-4b7e-147ab2445137 tf_rpc=ApplyResourceChange Cookie="PVEAuthCookie=PVE:root@pam:67C605F3::zVRwaQm5IpF/G2Bh/O6kkjF35lSwFc/pUoZzB112CHTnX2j1cGsJ2I9MWUIXosDG8Ngsfz3wNz08M+gTe0xgMhkadK5EzUSiLwUkXNaZpl12feFFtQPoysqve7gBob+uVT8gMFBoW4Uo579or5ZjOu1WnTld6qL/99ZT1vZ/2bUUquYnyj+D1+MiCNItVugT1W7wNQQfRfvu5PBz6neb4ThzNgtIB2cFOcBuXypT0r6Z5yOhnYJhfQM25MwvLZ3scM26YZCtUOeDeF5X6F67fZwFuR3IkYPX2KY4umecIJOpQ10kv1b0l6cKjx5FlP+5IpTlD0mEhiEPPZz2hX2vbg==" tf_mux_provider=tf5to6server.v5tov6Server tf_resource_type=proxmox_virtual_environment_file @module=proxmox Accept=application/json tf_http_req_uri=/api2/json/nodes/frostylab/storage/local/content Accept-Encoding=gzip tf_http_op_type=request tf_http_req_body="" tf_http_req_version=HTTP/1.1 @caller=/home/runner/go/pkg/mod/github.com/hashicorp/terraform-plugin-sdk/v2@v2.36.1/helper/logging/logging_http_transport.go:162 timestamp="2025-03-03T20:41:39.130+0100"
2025-03-03T20:41:39.154+0100 [DEBUG] provider.terraform-provider-proxmox_v0.73.0: Received HTTP Response: Pragma=no-cache tf_http_res_body="{\"data\":[{\"format\":\"iso\",\"size\":610110464,\"ctime\":1741029195,\"content\":\"iso\",\"volid\":\"local:iso/noble-server-cloudimg-amd64.img\"}]}" tf_http_res_status_code=200 tf_rpc=ApplyResourceChange Cache-Control=max-age=0 tf_http_res_version=HTTP/1.1 tf_resource_type=proxmox_virtual_environment_file Server=pve-api-daemon/3.0 tf_http_res_status_reason="200 OK" Expires="Mon, 03 Mar 2025 19:41:39 GMT" tf_mux_provider=tf5to6server.v5tov6Server tf_provider_addr=registry.terraform.io/bpg/proxmox tf_req_id=d1b1af95-39f3-90bd-4b7e-147ab2445137 @module=proxmox Content-Length=131 Date="Mon, 03 Mar 2025 19:41:39 GMT" tf_http_trans_id=1b856556-6609-135e-e2a3-cdce22e841f8 @caller=/home/runner/go/pkg/mod/github.com/hashicorp/terraform-plugin-sdk/v2@v2.36.1/helper/logging/logging_http_transport.go:162 Content-Type=application/json;charset=UTF-8 tf_http_op_type=response timestamp="2025-03-03T20:41:39.154+0100"
2025-03-03T20:41:39.155+0100 [DEBUG] provider.terraform-provider-proxmox_v0.73.0: Sending HTTP Request: Accept-Encoding=gzip Host=192.168.2.135:8006 tf_http_req_uri=/api2/json/storage/local tf_http_trans_id=19c6dc22-95b3-db05-f105-5f4dbc0a3e65 tf_provider_addr=registry.terraform.io/bpg/proxmox User-Agent=Go-http-client/1.1 tf_http_req_version=HTTP/1.1 tf_rpc=ApplyResourceChange @caller=/home/runner/go/pkg/mod/github.com/hashicorp/terraform-plugin-sdk/v2@v2.36.1/helper/logging/logging_http_transport.go:162 Accept=application/json tf_http_req_body="" tf_http_req_method=GET tf_req_id=d1b1af95-39f3-90bd-4b7e-147ab2445137 tf_resource_type=proxmox_virtual_environment_file @module=proxmox Cookie="PVEAuthCookie=PVE:root@pam:67C605F3::zVRwaQm5IpF/G2Bh/O6kkjF35lSwFc/pUoZzB112CHTnX2j1cGsJ2I9MWUIXosDG8Ngsfz3wNz08M+gTe0xgMhkadK5EzUSiLwUkXNaZpl12feFFtQPoysqve7gBob+uVT8gMFBoW4Uo579or5ZjOu1WnTld6qL/99ZT1vZ/2bUUquYnyj+D1+MiCNItVugT1W7wNQQfRfvu5PBz6neb4ThzNgtIB2cFOcBuXypT0r6Z5yOhnYJhfQM25MwvLZ3scM26YZCtUOeDeF5X6F67fZwFuR3IkYPX2KY4umecIJOpQ10kv1b0l6cKjx5FlP+5IpTlD0mEhiEPPZz2hX2vbg==" tf_http_op_type=request tf_mux_provider=tf5to6server.v5tov6Server timestamp="2025-03-03T20:41:39.155+0100"
2025-03-03T20:41:39.166+0100 [DEBUG] provider.terraform-provider-proxmox_v0.73.0: Received HTTP Response: @module=proxmox Connection=Keep-Alive Date="Mon, 03 Mar 2025 19:41:39 GMT" Expires="Mon, 03 Mar 2025 19:41:39 GMT" Pragma=no-cache tf_http_res_status_reason="200 OK" @caller=/home/runner/go/pkg/mod/github.com/hashicorp/terraform-plugin-sdk/v2@v2.36.1/helper/logging/logging_http_transport.go:162 tf_rpc=ApplyResourceChange tf_http_res_status_code=200 Cache-Control=max-age=0 Content-Length=164 Server=pve-api-daemon/3.0 tf_http_op_type=response tf_http_res_body="{\"data\":{\"content\":\"backup,vztmpl,iso,snippets\",\"path\":\"/var/lib/vz\",\"shared\":0,\"digest\":\"b79744bbf297e679053ba551411b20ae3d5b6d4b\",\"storage\":\"local\",\"type\":\"dir\"}}" tf_http_res_version=HTTP/1.1 tf_req_id=d1b1af95-39f3-90bd-4b7e-147ab2445137 tf_resource_type=proxmox_virtual_environment_file Content-Type=application/json;charset=UTF-8 tf_http_trans_id=19c6dc22-95b3-db05-f105-5f4dbc0a3e65 tf_mux_provider=tf5to6server.v5tov6Server tf_provider_addr=registry.terraform.io/bpg/proxmox timestamp="2025-03-03T20:41:39.166+0100"
2025-03-03T20:41:39.166+0100 [DEBUG] provider.terraform-provider-proxmox_v0.73.0: Sending HTTP Request: Accept=application/json @caller=/home/runner/go/pkg/mod/github.com/hashicorp/terraform-plugin-sdk/v2@v2.36.1/helper/logging/logging_http_transport.go:162 tf_http_req_body="" tf_provider_addr=registry.terraform.io/bpg/proxmox tf_req_id=d1b1af95-39f3-90bd-4b7e-147ab2445137 tf_resource_type=proxmox_virtual_environment_file Accept-Encoding=gzip tf_http_req_method=GET tf_http_req_uri=/api2/json/nodes/frostylab/network tf_mux_provider=tf5to6server.v5tov6Server tf_rpc=ApplyResourceChange Cookie="PVEAuthCookie=PVE:root@pam:67C605F3::zVRwaQm5IpF/G2Bh/O6kkjF35lSwFc/pUoZzB112CHTnX2j1cGsJ2I9MWUIXosDG8Ngsfz3wNz08M+gTe0xgMhkadK5EzUSiLwUkXNaZpl12feFFtQPoysqve7gBob+uVT8gMFBoW4Uo579or5ZjOu1WnTld6qL/99ZT1vZ/2bUUquYnyj+D1+MiCNItVugT1W7wNQQfRfvu5PBz6neb4ThzNgtIB2cFOcBuXypT0r6Z5yOhnYJhfQM25MwvLZ3scM26YZCtUOeDeF5X6F67fZwFuR3IkYPX2KY4umecIJOpQ10kv1b0l6cKjx5FlP+5IpTlD0mEhiEPPZz2hX2vbg==" Host=192.168.2.135:8006 User-Agent=Go-http-client/1.1 tf_http_op_type=request tf_http_req_version=HTTP/1.1 tf_http_trans_id=59732b1c-48db-d6db-1984-142d2406abcd @module=proxmox timestamp="2025-03-03T20:41:39.166+0100"
2025-03-03T20:41:39.169+0100 [DEBUG] provider.terraform-provider-proxmox_v0.73.0: Received HTTP Response: Cache-Control=max-age=0 Expires="Mon, 03 Mar 2025 19:41:39 GMT" tf_http_res_body="{\"data\":[{\"iface\":\"vmbr0\",\"address\":\"192.168.2.135\",\"netmask\":\"24\",\"gateway\":\"192.168.2.1\",\"autostart\":1,\"bridge_stp\":\"off\",\"method\":\"static\",\"bridge_fd\":\"0\",\"method6\":\"manual\",\"families\":[\"inet\"],\"priority\":4,\"active\":1,\"type\":\"bridge\",\"cidr\":\"192.168.2.135/24\",\"bridge_ports\":\"enp0s25\"},{\"exists\":1,\"families\":[\"inet\"],\"iface\":\"enp0s25\",\"method6\":\"manual\",\"method\":\"manual\",\"type\":\"eth\",\"active\":1,\"priority\":3}]}" tf_http_res_status_code=200 tf_http_res_status_reason="200 OK" tf_http_res_version=HTTP/1.1 tf_http_trans_id=59732b1c-48db-d6db-1984-142d2406abcd @module=proxmox tf_req_id=d1b1af95-39f3-90bd-4b7e-147ab2445137 Pragma=no-cache Server=pve-api-daemon/3.0 tf_http_op_type=response tf_mux_provider=tf5to6server.v5tov6Server tf_provider_addr=registry.terraform.io/bpg/proxmox @caller=/home/runner/go/pkg/mod/github.com/hashicorp/terraform-plugin-sdk/v2@v2.36.1/helper/logging/logging_http_transport.go:162 Content-Length=415 tf_resource_type=proxmox_virtual_environment_file tf_rpc=ApplyResourceChange Content-Type=application/json;charset=UTF-8 Date="Mon, 03 Mar 2025 19:41:39 GMT" Connection=Keep-Alive timestamp="2025-03-03T20:41:39.169+0100"
2025-03-03T20:41:39.169+0100 [DEBUG] provider.terraform-provider-proxmox_v0.73.0: Attempting to find interfaces with both a static IPV4 address and gateway.: tf_mux_provider=tf5to6server.v5tov6Server tf_provider_addr=registry.terraform.io/bpg/proxmox tf_resource_type=proxmox_virtual_environment_file tf_rpc=ApplyResourceChange @caller=/home/runner/work/terraform-provider-proxmox/terraform-provider-proxmox/proxmoxtf/provider/provider.go:256 @module=proxmox tf_req_id=d1b1af95-39f3-90bd-4b7e-147ab2445137 timestamp="2025-03-03T20:41:39.169+0100"
2025-03-03T20:41:39.169+0100 [DEBUG] provider.terraform-provider-proxmox_v0.73.0: uploading file to the node datastore via SSH input stream : tf_mux_provider=tf5to6server.v5tov6Server tf_provider_addr=registry.terraform.io/bpg/proxmox @caller=/home/runner/work/terraform-provider-proxmox/terraform-provider-proxmox/proxmox/ssh/client.go:292 @module=proxmox tf_resource_type=proxmox_virtual_environment_file tf_rpc=ApplyResourceChange file_name=k8s-dev-central-martin-worker0-cloud-config.yaml node_address="map[Address:192.168.2.135 Port:22]" content_type=snippets remote_dir=/var/lib/vz tf_req_id=d1b1af95-39f3-90bd-4b7e-147ab2445137 timestamp="2025-03-03T20:41:39.169+0100"
2025-03-03T20:41:39.170+0100 [INFO]  provider.terraform-provider-proxmox_v0.73.0: agent is set to false: @module=proxmox tf_provider_addr=registry.terraform.io/bpg/proxmox tf_req_id=d1b1af95-39f3-90bd-4b7e-147ab2445137 @caller=/home/runner/work/terraform-provider-proxmox/terraform-provider-proxmox/proxmox/ssh/client.go:535 tf_mux_provider=tf5to6server.v5tov6Server tf_resource_type=proxmox_virtual_environment_file tf_rpc=ApplyResourceChange timestamp="2025-03-03T20:41:39.170+0100"
2025-03-03T20:41:39.238+0100 [DEBUG] provider.terraform-provider-proxmox_v0.73.0: SSH connection established: host=192.168.2.135:22 tf_provider_addr=registry.terraform.io/bpg/proxmox tf_req_id=d1b1af95-39f3-90bd-4b7e-147ab2445137 tf_resource_type=proxmox_virtual_environment_file tf_rpc=ApplyResourceChange @caller=/home/runner/work/terraform-provider-proxmox/terraform-provider-proxmox/proxmox/ssh/client.go:660 @module=proxmox tf_mux_provider=tf5to6server.v5tov6Server user=plr timestamp="2025-03-03T20:41:39.238+0100"
2025-03-03T20:41:39.346+0100 [ERROR] provider.terraform-provider-proxmox_v0.73.0: Response contains error diagnostic: @caller=/home/runner/go/pkg/mod/github.com/hashicorp/terraform-plugin-go@v0.26.0/tfprotov6/internal/diag/diagnostics.go:58 diagnostic_detail="" diagnostic_summary="failed to open remote file /var/lib/vz/snippets/k8s-dev-central-martin-worker0-cloud-config.yaml: file does not exist" tf_req_id=d1b1af95-39f3-90bd-4b7e-147ab2445137 tf_resource_type=proxmox_virtual_environment_file tf_rpc=ApplyResourceChange @module=sdk.proto diagnostic_severity=ERROR tf_proto_version=6.8 tf_provider_addr=registry.terraform.io/bpg/proxmox timestamp="2025-03-03T20:41:39.346+0100"
2025-03-03T20:41:39.347+0100 [DEBUG] State storage *remote.State declined to persist a state snapshot
2025-03-03T20:41:39.347+0100 [ERROR] vertex "module.dev_cluster.module.worker[0].proxmox_virtual_environment_file.cloud_config" error: failed to open remote file /var/lib/vz/snippets/k8s-dev-central-martin-worker0-cloud-config.yaml: file does not exist
2025-03-03T20:41:39.347+0100 [DEBUG] states/remote: state read serial is: 251; serial is: 251
2025-03-03T20:41:39.347+0100 [DEBUG] states/remote: state read lineage is: 5788dea3-50ea-5c3f-e352-62ce5bc29f61; lineage is: 5788dea3-50ea-5c3f-e352-62ce5bc29f61
2025-03-03T20:41:39.356+0100 [DEBUG] POST https://gitlab.com/api/v4/projects/67369333/terraform/state/main?ID=359838e1-b854-e0ff-8411-871697480268
╷
│ Warning: Resource targeting is in effect
│ 
│ You are creating a plan with the -target option, which means that the result of this plan may not represent all of the changes requested by the current configuration.
│ 
│ The -target option is not for routine use, and is provided only for exceptional situations such as recovering from errors or mistakes, or when Terraform specifically suggests to use it as part of an error message.
╵
╷
│ Warning: Applied changes may be incomplete
│ 
│ The plan was created with the -target option in effect, so some changes requested in the configuration may have been ignored and the output values may not be fully updated. Run the following command to verify that no other changes are
│ pending:
│     terraform plan
│ 
│ Note that the -target option is not suitable for routine use, and is provided only for exceptional situations such as recovering from errors or mistakes, or when Terraform specifically suggests to use it as part of an error message.
╵
╷
│ Error: failed to open remote file /var/lib/vz/snippets/k8s-dev-central-martin-worker0-cloud-config.yaml: file does not exist
│ 
│   with module.dev_cluster.module.worker[0].proxmox_virtual_environment_file.cloud_config,
│   on proxmox_vm/main.tf line 26, in resource "proxmox_virtual_environment_file" "cloud_config":
│   26: resource "proxmox_virtual_environment_file" "cloud_config" {
│ 
╵
2025-03-03T20:41:39.936+0100 [DEBUG] DELETE https://gitlab.com/api/v4/projects/67369333/terraform/state/main/lock
2025-03-03T20:41:40.200+0100 [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = error reading from server: EOF"
2025-03-03T20:41:40.202+0100 [INFO]  provider: plugin process exited: plugin=.terraform/providers/registry.terraform.io/bpg/proxmox/0.73.0/linux_amd64/terraform-provider-proxmox_v0.73.0 id=1373403
2025-03-03T20:41:40.202+0100 [DEBUG] provider: plugin exited
2025-03-03T20:41:40.202+0100 [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = error reading from server: EOF"
2025-03-03T20:41:40.203+0100 [INFO]  provider: plugin process exited: plugin=.terraform/providers/registry.terraform.io/ansible/ansible/1.3.0/linux_amd64/terraform-provider-ansible_v1.3.0 id=1373379
2025-03-03T20:41:40.204+0100 [DEBUG] provider: plugin exited

[frostyfab]

I spent a little more time debugging this.

I found out

• Upload works: scp test.yaml root@frostylab.local:/var/lib/vz/snippets/test.yaml
• Replacing source_raw with source_file (path = local file) does not work here. Making me suspect of my local setup since it works for @nakamorichi

As a workaround I do roughly the following atm:

resource "local_file" "cloud_config" {
  content  = <<-EOF
    #cloud-config
    hostname: ${var.name}
  EOF
  filename = "/tmp/${var.name}-cloud-config.yaml"
}

resource "null_resource" "upload_cloud_config" {
  provisioner "local-exec" {
    command = "scp ${local_file.cloud_config.filename} root@frostylab.local:/var/lib/vz/snippets"
  }
}

resource "proxmox_virtual_environment_vm" "vm" {
  name        = var.name
  user_data_file_id = "${var.proxmox.config_datastore}:snippets/${var.name}-cloud-config.yaml" # config_datastore = "local"
}

[bpg]

@nakamorichi @frostyfab what is your root shell on PVE? If not bash then it may mix things up.

For the reference, this is the exact shell command the plugin is using to "stream" the file content to the host, please try from your workstation to see if it works:

echo "test content" | ssh terraform@pve 'try_sudo(){ if [ $(sudo -n pvesm apiinfo 2>&1 | grep "APIVER" | wc -l) -gt 0 ]; then sudo $1; else $1; fi }; try_sudo "/usr/bin/tee /var/lib/vz/snippets/test.txt'

[frostyfab]

I found my issue: it stared out of the mirror this morning.

echo $SHELL
/usr/bin/fish

echo "test content" | ssh -i ~/.ssh/plr-20250225 root@frostylab.local 'try_sudo(){ if [ $(sudo -n pvesm apiinfo 2>&1 | grep "APIVER" | wc -l) -gt 0 ]; then sudo $1; else $1; fi }; try_sudo "/usr/bin/tee /var/lib/vz/snippets/test.txt"'

fish: command substitutions not allowed here

With chsh -s $(which bash) everything is fine again. Hope its working for @nakamorichi too! Otherwise sorry for muddying the waters...

I recently put my dotfiles on the proxmox machine and changed shell w/o really thinking about it.

Thanks for looking into this @bpg and special thanks for your time developing/maintaining this thing!