Description
problem
Unable to deploy a cks cluster in a multi Cluster environment of different Hypervisor
versions
Cloudstack 4.20.0
The steps to reproduce the bug
- Create a cloudstack env with 2 clusters ( Cluster1 > KVM and Cluster 2 > Vmware)
- Make sure there are 2 systemvm template in the zone
list templates templatefilter=all filter=id,name
{
"id": "8093085c-21c7-11f0-9e30-1e0045000353",
"name": "SystemVM Template (KVM)"
},
"id": "80937b97-21c7-11f0-9e30-1e0045000353",
"name": "SystemVM Template (vSphere)"
-
Register a kubernetes ISO
-
Disable the vmware cluster
-
Deploy a cks cluster
Currently, there is no option to choose the Cluster during the deployment of CKS Cluster even via API
https://cloudstack.apache.org/api/apidocs-4.19/apis/createKubernetesCluster.html
...
- Cloudstack is choosing the systemvm template for vmware and the cks deployment fails
Logs
2025-04-28 10:12:28,596 INFO [c.c.v.VirtualMachineManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) allocating virtual machine from template:80937b97-21c7-11f0-9e30-1e0045000353 with hostname:i-2-13-VM and 1 networks
2025-04-28 10:12:27,973 INFO [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Executor-73:ctx-78f4ede5 job-112) (logid:055ec5c9) Add job-112 into job monitoring
2025-04-28 10:12:27,978 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112) (logid:481b7441) Executing AsyncJobVO: {id:112, userId: 2, accountId: 2, instanceType: VirtualMachine, instanceId: 8, cmd: org.apache.cloudstack.api.command.user.kubernetes.cluster.CreateKubernetesClusterCmd, cmdInfo: {"httpmethod":"GET","ctxAccountId":"2","uuid":"8b5f368a-6221-4a48-a01e-cdfe896161ee","cmdEventType":"KUBERNETES.CLUSTER.CREATE","kubernetesversionid":"edfba8c2-840e-40cf-b418-66bd085ba0a9","clustertype":"CloudManaged","size":"1","serviceofferingid":"623226b6-7b87-47e4-baaa-4a0460179023","response":"json","ctxUserId":"2","name":"test","zoneid":"6b98d90c-37d4-4d2e-84bf-ae0b3bf59981","networkid":"0ab752fc-391d-47ce-a379-153d66a958c0","ctxStartEventId":"420","id":"8","ctxDetails":"{\"interface com.cloud.offering.ServiceOffering\":\"623226b6-7b87-47e4-baaa-4a0460179023\",\"interface com.cloud.dc.DataCenter\":\"6b98d90c-37d4-4d2e-84bf-ae0b3bf59981\",\"interface com.cloud.kubernetes.version.KubernetesSupportedVersion\":\"edfba8c2-840e-40cf-b418-66bd085ba0a9\",\"interface com.cloud.network.Network\":\"0ab752fc-391d-47ce-a379-153d66a958c0\"}","noderootdisksize":"8"}, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 32986506462035, completeMsid: null, lastUpdated: null, lastPolled: null, created: null, removed: null}
2025-04-28 10:12:27,978 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (qtp940584193-20:ctx-32a9cc69 ctx-965faa1e) (logid:4ec44d38) submit async job-112, details: AsyncJobVO: {id:112, userId: 2, accountId: 2, instanceType: VirtualMachine, instanceId: 8, cmd: org.apache.cloudstack.api.command.user.kubernetes.cluster.CreateKubernetesClusterCmd, cmdInfo: {"httpmethod":"GET","ctxAccountId":"2","uuid":"8b5f368a-6221-4a48-a01e-cdfe896161ee","cmdEventType":"KUBERNETES.CLUSTER.CREATE","kubernetesversionid":"edfba8c2-840e-40cf-b418-66bd085ba0a9","clustertype":"CloudManaged","size":"1","serviceofferingid":"623226b6-7b87-47e4-baaa-4a0460179023","response":"json","ctxUserId":"2","name":"test","zoneid":"6b98d90c-37d4-4d2e-84bf-ae0b3bf59981","networkid":"0ab752fc-391d-47ce-a379-153d66a958c0","ctxStartEventId":"420","id":"8","ctxDetails":"{\"interface com.cloud.offering.ServiceOffering\":\"623226b6-7b87-47e4-baaa-4a0460179023\",\"interface com.cloud.dc.DataCenter\":\"6b98d90c-37d4-4d2e-84bf-ae0b3bf59981\",\"interface com.cloud.kubernetes.version.KubernetesSupportedVersion\":\"edfba8c2-840e-40cf-b418-66bd085ba0a9\",\"interface com.cloud.network.Network\":\"0ab752fc-391d-47ce-a379-153d66a958c0\"}","noderootdisksize":"8"}, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 32986506462035, completeMsid: null, lastUpdated: null, lastPolled: null, created: null, removed: null}
2025-04-28 10:12:27,995 INFO [c.c.k.c.a.KubernetesClusterActionWorker] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Starting Kubernetes cluster : test
2025-04-28 10:12:28,007 DEBUG [c.c.k.c.a.KubernetesClusterActionWorker] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Checking deployment destination for Kubernetes cluster : test in zone : ref-trl-8411-v-Mol8-kiran-chavala
2025-04-28 10:12:28,011 DEBUG [c.c.k.c.a.KubernetesClusterActionWorker] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Checking host : 10.0.34.181 for capacity already reserved 1
2025-04-28 10:12:28,011 DEBUG [c.c.c.CapacityManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Checking if host: 2 has enough capacity for requested CPU: 2000 and requested RAM: (2.00 GB) 2147483648 , cpuOverprovisioningFactor: 2.0
2025-04-28 10:12:28,012 DEBUG [c.c.c.CapacityManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Hosts's actual total CPU: 6300 and CPU after applying overprovisioning: 12600
2025-04-28 10:12:28,012 DEBUG [c.c.c.CapacityManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Free CPU: 12600 , Requested CPU: 2000
2025-04-28 10:12:28,012 DEBUG [c.c.c.CapacityManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Free RAM: (8.00 GB) 8584597504 , Requested RAM: (2.00 GB) 2147483648
2025-04-28 10:12:28,012 DEBUG [c.c.c.CapacityManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Host has enough CPU and RAM available
2025-04-28 10:12:28,012 DEBUG [c.c.c.CapacityManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) STATS: Can alloc CPU from host: 2, used: 0, reserved: 0, actual total: 6300, total with overprovisioning: 12600; requested cpu:2000,alloc_from_last_host?:false ,considerReservedCapacity?: true
2025-04-28 10:12:28,012 DEBUG [c.c.c.CapacityManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) STATS: Can alloc MEM from host: 2, used: (0 bytes) 0, reserved: (0 bytes) 0, total: (8.00 GB) 8584597504; requested mem: (2.00 GB) 2147483648, alloc_from_last_host?: false , considerReservedCapacity?: true
2025-04-28 10:12:28,012 DEBUG [c.c.k.c.a.KubernetesClusterActionWorker] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Found host : 10.0.34.181 for with enough capacity, CPU=2000 RAM=(2.00 GB) 2147483648
2025-04-28 10:12:28,014 DEBUG [c.c.k.c.a.KubernetesClusterActionWorker] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Checking host : 10.0.34.181 for capacity already reserved 2
2025-04-28 10:12:28,014 DEBUG [c.c.c.CapacityManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Checking if host: 2 has enough capacity for requested CPU: 4000 and requested RAM: (4.00 GB) 4294967296 , cpuOverprovisioningFactor: 2.0
2025-04-28 10:12:28,015 DEBUG [c.c.c.CapacityManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Hosts's actual total CPU: 6300 and CPU after applying overprovisioning: 12600
2025-04-28 10:12:28,015 DEBUG [c.c.c.CapacityManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Free CPU: 12600 , Requested CPU: 4000
2025-04-28 10:12:28,015 DEBUG [c.c.c.CapacityManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Free RAM: (8.00 GB) 8584597504 , Requested RAM: (4.00 GB) 4294967296
2025-04-28 10:12:28,015 DEBUG [c.c.c.CapacityManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Host has enough CPU and RAM available
2025-04-28 10:12:28,015 DEBUG [c.c.c.CapacityManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) STATS: Can alloc CPU from host: 2, used: 0, reserved: 0, actual total: 6300, total with overprovisioning: 12600; requested cpu:4000,alloc_from_last_host?:false ,considerReservedCapacity?: true
2025-04-28 10:12:28,015 DEBUG [c.c.c.CapacityManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) STATS: Can alloc MEM from host: 2, used: (0 bytes) 0, reserved: (0 bytes) 0, total: (8.00 GB) 8584597504; requested mem: (4.00 GB) 4294967296, alloc_from_last_host?: false , considerReservedCapacity?: true
2025-04-28 10:12:28,015 DEBUG [c.c.k.c.a.KubernetesClusterActionWorker] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Found host : 10.0.34.181 for with enough capacity, CPU=4000 RAM=(4.00 GB) 4294967296
2025-04-28 10:12:28,015 INFO [c.c.k.c.a.KubernetesClusterActionWorker] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Suitable hosts found in datacenter : ref-trl-8411-v-Mol8-kiran-chavala, creating deployment destination
2025-04-28 10:12:28,017 DEBUG [o.a.c.e.o.NetworkOrchestrator] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Starting network Network {"id": 207, "name": "vpc-kvm-tier", "uuid": "0ab752fc-391d-47ce-a379-153d66a958c0", "networkofferingid": 13}...
2025-04-28 10:12:28,018 DEBUG [o.a.c.e.o.NetworkOrchestrator] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Network id=207 is already implemented
2025-04-28 10:12:28,018 INFO [c.c.k.c.a.KubernetesClusterActionWorker] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Network : vpc-kvm-tier is started for the Kubernetes cluster : test
2025-04-28 10:12:28,021 DEBUG [c.c.n.IpAddressManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Associate IP address called by the user 2 account 2
2025-04-28 10:12:28,024 DEBUG [c.c.n.IpAddressManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Associate IP address lock acquired
2025-04-28 10:12:28,028 DEBUG [c.c.n.IpAddressManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Public IP address [Ip[10.0.58.127-1]] is not in quarantine; therefore, it is allowed to be allocated.
2025-04-28 10:12:28,036 DEBUG [c.c.n.IpAddressManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Got 10.0.58.127 to assign for account 2 in zone 1
2025-04-28 10:12:28,040 DEBUG [c.c.n.IpAddressManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Releasing lock account Account [{"accountName":"admin","id":2,"uuid":"cf372385-21c7-11f0-9e30-1e0045000353"}]
2025-04-28 10:12:28,045 DEBUG [c.c.n.IpAddressManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Associate IP address lock released
2025-04-28 10:12:28,067 DEBUG [c.c.n.v.VpcManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Associating ip Ip[10.0.58.127-1] to vpc [VPC [2-vpc-kvm]
2025-04-28 10:12:28,073 DEBUG [c.c.n.IpAddressManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) IP address [Ip[10.0.58.127-1]] is not direct, dedicated or reserved; therefore, the resource count should be updated.
2025-04-28 10:12:28,076 DEBUG [c.c.r.ResourceLimitManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Updating resource Type = public_ip count for Account = 2 Operation = increasing Amount = 1
2025-04-28 10:12:28,081 DEBUG [c.c.n.v.VpcManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Successfully assigned ip Ip[10.0.58.127-1] to vpc [VPC [2-vpc-kvm]
2025-04-28 10:12:28,095 DEBUG [c.c.n.IpAddressManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Associating ip Ip[10.0.58.127-1] to network Network {"id": 207, "name": "vpc-kvm-tier", "uuid": "0ab752fc-391d-47ce-a379-153d66a958c0", "networkofferingid": 13}
2025-04-28 10:12:28,103 DEBUG [c.c.n.IpAddressManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Successfully associated ip address 10.0.58.127 to network Network {"id": 207, "name": "vpc-kvm-tier", "uuid": "0ab752fc-391d-47ce-a379-153d66a958c0", "networkofferingid": 13}
2025-04-28 10:12:28,506 DEBUG [c.c.u.AccountManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Access granted to Account [{"accountName":"admin","id":2,"uuid":"cf372385-21c7-11f0-9e30-1e0045000353"}] to Service offering {"id":13,"name":"Large Instance","uuid":"623226b6-7b87-47e4-baaa-4a0460179023"}. by AffinityGroupAccessChecker
2025-04-28 10:12:28,506 DEBUG [c.c.u.AccountManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Access granted to Account [{"accountName":"admin","id":2,"uuid":"cf372385-21c7-11f0-9e30-1e0045000353"}] to null by AffinityGroupAccessChecker
2025-04-28 10:12:28,509 INFO [c.c.n.NetworkModelImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Checking permission for account admin (cf372385-21c7-11f0-9e30-1e0045000353) on network vpc-kvm-tier (0ab752fc-391d-47ce-a379-153d66a958c0)
2025-04-28 10:12:28,554 DEBUG [c.c.n.NetworkModelImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Service SecurityGroup is not supported in the network id=207
2025-04-28 10:12:28,563 INFO [c.c.v.UserVmManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) VM cannot be configured to be dynamically scalable if any of the service offering's dynamic scaling property, template's dynamic scaling property or global setting is false
2025-04-28 10:12:28,565 DEBUG [c.c.v.UserVmManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Rootdisksize override validation successful. Template root disk size (4.88 GB) 5242880000 Root disk size specified 8 GB
2025-04-28 10:12:28,583 DEBUG [c.c.v.UserVmManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Allocating in the DB for vm
2025-04-28 10:12:28,596 INFO [c.c.v.VirtualMachineManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) allocating virtual machine from template:80937b97-21c7-11f0-9e30-1e0045000353 with hostname:i-2-13-VM and 1 networks
2025-04-28 10:12:28,598 DEBUG [c.c.v.VirtualMachineManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Allocating entries for VM: VM instance {"id":13,"instanceName":"i-2-13-VM","type":"User","uuid":"b1f56516-c836-4f15-85d4-9d34340faa3c"}
2025-04-28 10:12:28,602 DEBUG [c.c.v.VirtualMachineManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Allocating nics for VM instance {"id":13,"instanceName":"i-2-13-VM","type":"User","uuid":"b1f56516-c836-4f15-85d4-9d34340faa3c"}
2025-04-28 10:12:28,604 DEBUG [o.a.c.e.o.NetworkOrchestrator] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Allocating nic for vm VM instance {"id":13,"instanceName":"i-2-13-VM","type":"User","uuid":"b1f56516-c836-4f15-85d4-9d34340faa3c"} in network Network {"id": 207, "name": "vpc-kvm-tier", "uuid": "0ab752fc-391d-47ce-a379-153d66a958c0", "networkofferingid": 13} with requested profile NicProfile {"broadcastUri":null,"iPv4Address":null,"id":0,"reservationId":null,"vmId":0}
2025-04-28 10:12:28,627 DEBUG [c.c.n.NetworkModelImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Service SecurityGroup is not supported in the network id=207
2025-04-28 10:12:28,629 DEBUG [c.c.v.VirtualMachineManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Allocating disks for VM instance {"id":13,"instanceName":"i-2-13-VM","type":"User","uuid":"b1f56516-c836-4f15-85d4-9d34340faa3c"}
2025-04-28 10:12:28,630 INFO [o.a.c.e.o.VolumeOrchestrator] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439 ctx-bf62cbdd) (logid:481b7441) Adding disk object [ROOT-13] to VM [VM instance {"id":13,"instanceName":"i-2-13-VM","type":"User","uuid":"b1f56516-c836-4f15-85d4-9d34340faa3c"}]
2025-04-28 10:12:28,633 DEBUG [o.a.c.e.o.VolumeOrchestrator] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439 ctx-bf62cbdd) (logid:481b7441) Using root disk size of [(8.00 GB) 8589934592] bytes for the volume [ROOT-13].
2025-04-28 10:12:28,644 DEBUG [c.c.r.ResourceLimitManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439 ctx-bf62cbdd) (logid:481b7441) Updating resource Type = volume count for Account = 2 Operation = increasing Amount = 1
2025-04-28 10:12:28,649 DEBUG [c.c.r.ResourceLimitManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439 ctx-bf62cbdd) (logid:481b7441) Updating resource Type = primary_storage count for Account = 2 Operation = increasing Amount = (8.00 GB) 8589934592
2025-04-28 10:12:28,668 DEBUG [c.c.v.VirtualMachineManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Allocation completed for VM: VM instance {"id":13,"instanceName":"i-2-13-VM","type":"User","uuid":"b1f56516-c836-4f15-85d4-9d34340faa3c"}
2025-04-28 10:12:28,668 DEBUG [c.c.v.UserVmManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Successfully allocated DB entry for VM instance {"id":13,"instanceName":"i-2-13-VM","type":"User","uuid":"b1f56516-c836-4f15-85d4-9d34340faa3c"}
2025-04-28 10:12:28,676 DEBUG [c.c.r.ResourceLimitManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Updating resource Type = user_vm count for Account = 2 Operation = increasing Amount = 1
2025-04-28 10:12:28,682 DEBUG [c.c.r.ResourceLimitManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Updating resource Type = cpu count for Account = 2 Operation = increasing Amount = 2
2025-04-28 10:12:28,687 DEBUG [c.c.r.ResourceLimitManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Updating resource Type = memory count for Account = 2 Operation = increasing Amount = 2048
2025-04-28 10:12:28,705 DEBUG [c.c.n.NetworkModelImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Service SecurityGroup is not supported in the network id=207
2025-04-28 10:12:28,710 DEBUG [c.c.n.NetworkModelImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Service SecurityGroup is not supported in the network id=207
2025-04-28 10:12:28,717 INFO [c.c.k.c.a.KubernetesClusterActionWorker] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Created control VM ID: b1f56516-c836-4f15-85d4-9d34340faa3c, test-control-1967be24360 in the Kubernetes cluster : test
2025-04-28 10:12:28,722 DEBUG [c.c.v.VirtualMachineManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) start parameter value of enterHardwareSetup == <very null> during processing of queued job
2025-04-28 10:12:28,729 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Sync job-113 execution on object VmWorkJobQueue.13
2025-04-28 10:12:29,340 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113) (logid:901c7a20) Add job-113 into job monitoring
2025-04-28 10:12:29,344 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113) (logid:481b7441) Executing AsyncJobVO: {id:113, userId: 2, accountId: 2, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAADXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 32986506462035, completeMsid: null, lastUpdated: null, lastPolled: null, created: Mon Apr 28 10:12:28 UTC 2025, removed: null}
2025-04-28 10:12:29,344 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113) (logid:481b7441) Run VM work job: com.cloud.vm.VmWorkStart for VM 13, job origin: 112
2025-04-28 10:12:29,346 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":2,"accountId":2,"vmId":13,"handlerName":"VirtualMachineManagerImpl"}
2025-04-28 10:12:29,347 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) orchestrating VM start for 'i-2-13-VM' com.cloud.vm.VirtualMachineProfile$Param@b66cdd7d set to null
2025-04-28 10:12:29,353 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) VM instance {"id":13,"instanceName":"i-2-13-VM","type":"User","uuid":"b1f56516-c836-4f15-85d4-9d34340faa3c"} state transited from [Stopped] to [Starting] with event [StartRequested]. VM's original host: null, new host: null, host before state transition: null
2025-04-28 10:12:29,353 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) Successfully transitioned to start state for VM instance {"id":13,"instanceName":"i-2-13-VM","type":"User","uuid":"b1f56516-c836-4f15-85d4-9d34340faa3c"} reservation id = ae08af4e-3f36-4579-8802-077c2a5f8bb2
2025-04-28 10:12:29,358 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) Deploy avoids pods: null, clusters: null, hosts: null
2025-04-28 10:12:29,361 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) VM start attempt #1
2025-04-28 10:12:29,367 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) Adding pods to avoid lists for non-explicit VM deployment: []
2025-04-28 10:12:29,367 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) Adding clusters to avoid lists for non-explicit VM deployment: []
2025-04-28 10:12:29,367 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) Adding hosts to avoid lists for non-explicit VM deployment: []
2025-04-28 10:12:29,367 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) DeploymentPlanner allocation algorithm: null
2025-04-28 10:12:29,367 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 2000, requested ram: (2.00 GB) 2147483648
2025-04-28 10:12:29,367 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) Is ROOT volume READY (pool already allocated)?: No
2025-04-28 10:12:29,371 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) Deploy avoids pods: [], clusters: [1, 2], hosts: []
2025-04-28 10:12:29,371 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) Deploy hosts with priorities {} , hosts have NORMAL priority by default
2025-04-28 10:12:29,372 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) Searching all possible resources under this Zone: 1
2025-04-28 10:12:29,373 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) Listing clusters in order of aggregate capacity, that have (at least one host with) enough CPU and RAM capacity under this Zone: 1
2025-04-28 10:12:29,376 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) Removing from the clusterId list these clusters from avoid set: [1, 2]
2025-04-28 10:12:29,382 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) Cluster: 3 has HyperVisorType that does not match the VM, skipping this cluster
2025-04-28 10:12:29,382 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) Could not find suitable Deployment Destination for this VM under any clusters, returning.
2025-04-28 10:12:29,383 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) Searching all possible resources under this Zone: 1
2025-04-28 10:12:29,384 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) Listing clusters in order of aggregate capacity, that have (at least one host with) enough CPU and RAM capacity under this Zone: 1
2025-04-28 10:12:29,387 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) Removing from the clusterId list these clusters from avoid set: [1, 2, 3]
2025-04-28 10:12:29,387 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) No clusters found after removing disabled clusters and clusters in avoid list, returning.
2025-04-28 10:12:29,404 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) VM instance {"id":13,"instanceName":"i-2-13-VM","type":"User","uuid":"b1f56516-c836-4f15-85d4-9d34340faa3c"} state transited from [Starting] to [Stopped] with event [OperationFailed]. VM's original host: null, new host: null, host before state transition: null
2025-04-28 10:12:29,415 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM instance {"id":13,"instanceName":"i-2-13-VM","type":"User","uuid":"b1f56516-c836-4f15-85d4-9d34340faa3c"}Scope=interface com.cloud.dc.DataCenter; id=1
2025-04-28 10:12:29,415 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113 ctx-694fd13e) (logid:481b7441) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM instance {"id":13,"instanceName":"i-2-13-VM","type":"User","uuid":"b1f56516-c836-4f15-85d4-9d34340faa3c"}Scope=interface com.cloud.dc.DataCenter; id=1
2025-04-28 10:12:29,415 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113) (logid:481b7441) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 13, job origin: 112
2025-04-28 10:12:29,415 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113) (logid:481b7441) Unable to complete AsyncJobVO: {id:113, userId: 2, accountId: 2, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAADXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 32986506462035, completeMsid: null, lastUpdated: null, lastPolled: null, created: Mon Apr 28 10:12:28 UTC 2025, removed: null}, job origin:112
2025-04-28 10:12:29,432 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113) (logid:481b7441) Complete async job-113, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uVk1PcAAAABACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvblZNT3AAAAAVAgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdACOVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNIGluc3RhbmNlIHsiaWQiOjEzLCJpbnN0YW5jZU5hbWUiOiJpLTItMTMtVk0iLCJ0eXBlIjoiVXNlciIsInV1aWQiOiJiMWY1NjUxNi1jODM2LTRmMTUtODVkNC05ZDM0MzQwZmFhM2MifXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFXNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIACEIABmZvcm1hdEkACmxpbmVOdW1iZXJMAA9jbGFzc0xvYWRlck5hbWVxAH4ACkwADmRlY2xhcmluZ0NsYXNzcQB-AApMAAhmaWxlTmFtZXEAfgAKTAAKbWV0aG9kTmFtZXEAfgAKTAAKbW9kdWxlTmFtZXEAfgAKTAANbW9kdWxlVmVyc2lvbnEAfgAKeHABAAAE8XQAA2FwcHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHBwc3EAfgARAQAAFgJxAH4AE3EAfgAUcQB-ABVxAH4AFnBwc3EAfgARAv____5wdAAtamRrLmludGVybmFsLnJlZmxlY3QuTmF0aXZlTWV0aG9kQWNjZXNzb3JJbXBsdAAdTmF0aXZlTWV0aG9kQWNjZXNzb3JJbXBsLmphdmF0AAdpbnZva2UwdAAJamF2YS5iYXNldAAHMTEuMC4yNXNxAH4AEQIAAAA-cHEAfgAZcQB-ABp0AAZpbnZva2VxAH4AHHEAfgAdc3EAfgARAgAAACtwdAAxamRrLmludGVybmFsLnJlZmxlY3QuRGVsZWdhdGluZ01ldGhvZEFjY2Vzc29ySW1wbHQAIURlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGwuamF2YXEAfgAfcQB-ABxxAH4AHXNxAH4AEQIAAAI2cHQAGGphdmEubGFuZy5yZWZsZWN0Lk1ldGhvZHQAC01ldGhvZC5qYXZhcQB-AB9xAH4AHHEAfgAdc3EAfgARAQAAAGtxAH4AE3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnBwc3EAfgARAQAAFn5xAH4AE3EAfgAUcQB-ABVxAH4AKXBwc3EAfgARAQAAAGZxAH4AE3QAIGNvbS5jbG91ZC52bS5WbVdvcmtKb2JEaXNwYXRjaGVydAAYVm1Xb3JrSm9iRGlzcGF0Y2hlci5qYXZhdAAGcnVuSm9icHBzcQB-ABEBAAACjnEAfgATdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0cHBzcQB-ABEBAAAAMHEAfgATdAA-b3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5NYW5hZ2VkQ29udGV4dFJ1bm5hYmxlJDF0ABtNYW5hZ2VkQ29udGV4dFJ1bm5hYmxlLmphdmF0AANydW5wcHNxAH4AEQEAAAA3cQB-ABN0AEJvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0JDF0ABpEZWZhdWx0TWFuYWdlZENvbnRleHQuamF2YXQABGNhbGxwcHNxAH4AEQEAAABmcQB-ABN0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADl0AA9jYWxsV2l0aENvbnRleHRwcHNxAH4AEQEAAAA0cQB-ABNxAH4APHEAfgA5dAAOcnVuV2l0aENvbnRleHRwcHNxAH4AEQEAAAAtcQB-ABN0ADxvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGVxAH4ANXEAfgA2cHBzcQB-ABEBAAACWnEAfgATcQB-ADBxAH4AMXEAfgA2cHBzcQB-ABECAAACA3B0AC5qYXZhLnV0aWwuY29uY3VycmVudC5FeGVjdXRvcnMkUnVubmFibGVBZGFwdGVydAAORXhlY3V0b3JzLmphdmFxAH4AOnEAfgAccQB-AB1zcQB-ABECAAABCHB0AB9qYXZhLnV0aWwuY29uY3VycmVudC5GdXR1cmVUYXNrdAAPRnV0dXJlVGFzay5qYXZhcQB-ADZxAH4AHHEAfgAdc3EAfgARAgAABGhwdAAnamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9ydAAXVGhyZWFkUG9vbEV4ZWN1dG9yLmphdmF0AAlydW5Xb3JrZXJxAH4AHHEAfgAdc3EAfgARAgAAAnRwdAAuamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9yJFdvcmtlcnEAfgBLcQB-ADZxAH4AHHEAfgAdc3EAfgARAgAAAz1wdAAQamF2YS5sYW5nLlRocmVhZHQAC1RocmVhZC5qYXZhcQB-ADZxAH4AHHEAfgAdc3IAH2phdmEudXRpbC5Db2xsZWN0aW9ucyRFbXB0eUxpc3R6uBe0PKee3gIAAHhweHNyABFqYXZhLmxhbmcuSW50ZWdlchLioKT3gYc4AgABSQAFdmFsdWV4cgAQamF2YS5sYW5nLk51bWJlcoaslR0LlOCLAgAAeHAAABDvc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4c3IADmphdmEubGFuZy5Mb25nO4vkkMyPI98CAAFKAAV2YWx1ZXhxAH4AVQAAAAAAAAABdnIAF2NvbS5jbG91ZC5kYy5EYXRhQ2VudGVyEFBUbQNFHgACAAB4cAA
2025-04-28 10:12:29,433 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113) (logid:481b7441) Publish async job-113 complete on message bus
2025-04-28 10:12:29,433 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113) (logid:481b7441) Wake up jobs related to job-113
2025-04-28 10:12:29,433 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113) (logid:481b7441) Update db status for job-113
2025-04-28 10:12:29,437 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113) (logid:481b7441) Wake up jobs joined with job-113 and disjoin all subjobs created from job- 113
2025-04-28 10:12:29,445 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113) (logid:481b7441) Done executing com.cloud.vm.VmWorkStart for job-113
2025-04-28 10:12:29,446 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-33:ctx-29ce3268 job-112/job-113) (logid:481b7441) Remove job-113 from job monitoring
2025-04-28 10:12:29,453 ERROR [c.c.k.c.a.KubernetesClusterActionWorker] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Provisioning the control VM failed in the Kubernetes cluster : test
2025-04-28 10:12:29,457 INFO [c.c.k.c.a.KubernetesClusterActionWorker] (API-Job-Executor-73:ctx-78f4ede5 job-112 ctx-b900a439) (logid:481b7441) Revoking launch permission for systemVM template
2025-04-28 10:12:29,462 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112) (logid:481b7441) Complete async job-112, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":"530","errortext":"Provisioning the control VM failed in the Kubernetes cluster : test"}
2025-04-28 10:12:29,463 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112) (logid:481b7441) Publish async job-112 complete on message bus
2025-04-28 10:12:29,463 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112) (logid:481b7441) Wake up jobs related to job-112
2025-04-28 10:12:29,463 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112) (logid:481b7441) Update db status for job-112
2025-04-28 10:12:29,463 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112) (logid:481b7441) Wake up jobs joined with job-112 and disjoin all subjobs created from job- 112
2025-04-28 10:12:29,467 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-73:ctx-78f4ede5 job-112) (logid:481b7441) Done executing org.apache.cloudstack.api.command.user.kubernetes.cluster.CreateKubernetesClusterCmd for job-112
2025-04-28 10:12:29,467 INFO [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Executor-73:ctx-78f4ede5 job-112) (logid:481b7441) Remove job-112 from job monitoring
What to do about it?
Cloudstack should select the correct systemvm template based on the available cluster
or
provide an option to the end user to select the cluster for cks deployment