Skip to content

Commit 07fc237

Browse files
sradcosradco
committed
Build: (42dae5f) Merge pull request #306 from sradco/update_lines_length
Update runbooks line lengths
1 parent 9dd8985 commit 07fc237

3 files changed

Lines changed: 69 additions & 64 deletions

File tree

‎runbooks/GuestVCPUQueueHighCritical.md‎

Lines changed: 6 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -13,8 +13,8 @@ indicating severe CPU contention.
1313
## Diagnosis
1414
Follow the below steps with extra focus on:
1515
* **Duration** – How long is the queue > 20
16-
* **Host saturation** – if node CPU is also > 90 %, migrate other VMs or mark the
17-
node as unschedulable so that no new Pods/VMs are placed thereon it.
16+
* **Host saturation** - if node CPU is also > 90%, migrate other VMs or
17+
mark the node as unschedulable so that no new Pods/VMs are placed thereon it.
1818

1919
1. **Confirm queue length**
2020
```promql
@@ -34,7 +34,8 @@ Follow the below steps with extra focus on:
3434
## Mitigation
3535
| Horizon | Action |
3636
|----------|------------------------------------------------------------------|
37-
| Immediate| **Prioritise**: live-migrate VM; hot-plug vCPUs; stop or throttle hot threads. |
37+
| Immediate| **Prioritise**: live-migrate VM; hot-plug vCPUs; stop or throttle |
38+
| | hot threads. |
3839
| Short term| Raise vCPU limit or split workload across additional VMs. |
3940
| Long term| Adjust placement rules; add autoscaling tied to run-queue length.|
4041

@@ -43,7 +44,8 @@ Follow the below steps with extra focus on:
4344
If you cannot resolve the issue, see the following resources:
4445

4546
- [OKD Help](https://www.okd.io/help/)
46-
- [#virtualization Slack channel](https://kubernetes.slack.com/channels/virtualization)
47+
- [#virtualization Slack channel](
48+
https://kubernetes.slack.com/channels/virtualization)
4749
<!--USend-->
4850

4951
<!--DS: If you cannot resolve the issue, log in to the

‎runbooks/GuestVCPUQueueHighWarning.md‎

Lines changed: 7 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -31,15 +31,18 @@ The run‑queue length is derived from `guest_load_1m – vCPU_count`.
3131
## Mitigation
3232
| Horizon | Action |
3333
|---------|--------|
34-
| Immediate | Optionally live‑migrate the VM to a quieter node or throttle noisy processes. |
35-
| Short term | Hot‑plug / increase vCPUs; tune application thread pools. |
36-
| Long term | Implement horizontal scaling (HPA/KEDA, VMReplicaSet); review placement rules. |
34+
| Immediate | Optionally live‑migrate the VM to a quieter node or throttle |
35+
| | noisy processes. |
36+
| Short term | Hot‑plug / increase vCPUs; tune application thread pools. |
37+
| Long term | Implement horizontal scaling (HPA/KEDA, VMReplicaSet); review |
38+
| | placement rules. |
3739

3840
<!--USstart-->
3941
If you cannot resolve the issue, see the following resources:
4042

4143
- [OKD Help](https://www.okd.io/help/)
42-
- [#virtualization Slack channel](https://kubernetes.slack.com/channels/virtualization)
44+
- [#virtualization Slack channel](
45+
https://kubernetes.slack.com/channels/virtualization)
4346
<!--USend-->
4447

4548
<!--DS: If you cannot resolve the issue, log in to the

‎runbooks_index.md‎

Lines changed: 56 additions & 56 deletions
Original file line numberDiff line numberDiff line change
@@ -1,81 +1,81 @@
11
# KubeVirt Runbooks
22

3-
- [KubevirtVmHighMemoryUsage.md](runbooks/KubevirtVmHighMemoryUsage.md)
4-
- [VirtHandlerDaemonSetRolloutFailing.md](runbooks/VirtHandlerDaemonSetRolloutFailing.md)
5-
- [CDINotReady.md](runbooks/CDINotReady.md)
6-
- [VirtHandlerRESTErrorsHigh.md](runbooks/VirtHandlerRESTErrorsHigh.md)
7-
- [HCOInstallationIncomplete.md](runbooks/HCOInstallationIncomplete.md)
8-
- [HAControlPlaneDown.md](runbooks/HAControlPlaneDown.md)
93
- [CDIDefaultStorageClassDegraded.md](runbooks/CDIDefaultStorageClassDegraded.md)
10-
- [OutdatedVirtualMachineInstanceWorkloads.md](runbooks/OutdatedVirtualMachineInstanceWorkloads.md)
11-
- [CDIDataImportCronOutdated.md](runbooks/CDIDataImportCronOutdated.md)
12-
- [VMCannotBeEvicted.md](runbooks/VMCannotBeEvicted.md)
4+
- [OrphanedVirtualMachineInstances.md](runbooks/OrphanedVirtualMachineInstances.md)
5+
- [SSPTemplateValidatorDown.md](runbooks/SSPTemplateValidatorDown.md)
6+
- [KubeMacPoolDuplicateMacsFound.md](runbooks/KubeMacPoolDuplicateMacsFound.md)
7+
- [SSPCommonTemplatesModificationReverted.md](runbooks/SSPCommonTemplatesModificationReverted.md)
8+
- [CnaoNmstateMigration.md](runbooks/CnaoNmstateMigration.md)
9+
- [NetworkAddonsConfigNotReady.md](runbooks/NetworkAddonsConfigNotReady.md)
10+
- [HCOOperatorConditionsUnhealthy.md](runbooks/HCOOperatorConditionsUnhealthy.md)
1311
- [CDIOperatorDown.md](runbooks/CDIOperatorDown.md)
14-
- [NoReadyVirtController.md](runbooks/NoReadyVirtController.md)
15-
- [SSPOperatorDown.md](runbooks/SSPOperatorDown.md)
12+
- [CDIDataImportCronOutdated.md](runbooks/CDIDataImportCronOutdated.md)
13+
- [VirtHandlerDaemonSetRolloutFailing.md](runbooks/VirtHandlerDaemonSetRolloutFailing.md)
14+
- [HAControlPlaneDown.md](runbooks/HAControlPlaneDown.md)
1615
- [GuestVCPUQueueHighCritical.md](runbooks/GuestVCPUQueueHighCritical.md)
17-
- [CDIStorageProfilesIncomplete.md](runbooks/CDIStorageProfilesIncomplete.md)
18-
- [SSPDown.md](runbooks/SSPDown.md)
19-
- [LowVirtControllersCount.md](runbooks/LowVirtControllersCount.md)
20-
- [KubeMacPoolDuplicateMacsFound.md](runbooks/KubeMacPoolDuplicateMacsFound.md)
16+
- [HCOMisconfiguredDescheduler.md](runbooks/HCOMisconfiguredDescheduler.md)
2117
- [UnsupportedHCOModification.md](runbooks/UnsupportedHCOModification.md)
22-
- [LowReadyVirtOperatorsCount.md](runbooks/LowReadyVirtOperatorsCount.md)
23-
- [LowVirtOperatorCount.md](runbooks/LowVirtOperatorCount.md)
24-
- [VirtAPIDown.md](runbooks/VirtAPIDown.md)
25-
- [KubemacpoolDown.md](runbooks/KubemacpoolDown.md)
18+
- [VirtOperatorRESTErrorsHigh.md](runbooks/VirtOperatorRESTErrorsHigh.md)
19+
- [SSPDown.md](runbooks/SSPDown.md)
20+
- [NoLeadingVirtOperator.md](runbooks/NoLeadingVirtOperator.md)
2621
- [VirtHandlerRESTErrorsBurst.md](runbooks/VirtHandlerRESTErrorsBurst.md)
27-
- [VirtOperatorRESTErrorsBurst.md](runbooks/VirtOperatorRESTErrorsBurst.md)
28-
- [HPPNotReady.md](runbooks/HPPNotReady.md)
29-
- [VirtApiRESTErrorsHigh.md](runbooks/VirtApiRESTErrorsHigh.md)
30-
- [VirtControllerRESTErrorsBurst.md](runbooks/VirtControllerRESTErrorsBurst.md)
31-
- [PersistentVolumeFillingUp.md](runbooks/PersistentVolumeFillingUp.md)
32-
- [SSPCommonTemplatesModificationReverted.md](runbooks/SSPCommonTemplatesModificationReverted.md)
33-
- [SSPHighRateRejectedVms.md](runbooks/SSPHighRateRejectedVms.md)
34-
- [CDIDataVolumeUnusualRestartCount.md](runbooks/CDIDataVolumeUnusualRestartCount.md)
35-
- [CDINoDefaultStorageClass.md](runbooks/CDINoDefaultStorageClass.md)
36-
- [VirtOperatorDown.md](runbooks/VirtOperatorDown.md)
37-
- [KubeVirtVMIExcessiveMigrations.md](runbooks/KubeVirtVMIExcessiveMigrations.md)
3822
- [KubeVirtNoAvailableNodesToRunVMs.md](runbooks/KubeVirtNoAvailableNodesToRunVMs.md)
23+
- [CDIStorageProfilesIncomplete.md](runbooks/CDIStorageProfilesIncomplete.md)
24+
- [CDINoDefaultStorageClass.md](runbooks/CDINoDefaultStorageClass.md)
25+
- [VirtControllerRESTErrorsHigh.md](runbooks/VirtControllerRESTErrorsHigh.md)
3926
- [LowKVMNodesCount.md](runbooks/LowKVMNodesCount.md)
40-
- [CnaoDown.md](runbooks/CnaoDown.md)
41-
- [CDIMultipleDefaultVirtStorageClasses.md](runbooks/CDIMultipleDefaultVirtStorageClasses.md)
42-
- [KubeVirtDeprecatedAPIRequested.md](runbooks/KubeVirtDeprecatedAPIRequested.md)
27+
- [NodeNetworkInterfaceDown.md](runbooks/NodeNetworkInterfaceDown.md)
28+
- [KubemacpoolDown.md](runbooks/KubemacpoolDown.md)
29+
- [LowVirtControllersCount.md](runbooks/LowVirtControllersCount.md)
4330
- [GuestVCPUQueueHighWarning.md](runbooks/GuestVCPUQueueHighWarning.md)
44-
- [HPPSharingPoolPathWithOS.md](runbooks/HPPSharingPoolPathWithOS.md)
45-
- [SSPTemplateValidatorDown.md](runbooks/SSPTemplateValidatorDown.md)
31+
- [OutdatedVirtualMachineInstanceWorkloads.md](runbooks/OutdatedVirtualMachineInstanceWorkloads.md)
32+
- [VirtApiRESTErrorsHigh.md](runbooks/VirtApiRESTErrorsHigh.md)
33+
- [VirtControllerDown.md](runbooks/VirtControllerDown.md)
34+
- [HighCPUWorkload.md](runbooks/HighCPUWorkload.md)
35+
- [LowReadyVirtControllersCount.md](runbooks/LowReadyVirtControllersCount.md)
36+
- [KubeVirtVMIExcessiveMigrations.md](runbooks/KubeVirtVMIExcessiveMigrations.md)
4637
- [SingleStackIPv6Unsupported.md](runbooks/SingleStackIPv6Unsupported.md)
47-
- [HighNodeCPUFrequency.md](runbooks/HighNodeCPUFrequency.md)
48-
- [NoLeadingVirtOperator.md](runbooks/NoLeadingVirtOperator.md)
49-
- [VMStorageClassWarning.md](runbooks/VMStorageClassWarning.md)
38+
- [NoReadyVirtController.md](runbooks/NoReadyVirtController.md)
5039
- [HPPOperatorDown.md](runbooks/HPPOperatorDown.md)
51-
- [SSPFailingToReconcile.md](runbooks/SSPFailingToReconcile.md)
52-
- [HCOOperatorConditionsUnhealthy.md](runbooks/HCOOperatorConditionsUnhealthy.md)
53-
- [VirtControllerRESTErrorsHigh.md](runbooks/VirtControllerRESTErrorsHigh.md)
54-
- [HCOMisconfiguredDescheduler.md](runbooks/HCOMisconfiguredDescheduler.md)
55-
- [NodeNetworkInterfaceDown.md](runbooks/NodeNetworkInterfaceDown.md)
56-
- [NetworkAddonsConfigNotReady.md](runbooks/NetworkAddonsConfigNotReady.md)
40+
- [HCOInstallationIncomplete.md](runbooks/HCOInstallationIncomplete.md)
41+
- [HPPSharingPoolPathWithOS.md](runbooks/HPPSharingPoolPathWithOS.md)
42+
- [VMStorageClassWarning.md](runbooks/VMStorageClassWarning.md)
43+
- [CnaoDown.md](runbooks/CnaoDown.md)
5744
- [LowVirtAPICount.md](runbooks/LowVirtAPICount.md)
58-
- [LowReadyVirtControllersCount.md](runbooks/LowReadyVirtControllersCount.md)
59-
- [VirtControllerDown.md](runbooks/VirtControllerDown.md)
60-
- [OrphanedVirtualMachineInstances.md](runbooks/OrphanedVirtualMachineInstances.md)
61-
- [HighCPUWorkload.md](runbooks/HighCPUWorkload.md)
62-
- [CnaoNmstateMigration.md](runbooks/CnaoNmstateMigration.md)
45+
- [SSPFailingToReconcile.md](runbooks/SSPFailingToReconcile.md)
46+
- [SSPHighRateRejectedVms.md](runbooks/SSPHighRateRejectedVms.md)
47+
- [CDIMultipleDefaultVirtStorageClasses.md](runbooks/CDIMultipleDefaultVirtStorageClasses.md)
48+
- [KubevirtVmHighMemoryUsage.md](runbooks/KubevirtVmHighMemoryUsage.md)
6349
- [NoReadyVirtOperator.md](runbooks/NoReadyVirtOperator.md)
64-
- [VirtOperatorRESTErrorsHigh.md](runbooks/VirtOperatorRESTErrorsHigh.md)
65-
- [VirtApiRESTErrorsBurst.md](runbooks/VirtApiRESTErrorsBurst.md)
6650
- [KubeVirtCRModified.md](runbooks/KubeVirtCRModified.md)
51+
- [VirtHandlerRESTErrorsHigh.md](runbooks/VirtHandlerRESTErrorsHigh.md)
52+
- [VirtApiRESTErrorsBurst.md](runbooks/VirtApiRESTErrorsBurst.md)
53+
- [LowReadyVirtOperatorsCount.md](runbooks/LowReadyVirtOperatorsCount.md)
54+
- [VMCannotBeEvicted.md](runbooks/VMCannotBeEvicted.md)
55+
- [VirtOperatorDown.md](runbooks/VirtOperatorDown.md)
56+
- [PersistentVolumeFillingUp.md](runbooks/PersistentVolumeFillingUp.md)
57+
- [CDINotReady.md](runbooks/CDINotReady.md)
58+
- [SSPOperatorDown.md](runbooks/SSPOperatorDown.md)
59+
- [KubeVirtDeprecatedAPIRequested.md](runbooks/KubeVirtDeprecatedAPIRequested.md)
60+
- [HighNodeCPUFrequency.md](runbooks/HighNodeCPUFrequency.md)
61+
- [HPPNotReady.md](runbooks/HPPNotReady.md)
62+
- [VirtControllerRESTErrorsBurst.md](runbooks/VirtControllerRESTErrorsBurst.md)
63+
- [VirtOperatorRESTErrorsBurst.md](runbooks/VirtOperatorRESTErrorsBurst.md)
64+
- [VirtAPIDown.md](runbooks/VirtAPIDown.md)
65+
- [CDIDataVolumeUnusualRestartCount.md](runbooks/CDIDataVolumeUnusualRestartCount.md)
66+
- [LowVirtOperatorCount.md](runbooks/LowVirtOperatorCount.md)
6767

6868
## Deprecated Runbooks
6969

70+
- [KubeVirtVMStuckInMigratingState.md](runbooks/KubeVirtVMStuckInMigratingState.md)
7071
- [OperatorConditionsUnhealthy.md](runbooks/OperatorConditionsUnhealthy.md)
71-
- [VirtualMachineCRCErrors.md](runbooks/VirtualMachineCRCErrors.md)
72+
- [KubevirtHyperconvergedClusterOperatorNMOInUseAlert.md](runbooks/KubevirtHyperconvergedClusterOperatorNMOInUseAlert.md)
7273
- [KubeVirtComponentExceedsRequestedMemory.md](runbooks/KubeVirtComponentExceedsRequestedMemory.md)
7374
- [KubeVirtVMStuckInStartingState.md](runbooks/KubeVirtVMStuckInStartingState.md)
74-
- [KubeMacPoolDown.md](runbooks/KubeMacPoolDown.md)
75-
- [KubevirtHyperconvergedClusterOperatorNMOInUseAlert.md](runbooks/KubevirtHyperconvergedClusterOperatorNMOInUseAlert.md)
76-
- [KubeVirtVMStuckInMigratingState.md](runbooks/KubeVirtVMStuckInMigratingState.md)
77-
- [KubeVirtComponentExceedsRequestedCPU.md](runbooks/KubeVirtComponentExceedsRequestedCPU.md)
7875
- [KubeVirtVMStuckInErrorState.md](runbooks/KubeVirtVMStuckInErrorState.md)
76+
- [VirtualMachineCRCErrors.md](runbooks/VirtualMachineCRCErrors.md)
77+
- [KubeVirtComponentExceedsRequestedCPU.md](runbooks/KubeVirtComponentExceedsRequestedCPU.md)
78+
- [KubeMacPoolDown.md](runbooks/KubeMacPoolDown.md)
7979

8080
## Renamed Runbooks
8181

0 commit comments

Comments
 (0)