docs: add VM restart and addon management warnings for PCI devices

- Add warning to restart VMs immediately after modifying PCI/vGPU devices
- Document annotation to skip addon disable check when VMs are stopped with devices attached
- Explain synchronization importance between VM spec and running state

Signed-off-by: Jack Yu <[email protected]>

Author: Yu-Jack

docs/advanced/addons/nvidiadrivertoolkit.md

@@ -32,6 +32,16 @@ On pod startup, the ENTRYPOINT script will download the NVIDIA driver from the s
 
 The `PCIDevices` addon can now leverage this addon to manage the lifecycle of the vGPU devices on nodes containing supported GPU [devices](../vgpusupport.md).
 
+:::warning
+
+**Always restart the VM immediately after attaching or detaching vGPU devices.**
+
+Although rebooting the VM after editing its spec is not mandatory, we strongly recommend doing so to ensure proper synchronization. Without an immediate reboot, the addon disable check might not accurately detect devices in use.
+
+If you need to disable and re-enable the `nvidia-driver-toolkit` addon while VMs are stopped with host devices attached, you can annotate the addon with `harvesterhci.io/skipNvidiaDriverToolkitAddonWebhookCheck` to skip the addon disable check.
+
+:::
+
 ## Install Different NVIDIA Driver Versions
 
 _Available as of v1.7.0_

docs/advanced/addons/pcidevices.md

@@ -53,6 +53,15 @@ Select **PCI Devices** and use the **Available PCI Devices** drop-down. Select t
 
 ![](/img/v1.2/pcidevices/vm-pcidevices-attach.png)
 
+:::warning
+
+**Always restart the VM immediately after adding or removing PCI devices.**
+
+Although rebooting the VM after editing its spec is not mandatory, we strongly recommend doing so to ensure proper synchronization. Without an immediate reboot, the addon disable check might not accurately detect devices in use.
+
+If you need to disable and re-enable the `pcidevices-controller` addon while VMs are stopped with host devices attached, you can annotate the addon with `harvesterhci.io/skipPCIDevicesControllerAddonWebhookCheck` to skip the addon disable check.
+
+:::
 
 ## Using a passed-through PCI Device inside the VM