I have used nvidia-dcgm-exporter to expose the nvidia metrics via port 9400.
I managed to find some metrics like DCGM_FI_DEV_GPU_TEMP, etc but I am not able to find metrics for GPU utilisation like DCGM_FI_DEV_GPU_UTIL.
Any advice how to get it to work? I need to display GPU utilisation on Grafana.