Add NVIDIA DOCA-OFED driver support

[adionisio-nok]

To enable GPUDirect RDMA in our GPUs, we need DOCA-OFED driver and user space libraries. DOCA-OFED is substitute to MLNX_OFED driver (ref).

There seems to be MLNX_OFED package before that was supported in talos but was removed.

--
Update:

Attaching pdf version of the above link:
nvidia-mlnx-ofed-to-doca-ofed-transition-guide.pdf
There is also full guide pdf version on DOCA (but it's failing to be uploaded to github) https://docs.nvidia.com/doca-documentation-v3-2-1-lts.pdf

I've tested doca-networking profile (page 190 in full doca documentation) in baremetal B200 setup and was able to enable GPUDirect RDMA.

[frezbo]

None of the docs or the pdf open for me, is this geo-restricted? It can't load the awswaf challenge

[adionisio-nok]

Updated the issue description with the pdf attachment/link.

[adionisio-nok]

Hi, in the baremetal setup, I installed "doca-networking" profile:
https://developer.nvidia.com/doca-downloads?deployment_platform=Host-Server&deployment_package=DOCA-Host&target_os=Linux&Architecture=x86_64&Profile=doca-networking&Distribution=Ubuntu&version=24.04&installer_type=deb_online

It has the following dependences:

• MFT https://docs.nvidia.com/networking/display/mftv4341lts/compilation-and-installation and,
• mft-mlx5 (sudo apt install mft-mlx5=4.34.1-8)

You might also want to look into adding "doca-all" into talos for future needs as well.

[adionisio-nok]

Hi, here are some logs from when I installed doca-ofed. Also attaching logs for nvlink5 as I don't know if it's already available in talos, but it is also a dependency for fabric manager. Hope this helps.

doca-ofed-3.1.0-install-logs.txt
nvlink5-580.txt