How to Use Omnitrace in hpcfund

[zixianwang2022]

Hi, is there a support to use omnitrace in hpcfund clusters? I don't see it using module spider omnitrace.

module spider omnitrace
Lmod has detected the following error:  Unable to find: "omnitrace".

Do I need to manually download it to use?

[tom-papatheodore]

Hi @zixianwang2022. Again, I'll have to defer to @koomie here as he works most closely with the omnitools.

[zixianwang2022]

Thank you @tom-papatheodore,

Just adding more information here:

I tried downloading omnitrace from source here: https://github.com/ROCm/omnitrace/releases/tag/rocm-6.2.4.

I found that hpcfund is using rocm 6.4, rocky linux 9.1. However, the closes release I found is "omnitrace-1.11.2-rhel-9.2-ROCm-60000-PAPI-OMPT-Python3.sh". So I used it instead. I also tried rhel9.1, but it failed either.

Then I did the following according to this video and this document:

mkdir ~/omnitrace
cd ~/omnitrace

(xmoe) [zixianw4@k004-001 omnitrace]$ wget https://github.com/ROCm/omnitrace/releases/download/rocm-6.2.4/omnitrace-1.11.2-rhel-9.2-ROCm-60000-PAPI-OMPT-Python3.sh
(xmoe) [zixianw4@k004-001 omnitrace]$ bash omnitrace-1.11.2-rhel-9.2-ROCm-60000-PAPI-OMPT-Python3.sh 

xmoe) [zixianw4@k004-001 omnitrace]$ module use share/modulefiles/
(xmoe) [zixianw4@k004-001 omnitrace]$ module load omnitrace
omnitrace         omnitrace/1.11.2  
(xmoe) [zixianw4@k004-001 omnitrace]$ module load omnitrace/1.11.2 
(xmoe) [zixianw4@k004-001 omnitrace]$ source share/omnitrace/setup-env.sh 

I am able to call out

omnitrace-instrument --help

But it gives me error for using omnitrace-avail --help:

omnitrace-avail --help
omnitrace-avail: error while loading shared libraries: librocm_smi64.so.6: cannot open shared object file: No such file or directory