Debug tensors

[kahfizulkifli]

I'm just wondering, is there some clean way to debug tensors in compiled HLO graphs. In transformers-neuronx, there is a global_debugger. Also, is it possible to print tensors from multiple devices, since when I print tensors, they only shown in device 'xla:0'. I'm confused about trying to view tensors from other devices, like 'xla:1'. Thanks!

[aws-yyjau]

Hi @kahfizulkifli

Thanks for the message. We will look into it and get back to you.