about trt

[PonyPinkPie]

hi, very appreciating your excellent work, however, is there any code about converting it to TRT?

[ahatamiz]

Hi @PonyPinkPie , unfortunately, we have not tried the TRT engine with MambaVision yet. But it should be well-supported.

[PonyPinkPie]

Hi @PonyPinkPie , unfortunately, we have not tried the TRT engine with MambaVision yet. But it should be well-supported.

There seem to be some difficulties in converting the MAMBA model to TRT, which hinders the use of such advanced models in practical projects. Does NVLabs have plans to support this feature? thanks.