Prebuilt kernels not found, using JIT backend

[rangehow]

Under what circumstances will this prompt appear? Since my environment is offline, I downloaded the .whl file from the release and installed it successfully on the server using pip, with no errors during the entire process. Should I be concerned about this prompt, and does it indicate a potential decrease in inference performance?

[yzh119]

Hi @rangehow , that indicates you are using the JIT version instead of AOT version.

I downloaded the .whl file from the release and installed it successfully on the server using pip

What's the url of the wheel file you download from?

For JIT version, If you properly warmup the kernel compilation, this would not bring performance decrease. We have cache for JIT compiled kernels.

[rangehow]

Thanks for your explanation. I download wheel from release in this repository. https://github.com/flashinfer-ai/flashinfer/releases/download/v0.2.1.post2/flashinfer_python-0.2.1.post2+cu121torch2.5-cp38-abi3-linux_x86_64.whl
So if there exists some way that we can download .whl for AOT version?