reproduce by replace dim with 3420 https://github.com/flashinfer-ai/flashinfer/blob/f84ac1c97e2e1a4391150ca73971b973ee569e5a/tests/utils/test_activation.py#L40 Also you can refer to: https://github.com/alibaba/rtp-llm/blob/main/3rdparty/flashinfer/0010-silu-mul-vec-size.patch