How to speed up inference

[shengyuting]

Thank you for your great work. I succeeded in implementing the inference, but it seems a little slow.