[Feature] ARM NEON support #16271
Description
Checklist
- If this is not a feature request but a general question, please start a discussion at https://github.com/sgl-project/sglang/discussions. Otherwise, it will be closed.
- Please use English. Otherwise, it will be closed.
Motivation
Please support ARM cou based solutions also. They are much cheaper and faster than the Intel based solutions for CPU inference.
Related resources
No response