Hello.
I want to use the latest vllm with 4x A770.
What steps should i do?
Do i need to use
https://github.com/jikunshang/vllm
or all i need is implemented to vllm main?
Ipex-llm support is ended, and i don't know where and how to start with the latest vllm now..
The Llm-scaller project is for bmg (b580/b60)