[Hardware] Enable XPU Device on Intel GPU

[liangan1]

Introduction

Enable XPU device on Intel GPU.

Limitation

• Marlin kernel is not supported on xpu.
• XPU is not supported by flash_attn repo, So, only torch native backend is available for MLA.
• cuda graph is used for CUDA while no sycl graph supported for XPU now.

Validation command:

python -m ktransformers.local_chat --model_path deepseek-ai/DeepSeek-V2-Lite-Chat --gguf_path ./DeepSeek-V2-Lite-Chat-GGUF --device xpu --optimize-config-path ktransformers/optimize/optimize_rules/DeepSeek-V2-Chat-XPU.yaml

Chat: how are you
As an AI, I don't have feelings or emotions, so I can't answer that question in a human-like way. However, I'm here to help you with any questions or information you need. How can I assist you today?

[liangan1]

@Azure-Tang can u help to review this PR? I have validated the functionality on both XPU and CUDA device and the output is expected.

[Atream]

Thank you for your contribution.
We will merge after planning and testing a unified architecture that is compatible with various GPUs. Until then, please use your own branches first. Remember to frequently merge the main branch to stay synchronized with us and achieve better performance.

[aubreyli]

I verified this PR and it works as expected on my Intel Arc-770 card.