[Feature] Can you add `gpu-type: intel`

[shiipou]

Can you add the possiblity to use Intel Arc A770 GPU for Ollama ?

It just in cause that the image you set is for AMD or NVIDIA, you can still use a special one for Intel Arc GPU.

ollama:
  gpu:
    type: 'intel'

I can help testing it and/or implement it but I need some guideline about where to start to made the change in your project.

[jdetroyes]

Hello @shiipou

It's look like support for intel GPUs are not really supported by ollama yet, according to these issues/pull requests:

• Add support for Intel Arc GPUs ollama/ollama#1590
• Add support for running llama.cpp with SYCL for Intel GPUs ollama/ollama#2458
• Enabling ollama to run on Intel GPUs with SYCL backend ollama/ollama#3278

But we can take a look with Intel integration:

• https://github.com/intel/intel-device-plugins-for-kubernetes/tree/main/cmd/gpu_plugin
• https://github.com/intel/intel-resource-drivers-for-kubernetes

[mmalyska]

Hi @jdetroyes , Intel GPU and iGPU is support in ollama since v0.5.1.
Do you consider now adding it to helm chart?

Ref docs: https://github.com/intel/ipex-llm/blob/main/docs/mddocs/Quickstart/ollama_quickstart.md#run-ollama-with-ipex-llm-on-intel-gpu

[schmierlappe]

is this now available to use?

[jdetroyes]

Ollama still does not support natively Intel GPU. Actually Ipex-llm is a workaround and not an official support.