[Feature] Does MMCV consider supporting intel gpu?

[Dark1Forest]

What is the feature?

Does MMCV consider supporting intel gpu.because now, pytorch has released a branch that supports intel gpu

Any other context?

No response

[C1rN09]

Thanks for you feedback!

pytorch has released a branch that supports intel gpu

I'm not familiar with this branch, can you provide with more context? Since MMCV is partly built upon PyTorch, it should be natural for MMCV to support intel GPU once PyTorch did it.

Does MMCV consider supporting intel gpu

It depends. If that means adding an existing PyTorch device, e.g. opencl, to MMCV, this should be done quickly. However, if it means migrating massive existing CUDA ops, this may take a long time. We are currently working on other important features, so this migration is of relatively low priority, unless many of our users need it. :)

Finally, we always welcome contributors from our community! If you are interested in this feature, feel free to make discussions or posting PRs!

[Dark1Forest]

Pytorch has provided support for intel gpu.
This is docs form pytorch https://pytorch.org/tutorials/recipes/intel_extension_for_pytorch.html
This is github path https://github.com/intel/intel-extension-for-pytorch/tree/xpu-master
Pytorch claims that the code compatibility is very good, and must not make too many changes to the code

[Dark1Forest]

xpu branch like cpu branch
you just move somthings to xpu like this

import torch
import torchvision.models as models

model = models.resnet50(pretrained=True)
model.eval()
data = torch.rand(1, 3, 224, 224)

import intel_extension_for_pytorch as ipex
model = model.to('xpu')
data = data.to('xpu')
model = ipex.optimize(model)

with torch.no_grad():
  model(data)

[C1rN09]

This feature looks good! Are you willing to have a try and post a PR? @Dark1Forest

[Dark1Forest]

I hope so, but I don't know much about the source code of mmcv. It takes a lot of time to release pr. I'm just a newcomer to AI

[C1rN09]

I hope so, but I don't know much about the source code of mmcv. It takes a lot of time to release pr. I'm just a newcomer to AI

That's OK. This feature is a relatively low priority to us, because it's currently not required by most users. As a result, we will consider this feature later, when we have time for this, or when many users call for it. Before that time, you as well as other contributors are always welcome to post a PR, so that we can review it soon. ^_^

[Dark1Forest]

It doesn't matter. You can tell me when I expect to see this function release.

[LoSealL]

I can consider to support this feature in mmcv, @Dark1Forest so can you explain your request more detaily? What's the pain point for you to run on Intel GPU (iGPU or Arc?) Do you need training, or just inference?

[Dark1Forest]

I can consider to support this feature in mmcv, @Dark1Forest so can you explain your request more detaily? What's the pain point for you to run on Intel GPU (iGPU or Arc?) Do you need training, or just inference?

I hope to train on arc 770.

[LoSealL]

@C1rN09 May I ask if I'd like to add a new device type 'xpu' support, shall I create to PR to both mmcv and mmengine?

It seems when mmcv goes to 2.x, such related codes will be moved to mmengine.