How to select GPU?

[kpagcha]

I am running this on Windows but when I check the GPU usage, it seems to generally prefer to use the Intel GPU instead of my Geforce one. I changed the bat to this setting I found:

set TF_CUDNN_USE_AUTOTUNE=0 CUDA_VISIBLE_DEVICES=2 & .\python_embeded\python.exe -s Fooocus\entry_with_update.py

I tried CUDA_VISIBLE_DEVICES=1 too.

But it keeps using mostly the Intel GPU.

[robinpoppins]

I have the same issue. The programm runs on my internal gpu, but i want to use my rtx 4060. i got the latest drivers. can anyone please assist with code adaptions?

[dawidteo]

I added in "Launch options" in "Extra Launch Arguments" "--gpu-device-id 1" and it works great. Use two GTX1070 in two Fooocuses apps in the same time.

[SreeisonGithub]

can anyone tell me where to add this, like i am a beginner and pls explain in laymen terms as to where i can add launch options, i run foocus and saw that gpu usage was around 4 percent, and then it crashes.

[Rogala]

Edit the run.bat launch file in Notepad or another editor
All CMD Flags

[Ni-Deshmane]

Hi, can someone paste the completed code for this? I'm lost on how to modify the files without breaking something

[fparie]

this option does not seem to do anything when using AMD GPUs and the --directml option. Is it possible to select AMD GPU ID 1 ?

[robinpoppins]

Awesome, thank you! dawidteo ***@***.***> schrieb am Do., 1. Feb. 2024, 01:12:

…

I added in "Launch options" in "Extra Launch Arguments" "--gpu-device-id 1" and it works great. Use two GTX1070 in two Fooocuses apps in the same time. — Reply to this email directly, view it on GitHub <#1151 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AFJO6NEHFSHROCS32U4DIETYRKXU3AVCNFSM6AAAAABAE4C7KSVHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4DGMRXGUYTO> . You are receiving this because you commented.Message ID: ***@***.***>

[jimmyandrews]

Not sure if this is appropriate to reopen this issue, but I'm having some oddities with the Docker version of the deployment and this issue.

I found where to add in that setting (docker-compose.yml, Line 11, - CMDARGS=...) and can successfully rerun docker compose to push up that config. During the container startup, everything looks good, sees the new flag, finds my NVidia GPU, sets it up, recognizes it correctly, etc. (Turns out with the default settings it was already grabbing the NVidia GPU anyway.) But when I go to run a prompt, I can see the NVidia VRAM being exercised, a blip on the 3D use when the prompt is first executed, but then it's the Intel GPU that does all the 3D processing. It was most easily to see the behavior using the "default" preset and using only the SAI 3D Model style, with a prompt of "Beautiful pasture at sunset."

What am I missing, or is this standard behavior?

[pawrequest]

same here, but launching from the provided .bat files.

console output correctly identifies the nvidia GPU but task-manager shows work is done on integrated AMD gpu.

[jimmyandrews]

I've poked around a bit with this and apparently there is some bugginess with the Task Manager and showing proper values. When I open another application that pings the GPU usage, it does appear that my NVidia GPU is being exercised.

I'm starting to play with stable-diffusion-webui-forge code, now that I have my bearings a bit more. Updated my CUDA drivers too using the NVidia CUDA installer, so hopefully I can have some luck there.