Batch size increase

[gabriel-oj]

Hi guys, is there currently support for batch sizes of 2 or more? By that, I mean generating multiple images in parallel, not just increasing the "Image Number".

I now have 16GB VRAM so that would be really useful.

Thanks in advance.

[Rogala]

One video card, one task

[gabriel-oj]

I can run 2 instances of Fooocus at the same time just fine, so your statement is not entirely accurate. Additionally, there are other repos such as stable-diffusion-webui-forge that do offer the option of batch size 2 or more. What I understand from your reply is that Fooocus doesn't have this feature implemented, and that's ok. It would be good to have it, since it speeds things up a little, but I know there are no plans to further develop Fooocus.

Thanks for your reply.

[Rogala]

You are mistaken, all the work goes on sequentially, even if you launch 20 copies, they will go in turn

[gabriel-oj]

The 2 instances are generating images simultaneously, I don't even have duplicate Fooocus files.

I understand what you're trying to say though, the GPU is dividing its attention equally between the 2 processes. Still, the GPU clearly can handle 2 tasks concurrently. You said "one video card, one task".

[Rogala]

I'm afraid to upset you, but if you run one task, what will be the speed of it/s

[gabriel-oj]

You're not upsetting me. By running one task I'll get double that, around 3.4 it/s, that's why I said I understand your point. Still, technically, I'm running 2 tasks, even though the GPU is dividing its attention. This is already deviating from the topic I originally proposed, so I guess we're done here. Thanks for your time.

[Rogala]

[gabriel-oj]

What you said makes zero sense