Fooocus-Control：add controlnet to fooocus

[fenneishi]

Hi,

I'm excited to share Fooocus-Control.
Fooocus-Control is a ⭐free⭐ image generating software (based on Fooocus , ControlNet ,👉SDXL , IP-Adapter , etc.).
Fooocus-Control adds more control to the original Fooocus software.

github: https://github.com/fenneishi/Fooocus-ControlNet-SDXL

---

---

---

💡 FooocusControl keeps it simple

• Fooocus is an excellent SDXL-based software, which provides excellent generation effects based on the simplicity of
  liking midjourney, while being free as stable diffusiond.
• FooocusControl inherits the core design concepts of fooocus, in order to minimize the learning threshold,
  FooocusControl has the same UI interface as fooocus (only in the Input Image/Image Prompt/advance to add more
  options).
• FooocusControl does all the complicated stuff behind the scenes, such as model downloading, loading, registration,
  image preprocessing, etc. Users don't need to bother with any of this at all, you just need to check the desired image
  control method.

💡 FooocusControl facilitates secondary development

• FooocusControl simplifies the way fooocus integrates with controlnet by simply defining pre-processing and adding
  configuration files.
• If you are a developer with your own unique controlnet model , with FooocusControl , you can easily integrate it into
  fooocus .
• In addition to controlnet, FooocusControl plans to continue to integrate ip-adapter and other models to further
  provide users with more control methods.

💡 FooocusControl pursues the out-of-the-box use of software

• Free software usually encounters a lot of installation and use of the problem, such as network problems caused by the
  model file that can not be downloaded and updated, a variety of headaches gpu driver, plug-ins lack of dependent
  libraries and other issues. These are very annoying invisible thresholds. fooocusControl is committed to solving these
  problems.
• FooocusControl has no external dependencies, all the dependencies are built into the software.
• FooocusControl provides both light and massive download methods, the latter will download all the models built into
  the software, which is very friendly to users who need to run offline, or those who have a bad network.
• Outside the windows platform, FooocusControl will try to use docker and other technologies to further simplify the
  user installation, to avoid various gpu and dependency problems to the greatest extent possible.
• FooocusControl will add multiple download sources for each model (coming soon) to prevent models from being downloaded
  or updated due to network problems.

---

Free Install Fooocus-Control

🍇show case🍇

Sketch

---

ImagePrompt

---

Canny

---

Depth

---

Pose

:face can control pose

---

Recolor

---

[barepixels]

I tested Depth. Works great. Here is my result
(NSFW) https://i.imgur.com/QFfParx.jpg (NSFW)

You should have Issues and Discussion activated on your GitHub so people can leave feedback

[fenneishi]

happy to help you.

[fenneishi]

The Issues and Discussions have been activated.

[adafym]

Yeah, need this.

[adafym]

Well, I have tested depth and pose, it works great!!!

[lllyasviel]

Thanks for the work.
This repo has been added to #699 and some related fork promotions are added to several places.
Feel free to see also related policy and more details in the above link.

[fenneishi]

Thank you for adding this repo to #699 and promoting the forks. I've reviewed the related policy in the link. Looking forward to contributing more to the community!

[PeiPeiWow]

Great!!!

[kantsche]

it would be good to have a start at and stop at

[fenneishi]

Can you give me some image evidence instance?If it's not too much trouble.

[fenneishi]

Or some research？

[kantsche]

This image used for ip adapter

with the prompt "portait dog painting"

stop at 1.0

stop at 0.5

start at 0.5

start at 0.6

start at 0.4 stop at 0.6 (but with higher weight, foocus can only go to 1.0)

[fenneishi]

Thank you very much for your feedback，I will actively consider this feature.

My thinking is:

Essentially,this is a bug(or flaw) at the algorithmic layer instead of software layer

So, the complete solution is to resolve the conflicts between the various prompts ,This paper may point to an idea for the solution：
《Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Models》

As a temporary solution, I might prefer one of the following：

• Introduce a choice button in image prompt: content or style. content with default "start at=0.0" and style with default 'start at = 0.5'.
• Add a new control named : "image prompt(style)" with the default 'start at=0.5' and the ‘start at’ can be config by user.

thanks again!

[fenneishi]

developing 🤘✌️

[Yaozong-Lee]

is it different from fooocus-MRE?

[RompinDonkey]

Hello. Noobie to AI gen software here (apologies if my question is silly) Interested in adding this to Fooocus which I have loved so far. I am limited in software I can use due to my PC specs. That's the beauty of Fooocus, my 1060 6gb card and i5 7600 is handling things perfectly, gens coming out nice and fast with pleasing results etc. Would adding FooocusControl change that? Would it still run as smoothly and efficiently as without FC?

Edit: Or have I misunderstood - IS FC a separate software? I originally assumed it was some kind of extension or add-on to the original Fooocus. Apologies if I misunderstood.

Thanks.

[YourKoach]

I already have the original Fooocus installed. Do I need to uninstall it before I can install Fooocus-Control?

[mashb1t]

Fooocus-Control is a separate project and can simply be downloaded and installed in parallel by using a different folder name.