VAE - Artifacts Problem

[Madxis]

I have Checkpoints that generate artifacts and they recommend using VAEs to avoid it, but I don't know how to choose a specific one. In the VAE folder I have 2, and although they are in the corresponding folder, I still see artifacts.

In total I have come across 3 checkpoints with this artifact problem.

The checkpoint of the preview I uploaded is this: https://civitai.com/models/120090?modelVersionId=268240
_(Euler Karras, CFG 7, 20 steps, seed 5429448612200702317)
And as you can see in the comments, everyone has solved the problem with VAE.
This is another checkpoint with artifacts that I wasn't able to make it work:
https://civitai.com/models/142313/aikimixl?modelVersionId=157794

So I was wondering how to solve this, since I'm finding more and more checkpoints that need VAEs to function properly.

[poor7]

Is another Sampler not suitable for you or gives the same result?

[Madxis]

They have a very particular style that is difficult to emulate with another checkpoint (At least I haven't managed it), even so there should be some way to make the VAE work to be able to use any checkpoint, right?

[3Diva]

I haven't tried this model, so I'm not sure if this would help - but as poor7 pointed out, perhaps the sampler will make a difference. I see that in most of the images that the model's creator posted it looks like they're using "Euler a" as the sampler, while the default sampler for Fooocus is "dpmpp_2m_sde_gpu". You might try using the settings the model's creator is using and see if that helps. They're using Euler a which is called "euler_ancestral" in Fooocus, as well as a sampling step count of 20.

To change the Sampler in Fooocus you can do that under the "Advanced" tab >> "Developer Debug Mode" >> "Sampler". You can change it to "euler_ancestral" to see if that helps. You can also change the step count under Developer Debug Mode and "Forced Overwrite of Sampling Step".

Hopefully that will help with the issue. :)

[3Diva]

Here's the image I got:

Here are the settings I used:

The style does look a bit different.

[3Diva]

These settings look a bit better:

[Madxis]

Thank you very much for taking the time to do this!
I see that you also have artifacts in them but in much smaller quantities
And the colors you get are much more vivid, did you leave Fooocus V2, Enhance and Sharp selected?

[3Diva]

@Madxis No, I unchecked all the styles as I didn't want it to effect the outcome of the image. There are definitely still artifacts but it's not as bad. I do think there's a way to change the VAE but hopefully there are also internal settings that can be found to fix the issue. It seams that the Model is perhaps a little "over trained"? I'm not sure, but I've never seen that issue within Fooocus before, so I'm sure it must have something to do with the model or how it was trained. Hopefully you'll find a better solution or a model that works a little bit easier with Fooocus. :)

[Madxis]

Thank you so much! I'm going to save the checkpoint page, hopefully the creator makes a version that works better with Fooocus or some Fooocus update allows us to use VAEs more easily, thank you again!

[mald55]

I have the exact same problem with a model I use, and I believe it is the fact it doesn't have an embedded VAE. Not sure on how to fix on Fooocus.

[Madxis]

These are exactly the dots I have when trying to use this model: https://civitai.com/models/142313
It's very frustrating because I see others being able to use these models without any artifacts.
As I told 3Diva, I hope that in the future we will be able to switch between different types of VAEs, as I see that being the solution in all cases.