Inpainting way too sharp, bug or not?

[xunkar]

Everytime I try to do inpainting, the inpainted areas are oversharpened to the point of generating artifacts. Here is an example where the character was inpainted.

Both the original and the inpaint where generated using the same parameters, but no matter what, results are always a downgrade and the artifacts become patterns or discolorations. It looks like it tries to add too much detail.

Now, I've read lllyasviel saying something to the effect of not wanting to work on a feature like regional prompter because inpainting could (in theory) do the same, but I believe this is where inpainting will always fall short: it depends on the model being used, right? It seems to me that my issue stems from the fact that this particular model is unable to handle inpainting correctly, and this is precisely where the only solution that comes to mind is to generate the correct picture from the start. Something regional prompter would help doing.

But I digress. Is this an issue with the inpainting engine or the model?

[xunkar]

To add a bit more details: I've tried setting sharpness to 0 and guidance to 2, but it has no effect. Take a look at this one, I think it better captures the issue.

[mashb1t]

Please provide more background information about thr models you're using, resolution of the target image, etc., best by uploading the full terminal log here.

[xunkar]

Well none of the settings affect the result. The target resolution? It's an inpainting, it's the resolution of the base picture (the first one) I don't think the inpainting resolution can be controlled?

The first model is FantasyBlendXL. The civitai link is NSFW so I won't post it here, but the model handles pretty much everything and gives great results in the anime style, which is why I've been using it. However this also happens with much more standard models, like juggernautXL_v8

Notice how the inpainted areas are over contrasted and saturated. The prompt for all the pictures was 1girl, fighting, martial arts, dynamic, street art with style Graffiti Art enabled, that's it. And it's all default settings.

Sometimes it seems to be working well until the mid point where the Refiner Swapped stepped happens (internal, I have no refiner enabled).

[xunkar]

Well there seems to be something definitely bugged with the inpainting engine.

On the left is the source image. The face was masked in inpainting, using "improve details" with "highly detailed face" as an additional prompt. The middle image is the result with the inpainting engine option set on v1, v2.5 or v2.6 (the results are slightly different for each but they all show the same kind of… overwork), the image on the right is using "none" as inpainting engine.