Adding A "Pull CLIP from Checkpoint" for Pony and Other XL Integrated Models

[tommywright]

It would be AMAZING if we could have an option to use Load Checkpoint and pull the CLIP straight from the Checkpoint, this would fix a lot of issues for using models like many Pony and other XL models that have an integrated CLIP encoder. Many of my XL and Pony models do not work (give me extremely poor results) because they have integrated the CLIP right into the Checkpoint so that it can match the training.

Here are some models that do not work (give very poor results) with clip_g and clip_l (ones that have integrated CLIP). If you run them, notice the crazy noise patterns they generate over the top of the images.....
CyberRealisticPony
DamnPonyRealistic
CyberRealisticSemi
AbsoluteUnReal
Semimergeij
Ternarymix3DRealism

These are just the ones I have local. I'm guessing a ton more do not work because of this.

[Acly]

That's what it does for all models in /checkpoints folder. What makes you think otherwise?

[tommywright]

Because when I dump the ComfyUI workspace, it is not setup that way. It explicitly uses clip_l and clip_g and the result looks exactly like it does in Krita. If I replace the DualCLIPLoader with a standard Load Checkpoint (the one with the CLIP output on it) and replace the pipe for the DualCLIPLoader, it works as expected. So the built in ComfyUI for Krita does not use the Model's CLIP, it uses clip_l and clip_g.

[tommywright]

Try one of those models and you'll see. They render with crazy patterns all over them. Here.. try this one...
https://civitai.com/models/443821/cyberrealistic-pony

[tommywright]

Wait! Are you telling me I need to put those models in the checkpoints/ folder? OMG... let me try that!!! I always put my models in unet.

[tommywright]

OMG.. I'm an idiot! Ok, thank you for clearing that up. I have no idea which of my models are Checkpoints but I assume all of the Pony models are as none of those worked before. I'm going to buy you a coffee just for having to deal with my dumb ass. :P

Oh no... your "buy me a coffee" 404s! Let me know when it's fixed!