add sage-attention and flash-attention support,add support for noob ctrlnet models,automaticly add local themes in tmp/gradio_themes

[spawner1145]

refer to #2815 ,for windows,whl can be found in flash attention and sage attention,use the methods by adding --use-sage-attention or --use-flash-attention

[aiartalchemy]

Hey spawner1145. It seems not many updates are being done to forge at this point. Do you think you could please add support for the HiDream model into forge? pretty please!

[spawner1145]

Hey spawner1145. It seems not many updates are being done to forge at this point. Do you think you could please add support for the HiDream model into forge? pretty please!

Unfortunately my hardware is weak (RTX 4070 Laptop), and it's preventing me from properly working on the HiDream model implementation. 😥

[aiartalchemy]

Hey spawner1145. It seems not many updates are being done to forge at this point. Do you think you could please add support for the HiDream model into forge? pretty please!

Unfortunately my hardware is weak (RTX 4070 Laptop), and it's preventing me from properly working on the HiDream model implementation. 😥

Ah man, HiDream is amazing. I really hope someone will implement it into Forge. I love Forge.

There is another new model that maybe you might be interested in. It's a modified version of flux but it made the model small. Runs in comfy but not Forge.

https://huggingface.co/lodestones/Chroma

[spawner1145]

Hey spawner1145. It seems not many updates are being done to forge at this point. Do you think you could please add support for the HiDream model into forge? pretty please!

Unfortunately my hardware is weak (RTX 4070 Laptop), and it's preventing me from properly working on the HiDream model implementation. 😥

Ah man, HiDream is amazing. I really hope someone will implement it into Forge. I love Forge.

There is another new model that maybe you might be interested in. It's a modified version of flux but it made the model small. Runs in comfy but not Forge.

https://huggingface.co/lodestones/Chroma

It seems reforge supports plenty of models,maybe u can have a try?👀

[maybleMyers]

@spawner1145 Did you see an increase in speed with sage or flash? I am seeing the same or worse performance, at least with chroma.

[spawner1145]

@spawner1145 Did you see an increase in speed with sage or flash? I am seeing the same or worse performance, at least with chroma.

@maybleMyers results can be found in #2815

[mmtr-s]

When generated with an empty negative prompt, flash attention generates it fine, but sage attention generates a black blank image. Can anyone correct this situation to correct generation?