DeepCache with image2image and img2img ControlNet for SDXL/SD1.5 #1181
Description
🚀 The feature, motivation and pitch
Requested Feature: enable DeepCache acceleration in onedfiff for use with img2img and img2imgControlNet diffusers pipelines.
Alternatives
There are many other optimizations I use in my pipeline already, I just need DeepCache to work with OneDiff
Additional context
The performace boost according to your documentation from DeepCache+OneDiff is great enough that it would be a huge benefit to have it fully functional for img2img pipelines (at least). ControlNet and img2img ControlNet pipelines would also be extremely useful as a lot of realtime applications make heavy use of these for controlling the output of realtime SDXL and SD 1.5 rendering.
The below video demonstrates one such usecase: Multiple ControlNet outputs from NDI from Unity3D into OneDiff accelerated diffusers pipelines for interactive/realtime WASD/mouse control
Without DeepCache the speed is somewhat OK at 2 steps on a single rtx3090, but to be able to add just 1 or 2 extra denoising steps and retain this same speed per the performance boost added by DeepCache, would result in far more viable rendering quality for use in a realtime ControlNet+Agent based WASD-controlled videogame.