Skip to content

techrumel/Disco-Diffusion

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 

Repository files navigation

Disco-Diffusion

Create Video to Disco Diffusion Video

Disco Diffusion v5.2 - Warp by Raj Rumel

visitors

This version improves video init. You can now generate optical flow maps from input videos, and use those to:

  • warp init frames for consistent style
  • warp processed frames for less noise in final video

##Init warping The feature works like this: we take the 1st frame, diffuse it as usual as an image input with fixed skip steps. Then we warp in with its flow map into the 2nd frame and blend it with the original raw video 2nd frame. This way we get the style from heavily stylized 1st frame (warped accordingly) and content from 2nd frame (to reduce warping artifacts and prevent overexposure)


This is a variation of the awesome DiscoDiffusion colab

If you like what I'm doing you can

Thank you for being awesome!


About

Create Video to Disco Diffusion Video

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors