Sampling/Inference Speed

[J-Fo-S]

Interesting project - would it be possible for you to post the speed for sampling/inference? I.e., real-time or x times faster/slower than real time. Thanks

[unixpickle]

Sampling time for diffusion models depends on the quality you want to achieve. With 50 diffusion steps, sampling on my Titan X at batch size 1 is maybe 2x slower than real time. However, it's likely that 50 steps is much more than necessary for decent audio quality with the right sampling schedule.