Add diffusion model configs #770

Job	Run time
Test on ubuntu-latest with Python 3.11	2m 25s
Test on macos-latest with Python 3.11	3m 55s
Test on windows-latest with Python 3.11	3m 40s
	10m 0s

Provide feedback