Request: SDCPP/GGML implementation

[FizzleDorf]

I'd like to request an implementation in the sdcpp repository. this would help make binary distributions of diffusion software more viable rather than users struggling to maintain python environments. This would also make ggml quants easier to make rather than hacking together parts of ggml.

[Lakonik]

Thanks for the suggestion. I don't think implementing the cpp version in our pure python repo would be a good idea. Would be better to submit a PR to the sdcpp repo so that pi-Flow is supported there (unfortunately I don't think I have the extra time for that).

[zwukong]

sdcpp不支持gguf q4以下的量化，不知为为什么设置这个门槛，明明都支持了gguf

[FizzleDorf]

Thanks for the suggestion. I don't think implementing the cpp version in our pure python repo would be a good idea. Would be better to submit a PR to the sdcpp repo so that pi-Flow is supported there (unfortunately I don't think I have the extra time for that).

that is unfortunate. memory and storage are becoming more expensive for the next two years so it's becoming critical that memory and space optimizations of software needs to be implemented to support legacy hardware and lower the impact on space and memory in general. python hasn't been very good with respecting consumer hardware or people's time since users have to manage the deps themselves or pytorch makes it hard to use non-nvidia gpus. it's too bad llms still aren't great at low level programming otherwise this would have been something I could put out myself in a timely manner. good luck on your future endeavors

sdcpp不支持gguf q4以下的量化，不知为为什么设置这个门槛，明明都支持了gguf

it actually does support lower than q4. I'm not sure where this claim came from. it actually has more lower quant options than the conversion python scripts.

[zwukong]

因为你我特意去看了那个项目，挺有意思的，一个命令就能执行，比comfyui还方便。可惜兼容性不大好。D:\a\stable-diffusion.cpp\stable-diffusion.cpp\ggml\src\ggml-cuda\getrows.cu:204: ggml_cuda_get_rows_switch_src0_type: unsupported src0 type: q3_K leejet/stable-diffusion.cpp#963