device_map="auto"
#14704
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
{{ message }}
-
Is it possible to run Stable Diffusion in webui using device_map="auto" ?
https://huggingface.co/docs/accelerate/main/en/concept_guides/big_model_inference#the-devicemap
I can run Mistral with this feature and it splits the model into parts so I can use longer inputs, but not sure if it works here.
Beta Was this translation helpful? Give feedback.
All reactions