Can I run this on my 6GB VRAM RTHX 3060 laptop gpu? #7
Description
I get an error after pulling and loading the model (llama 8B). It says ready but then given a prompt it fails immediately.
{{ message }}
I get an error after pulling and loading the model (llama 8B). It says ready but then given a prompt it fails immediately.