Show host / RAM usage even when GPUs are present #7897
Description
llama.cpp allows for partial offload of model layers to CPU / RAM. It would be great if LocalAI showed RAM usage alongside VRAM usage.
{{ message }}
llama.cpp allows for partial offload of model layers to CPU / RAM. It would be great if LocalAI showed RAM usage alongside VRAM usage.