-
-
Notifications
You must be signed in to change notification settings - Fork 385
Open
Description
I've been configuring my models and I've noticed a few issues.
The first is that the cache type settings in the model configuration do not work at all. When I select for example q8_0, this setting does not get added to the json configuration down below. This is annoying, but I can just configure them manually.
The second problem makes it worse, because part of the configuration gets wiped at least whenever I start Clara and maybe when I enter the advanced settings. This means that the changes I made get reset and the models don't load anymore.... This is the case for at least the --cache-type-k/v and the --n-cpu-moe settings.
I am using the AppImage on Fedora 42 Linux
Metadata
Metadata
Assignees
Labels
No labels