How can I expose all my models to lemonade? #1473
Unanswered
namecaps3k
asked this question in
Q&A
Replies: 2 comments
-
|
It should discover all of your models in that directory. You would need to share your directory structure to get help with this. |
Beta Was this translation helpful? Give feedback.
0 replies
-
I just have 17 gguf models and few mmproj in that folder, all together without any subfolders |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi,
I'm trying to expose my gguf models directory to lemonade but to no avail.
I set
LEMONADE_EXTRA_MODELS_DIR=/media/hugginface/
Directory contains lots of models which I use with llama everyday but somehow lemonade only sees one model there:
72 [Info] (ModelManager) Building models cache...
73 [Info] (ModelManager) Scanning for GGUF models in: /media/hugginface/
73 [Info] (ModelManager) Discovered 1 models from extra directory
67 [Info] (ModelManager) Cache built: 106 total, 0 downloaded
ai@ai:~$ find /media/hugginface/ -name *.gguf | wc -l
17
Beta Was this translation helpful? Give feedback.
All reactions