-
-
Notifications
You must be signed in to change notification settings - Fork 3.4k
Open
Labels
bugSomething isn't workingSomething isn't workinggood first issueGood for newcomersGood for newcomersroadmap
Description
Starting with an empty models/ and a fresh restart of the LocalAI server:
> ls models
> curl http://localhost:8080/models/apply -H "Content-Type: application/json" -d '{
"url": "github:go-skynet/model-gallery/base.yaml",
"name": "llama2-chat",
"files": [
{
"uri": "https://huggingface.co/TheBloke/Llama-2-13B-chat-GGUF/resolve/main/llama-2-13b-chat.Q4_K_S.gguf",
"sha256": "106d3b9c0a8e24217f588f2af44fce95ec8906c1ea92ca9391147ba29cc4d2a4",
"filename": "llama-2-13b-chat.Q4_K_S.gguf"
}
]
}'
# ...
> curl http://localhost:8080/models
{"object":"list","data":[{"id":"llama2-chat","object":"model"},{"id":"llama-2-13b-chat.Q4_K_S.gguf","object":"model"}]}
> ls models
chat.tmpl completion.tmpl llama-2-13b-chat.Q4_K_S.gguf llama2-chat.yamlIt seems the GGUF extension is not being filtered out by the listing models endpoint. It should be filtered out, I think only the files ending in .yaml should show up.
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't workinggood first issueGood for newcomersGood for newcomersroadmap