Skip to content

Commit 22b7248

Browse files
mudlergithub-actions[bot]
authored andcommitted
chore(model gallery): 🤖 add new models via gallery agent
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
1 parent c03e532 commit 22b7248

File tree

1 file changed

+29
-0
lines changed

1 file changed

+29
-0
lines changed

gallery/index.yaml

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,33 @@
11
---
2+
- name: "editthinker-8b"
3+
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
4+
urls:
5+
- https://huggingface.co/mradermacher/EditThinker-8B-GGUF
6+
description: |
7+
The model, **EditThinker-8B (quantized version)**, is a large language model designed for tasks like text generation, reasoning, and multi-turn dialogue. It is a compressed version of the original EditThinker-8B model, optimized for efficiency with quantization techniques (e.g., Q4_K_S, Q2_K, etc.). It retains the core capabilities of the original model but is tailored for deployment in resource-constrained environments. The quantized version is suitable for applications requiring reduced memory usage and faster inference. For the original, unquantized model, refer to the official Hugging Face repository.
8+
overrides:
9+
parameters:
10+
model: llama-cpp/models/EditThinker-8B.Q4_K_M.gguf
11+
name: EditThinker-8B-GGUF
12+
backend: llama-cpp
13+
template:
14+
use_tokenizer_template: true
15+
known_usecases:
16+
- chat
17+
function:
18+
grammar:
19+
disable: true
20+
mmproj: llama-cpp/mmproj/EditThinker-8B.mmproj-f16.gguf
21+
description: Imported from https://huggingface.co/mradermacher/EditThinker-8B-GGUF
22+
options:
23+
- use_jinja:true
24+
files:
25+
- filename: llama-cpp/models/EditThinker-8B.Q4_K_M.gguf
26+
sha256: 815a2480340b91200f0d8c3ca3d986bb70d2b6329c9ed9572b98c8bb560ecd57
27+
uri: https://huggingface.co/mradermacher/EditThinker-8B-GGUF/resolve/main/EditThinker-8B.Q4_K_M.gguf
28+
- filename: llama-cpp/mmproj/EditThinker-8B.mmproj-f16.gguf
29+
sha256: c18b616c54f24dd1dec11bcda81bf0f58f49f2776ea4ed77abc5f5e365fbdef8
30+
uri: https://huggingface.co/mradermacher/EditThinker-8B-GGUF/resolve/main/EditThinker-8B.mmproj-f16.gguf
231
- name: "lfm2.5-1.2b-nova-function-calling"
332
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
433
urls:

0 commit comments

Comments
 (0)