Skip to content

Commit 65950ef

Browse files
authored
Bump llama.cpp to 52fb93a2b (30 commits) (#42)
No public API changes — NIF and LlamaCppEx.MTP bindings continue to work unchanged. Headlines: backend sampling for MTP draft path (#23287, additive `backend_sampling` default-on), MTP logit-skip optimization (#23433), nullptr crash fix in common_speculative (#23386), server slot sleep VRAM leak fix (#23461). Plus assorted mtmd, server unified-binary, vulkan/cuda/metal kernel improvements. See CHANGELOG.md for the full breakdown.
1 parent ee02bdc commit 65950ef

2 files changed

Lines changed: 20 additions & 1 deletion

File tree

CHANGELOG.md

Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,25 @@
22

33
## Unreleased
44

5+
### Changed
6+
7+
- **llama.cpp submodule** — Updated from b28a2f372 to 52fb93a2b (30 commits). No public API changes; existing NIF and `LlamaCppEx.MTP` bindings continue to work unchanged.
8+
- **MTP / speculative**: move draft sampling to the backend (`backend_sampling` defaults `true` on the new `common_params_speculative_draft` field — additive) (#23287); skip logit computation via `inp_out_ids` (#23433); fix `nullptr` crash in `common_speculative_get_devices_str` (#23386); free draft/MTP resources on server slot sleep to fix a VRAM leak (#23461); doc typo (#23435).
9+
- **llama**: fix `llm_graph_input_attn_kv_iswa` null-buffer crash on SWA-only models (#23131).
10+
- **vocab**: add Carbon-3B `HybridDNATokenizer` support (#23410).
11+
- **server**: re-inject subcommand when the router spawns children under the unified binary (#23442).
12+
- **app**: introduce the `llama` unified executable (#23296); add `batched-bench`, `fit-params`, `quantize`, and `perplexity` subcommands (#23459); show version (#23426).
13+
- **mtmd**: merge HunyuanOCR into HunyuanVL and fix OCR vision precision (#23329); DeepSeek-OCR image-processing fixes + `img_tool::resize` padding refactor (#23345); `fit_params` now accounts for `mmproj` (#21489); WAV MIME-type variants and improved audio format detection (#23396).
14+
- **ggml**: check the right iface method before falling back to the 2D get (#23306).
15+
- **metal**: optimize `pad` + `cpy` (#23354).
16+
- **CUDA**: Programmatic Dependent Launch (PDL) for Hopper+ (#22522); tune RDNA3 Q6_K MMVQ nwarps (#23349).
17+
- **vulkan**: optimize `IM2COL` shader (#22685).
18+
- **opencl**: refactor backend initialization (#23318).
19+
- **hexagon**: `ssm-conv` fix for large prompts (#23307); HMX quantized matmul rework (#23368).
20+
- **snapdragon**: update toolchain to v0.6 (#23369).
21+
- **webui**: max image size option (#22849); reactive `isMobile` in viewport store (#23330); div-wrapper pointer-events fix on hidden (#23390); move text attachments before message content in chat-completions payload (#23406); improve UI dev git hooks (#23403).
22+
- **docker**: copy conversion files (#23370).
23+
524
## v0.8.11
625

726
### Changed

vendor/llama.cpp

Submodule llama.cpp updated 151 files

0 commit comments

Comments
 (0)