Skip to content

Commit d63483a

Browse files
authored
Bump llama.cpp to 0d18aaa9d, release v0.8.14 (#44)
Update vendored llama.cpp from b22ff4b7b to 0d18aaa9d (52 commits). No public API changes affect the NIF; build and tests pass unchanged.
1 parent bdc3f96 commit d63483a

3 files changed

Lines changed: 29 additions & 2 deletions

File tree

CHANGELOG.md

Lines changed: 27 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,32 @@
11
# Changelog
22

3+
## v0.8.14
4+
5+
### Changed
6+
7+
- **llama.cpp submodule** — Updated from b22ff4b7b to 0d18aaa9d (52 commits). No public API changes; the only `include/llama.h` diff is a doc comment on `LLAMA_STATE_SEQ_FLAGS_ON_DEVICE` clarifying that getting a per-seq state with the flag invalidates prior on-device states for the same `seq_id`. `common/common.h` replaces `checkpoint_every_nt` with `checkpoint_min_step` (server-only field) and drops the `LLAMA_UI_DEFAULT_ENABLED` ifdef (UI still defaults to `true`); `common/chat.h` adds additive `common_chat_msg_span`/`common_chat_msg_delimiter` structs, a `message_spans` field on `common_chat_params`, an `is_continuation` field on `common_chat_parser_params`, and a new `common_chat_split_by_role` helper. None of these are used by the NIF, so no binding changes were required.
8+
- **llama**: document that only one on-device state can be saved per sequence (#23520).
9+
- **server**: fix checkpoints creation (#22929); MTP layer kv-cache should respect draft type ctk (#23646); expose prompt token counts in `/slots` (carried from v0.8.13 lineage); add margin for draft model for `fit` (#23485).
10+
- **convert**: support `Gemma4ForCausalLM` (#23682); add compressed-tensors NVFP4 support (#21095); minor fixes for numpy 2.x (#23571).
11+
- **model**: add support for `talkie-1930-13b` (#22596); tag `ffn_latent` as `MUL_MAT` to fix buft probe (#23664); attach Mistral3 NVFP4 weight scales (#23629).
12+
- **vocab**: fix `HybridDNA` tokenizer (#23466) (carried).
13+
- **ggml**: bump to 0.13.0 (ggml/1510) and 0.12.1 (ggml/1508); `gguf_init_from_callback` and `gguf_init_from_buffer` (#22341); parallelize quant LUT init (#23595); ggml-alloc out-of-bounds read fix in `ggml_dyn_tallocr_remove_block` (ggml/1492); TP fix ggml context size calculation (#22616); `ggml_silu_back` docstring fix (ggml/1500).
14+
- **metal**: add apple device id (#23566).
15+
- **CUDA**: add fast Walsh–Hadamard transform (#23615); missing PDL sync for FWHT + better fallback (#23690).
16+
- **vulkan**: optimize `conv2d` and implement `coopmat1` support (#22620).
17+
- **SYCL**: implement `ggml_sycl_pool_vmm` (#22862).
18+
- **hexagon**: add `CONCAT` op (#23648); flash-attn softmax repl optimization (#23455).
19+
- **ggml-webgpu**: add MMVQ path for Q4/Q8/Q2_K/Q4_K and clean up legacy `MUL_MAT` pipeline (#23594); check `batch_compute_passes` before sending passes when not GPU profiling (#23457).
20+
- **opencl**: batch profiling to improve speed and prevent memory leaks (#23495).
21+
- **perplexity**: fix even more integer overflows (#23623).
22+
- **TP**: fix entirely zero-sized slices per device (#23525).
23+
- **ui**: fix stop/continue during an agentic loop (#23356); media attachments before text (#23467).
24+
- **vendor**: update `cpp-httplib` to 0.45.1 (#23639).
25+
- **snapdragon**: bump toolchain docker to v0.7 to fix UI build issues (#23680); update windows toolchain to use `hsdk` v6.6.0.0 (#23552).
26+
- **cmake**: fix UI build (#23592).
27+
- **tests**: `test-backend-ops -j <N>` to run tests in parallel (#23637).
28+
- **CI**: many self-hosted runner migrations, `[no release]` keyword support, and macOS/apple workflow consolidation (#23705, #23713, #23715, #23718, #23721, #23728, #23730, #23734, #23619, #23616, #23675, #23642, #23651, #23630).
29+
330
## v0.8.13
431

532
### Changed

mix.exs

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -37,7 +37,7 @@ end
3737
defmodule LlamaCppEx.MixProject do
3838
use Mix.Project
3939

40-
@version "0.8.13"
40+
@version "0.8.14"
4141
@source_url "https://github.com/nyo16/llama_cpp_ex"
4242

4343
def project do

vendor/llama.cpp

Submodule llama.cpp updated 141 files

0 commit comments

Comments
 (0)