Skip to content

Commit 2c6b3b7

Browse files
committed
chore(release): v0.9.0 - SGLang-driven serving hardening + OOM crash guard
Highlights since v0.8.1: - response_format: clean schema-shaped JSON on both streaming and non-streaming, Gemma4 AND Qwen3.6 (first-JSON-value truncation + Eager schema grammar). Fixes silent free-text on non-streaming. - Tool-call grammar enforcement: tool_choice=required/named now structurally fills required params on quantized Gemma4 + Qwen3.6 (kills the empty-parameter infinite-loop defect). Plus a Qwen vocab-padding fix that makes its grammar actually enforce. - Robustness: prompt-size reject cap now guards ALL MLX chat paths (OpenAI + Anthropic, stream + non-stream) so an oversized prompt returns a clean error instead of crashing the whole server via an uncaught Metal OOM. Safer default (16384). - GET /v1/loads JSON observability; multi-entry LPM prefix cache for branching agentic sessions; MLX native decode overlap. - App: memory calculator with model-aware tuning + budget auto-optimize. Verified on Gemma-4-26b-nvfp4 + Qwen3.6-35B-mxfp4 (e2e suite 10/10, 8/8).
1 parent 300b2b6 commit 2c6b3b7

4 files changed

Lines changed: 4 additions & 4 deletions

File tree

Cargo.lock

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

crates/lumen-app/Cargo.toml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
[package]
22
name = "lumen-app"
3-
version = "0.8.1"
3+
version = "0.9.0"
44
edition.workspace = true
55
rust-version.workspace = true
66
license.workspace = true

crates/lumen-app/frontend/package.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
{
22
"name": "lumen-app-frontend",
33
"private": true,
4-
"version": "0.8.1",
4+
"version": "0.9.0",
55
"type": "module",
66
"scripts": {
77
"predev": "cargo build --manifest-path ../../../Cargo.toml -p lumen-server --release",

crates/lumen-app/tauri.conf.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
{
22
"$schema": "https://schema.tauri.app/config/2",
33
"productName": "Lumen",
4-
"version": "0.8.1",
4+
"version": "0.9.0",
55
"identifier": "ai.lumen.app",
66
"build": {
77
"frontendDist": "frontend/dist",

0 commit comments

Comments
 (0)