Skip to content

feat(gallery): add Nemotron 3.5 Lightning 30B - #11477

Open
localai-org-maint-bot wants to merge 1 commit into
masterfrom
cron/model-gallery-20260812
Open

feat(gallery): add Nemotron 3.5 Lightning 30B#11477
localai-org-maint-bot wants to merge 1 commit into
masterfrom
cron/model-gallery-20260812

Conversation

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Summary

  • add NVIDIA Nemotron 3.5 Lightning 30B-A3B using the official ggml-org GGUF repository
  • offer Q4_K_M, NVFP4, and Q8_0 builds through LocalAI gallery variants
  • configure llama.cpp tokenizer templates and tool-parsing fallback
  • record SHA256 values verified against both Hugging Face x-linked-etag headers and LFS object IDs

Validation

  • go test ./core/gallery -ginkgo.focus="gallery/index.yaml variant invariants"
  • git diff --check
  • fresh header/LFS verification for all three GGUF artifacts

The full go test ./core/gallery/... run reached 374 passing specs but remains red on four existing master issues: the Higgs Audio checksum assertion currently addressed by #11476, plus three tests whose external GitHub/Gist requests return HTTP 403 in this environment.

Add the official llama.cpp GGUF builds for NVIDIA Nemotron 3.5 Lightning 30B-A3B, linking Q4_K_M, NVFP4, and Q8_0 as installable variants.

Assisted-by: Codex:gpt-5
@localai-org-maint-bot
localai-org-maint-bot force-pushed the cron/model-gallery-20260812 branch from 6c372c0 to 127aaff Compare August 12, 2026 12:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant