Search results

Function Calling with Small Language Models using a low-memory-footprint LiteRT-LM (an alternative to llama.cpp)

Status: Open.

#401 In NVIDIA-AI-IOT/jetson-ai-lab;

· shahizat opened on May 22, 2026

FlashRT on Jetson Thor / Orin: realtime inference backend, e.g, Pi0.5 44ms, GROOT N1.6 41–45ms, Orin Pi0.5 INT8 community port

Status: Open.

#400 In NVIDIA-AI-IOT/jetson-ai-lab;

· LiangSu8899 opened on May 21, 2026

vLLM on Jetson Orin fails to load google/gemma-4-E2B-it — Transformers architecture unrecognized / pip constraint blocks upgrade

Status: Open.

#399 In NVIDIA-AI-IOT/jetson-ai-lab;

· jried31 opened on May 18, 2026

Add tutorial: Qwen3.6-27B with MTP (Multi-Token Prediction) on Jetson Thor / AGX Orin for local agentic coding

community-request

enhancementNew feature or requestNew feature or request

tutorial

Status: Open.

#397 In NVIDIA-AI-IOT/jetson-ai-lab;

· tokk-nv opened on May 14, 2026

Add model card: Gemma-4-26B-A4B NVFP4 on Jetson Thor

documentationImprovements or additions to documentationImprovements or additions to documentation

enhancementNew feature or requestNew feature or request

tutorial

Status: Open.

#394 In NVIDIA-AI-IOT/jetson-ai-lab;

· tokk-nv opened on May 7, 2026

Add tutorial: Running Gemma 4 (E2B/E4B/26B-A4B/31B) on Jetson with llama.cpp/Ollama

community-request

enhancementNew feature or requestNew feature or request

tutorial

Status: Open.

#389 In NVIDIA-AI-IOT/jetson-ai-lab;

· tokk-nv opened on May 3, 2026

Guide for building custom vLLM Docker image on Jetson Thor (e.g. vLLM 0.18.x)

Status: Open.

#373 In NVIDIA-AI-IOT/jetson-ai-lab;

· sc-hua opened on Apr 1, 2026

[Bug] MTP speculative decoding fails for Qwen3.5-35B-A3B-NVFP4 with jetson latest vllm docker

Status: Open.

#362 In NVIDIA-AI-IOT/jetson-ai-lab;

· sc-hua opened on Mar 12, 2026

nemotron-3-nano-30b-a3b VLLM container command takes >30min to start up

Status: Open.

#346 In NVIDIA-AI-IOT/jetson-ai-lab;

· tokk-nv opened on Feb 24, 2026

Cosmos-Reason2 on Orin – W4A16 alternative for consideration

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#345 In NVIDIA-AI-IOT/jetson-ai-lab;

· JonnaMat opened on Feb 20, 2026