Discussions

• 13 You must be logged in to vote

  🙌

  Performance of llama.cpp on AMD ROCm (HIP)

  performance Speed related topics

  olegshulyakov started Aug 1, 2025 in Show and tell

  

  

  

  

  169
• 4 You must be logged in to vote

  🙌

  Performance of llama.cpp on Intel GPU with SYCL backend

  arthw started May 19, 2026 in Show and tell

  

  

  

  

  31
• 37 You must be logged in to vote

  💬

  Performance of llama.cpp with Vulkan

  performance Speed related topics need feedback Testing and feedback with results are needed

  netrunnereve started Dec 18, 2024 in General

  

  

  

  

  735
• 1 You must be logged in to vote

  💡

  Add support for JetBrains/Mellum2-12B-A2.5B-Instruct.

  Smoffyy started Jun 1, 2026 in Ideas

  

  

  0
• 1 You must be logged in to vote

  🙏

  Inconsistent Arguments Between llama-bench and llama-cli / llama-server

  d-shehu asked Jun 1, 2026 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  💬

  IonClaw - The first AI Agent that runs everywhere - iOS, Android, tvOS, watchOS, Desktop, Servers

  paulocoutinhox started Jun 1, 2026 in General

  

  

  3
• 1 You must be logged in to vote

  💬

  ci : discuss optimization strategies

  ggerganov started Mar 12, 2026 in General

  

  

  

  

  74
• 21 You must be logged in to vote

  📣

  llama.app : website + unified llama binary

  ggerganov announced May 29, 2026 in Announcements

  

  

  

  

  13
• 1 You must be logged in to vote

  🙏

  Qualcomm X1 Elite Hexagon llama.cpp on Linux

  MateuszKrawczuk asked May 29, 2026 in Q&A · Unanswered

  

  

  4
• 6 You must be logged in to vote

  💡

  Feature Request: TurboQuant and MTP support

  Bino5150 started May 14, 2026 in Ideas

  

  

  

  

  8
• 3 You must be logged in to vote

  🙌

  Show-and-tell: my advanced-gguf-quantizer tool for NVFP4,MXFP6,Q2,Q3,Q4

  michaelw9999 started May 29, 2026 in Show and tell

  

  

  1
• 2 You must be logged in to vote

  🙌

  "Running llama.cpp with Adreno 830 GPU acceleration on Termux (Snapdragon 8 Elite)"

  paragon83114 started May 26, 2026 in Show and tell

  

  

  2
• 1 You must be logged in to vote

  🙏

  What happened to the detailed starting/loading output?

  segmond asked May 30, 2026 in Q&A · Unanswered

  

  

  

  

  4
• 1 You must be logged in to vote

  🙏

  What is the best configuration for cross-compiling on Android

  ArkaneFans asked Jun 1, 2026 in Q&A · Unanswered

  

  

  0
• 25 You must be logged in to vote

  🙌

  Performance of llama.cpp on Nvidia CUDA

  performance Speed related topics

  olegshulyakov started Aug 1, 2025 in Show and tell

  

  

  

  

  203
• 1 You must be logged in to vote

  💡

  Support dots.mocr, better OCR than dots.ocr (already supported, from same team) with SVG output

  Disonantemus started May 31, 2026 in Ideas

  

  

  0
• 2 You must be logged in to vote

  🙏

  Set max prefill parallelization independent of -np?

  Kangaroux asked May 31, 2026 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙏

  MTP Support in Other Models?

  d-shehu asked May 26, 2026 in Q&A · Unanswered

  

  

  

  

  2
• 1 You must be logged in to vote

  🙏

  Does llama.cpp ACTUALLY support pipeline parallelism?

  marlin-oss asked Mar 8, 2026 in Q&A · Unanswered

  

  

  

  

  8
• 1 You must be logged in to vote

  💬

  @ggerganov @slaren Where are the other Zen DLLs?

  OPS-NeoRetro started May 31, 2026 in General

  

  

  0
• 2 You must be logged in to vote

  💡

  Support for LLMs with image/video output ability is needed.

  SilverJim started May 22, 2026 in Ideas

  

  

  2
• 91 You must be logged in to vote

  🙌

  guide : using llama-ui — the new WebUI of llama.cpp

  ggerganov started Nov 2, 2025 in Show and tell

  

  

  

  

  239
• 2 You must be logged in to vote

  🙏

  llama-server fails when MCP tool returns images.

  Sultan-papagani asked Mar 9, 2026 in Q&A · Unanswered

  

  

  2
• 2 You must be logged in to vote

  🙏

  Is MTP available ? (Especially for GLM 5.1)

  Volko61 asked Apr 17, 2026 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙌

  mcp-schema-normalize - a gateway-side normalizer for the documented json-schema-to-grammar limitations

  rsclafani started May 30, 2026 in Show and tell

  

  

  0