llama.app : website + unified llama binary

[ggerganov]

Overview

We are launching an official website for llama.cpp: https://llama.app/

The main goal of the website is to provide a simple way for new users to install and run llama.cpp on their machines. The page has an installation command (one-liner) and links/instructions to popular GGUF models on the hub. The current version is a first iteration of many.

During install the cross-platform installer ships a single binary called llama. The binary packs all the user-facing tooling of llama.cpp (i.e. llama-server, llama-cli, etc.) with a single CLI entry point. This is mostly following the git example. Currently we ship binaries for the major operating systems and we plan to iterate and improve the packaging pipeline.

The webpage will also provide helpful instructions for running llama in common use cases: chat, agentic coding, etc. These will be combined with current FOTM models from various quantization providers (e.g. Unsloth, Bartowski, etc.). There will be guidelines for integration with 3rd-party agents, creating or finding the best configuration for your device and tips for utilizing advanced llama.cpp features. We will be iterating on this and would love to hear any feedback from the community on how to improve.

• The contents of the webpage are hosted at https://github.com/ggml-org/llama.pages
• The unified llama app is here: https://github.com/ggml-org/llama.cpp/tree/master/app
• The binaries are built here: https://github.com/ggml-org/llama-install.sh
• The binaries are hosted here: https://huggingface.co/buckets/ggml-org/install.sh

HF Team: @ggml-org/hf

[donohara]

This is terrific! Thanks to everyone who contributes to this great tool !

[MerijnHendriks]

Congrats on the achievement and the launch of the website!

If llama-server can remain to exist as a single binary and function independently of the llama binary, then I have no complaints.

[ggerganov]

Yes, llama-server remains as is. Simply put, llama serve and llama-server are the same thing. Also llama cli and llama-cli, etc. Same idea as git commit and git-commit.

[Jipok]

When choosing a model, the size is missing. In my opinion, it would be better to either remove selector and leave the links to the HG, or add a size indication.

[cphlipot]

Aside from the size, i think we could also try to select more sensible defaults. It seems right now we just select whatever the first one in the list is, which seems to result in either selecting the largest or smallest quant depending on the provider, neither of which is probably what the user is most likely to want:

[cphlipot]

This looks like a great step forward in terms of usability.

I was wondering with the CLI, are there any plans to adjust arugments for better UX, or is the aim to just simply expose existing tools as subcommand with all existing arguments left exactly as-is?

[aviallon]

Missed opportunity to register llama.cpp

[Kangaroux]

Site looks good, two critiques:

1. Add a brief callout to what llama.cpp is in the hero. If I stumble on the site the first thing I see is a "C++" logo
2. Nit: would be nice if someone with image editing tools could clean up the llama image to fix the perspective on the computer case https://llama.app/local-ai.png

[allozaur]

hey, thank you for the feebdack :) improvements are coming

[h8f1z]

Congrats 👏 🎉

[luck-tar-gz]

Congrats! I saw a little inconsistency though:

While Qwen's, Gemma's and Step's model tags show "XB MoE · YB active", GPT-OSS's model tag does not show that, making it sound more like the Qwen3.6-27B dense model. Converting it to show that it is MoE would be more accurate.

Great work as always!

[julien-c]

do you want to open a quick PR on https://github.com/ggml-org/llama.pages maybe?

[luck-tar-gz]

Yeah, should be there now.