How to build the docker image for llama-swappo ?

[grigio]

or can you publish it on ghcr.io like llama-swap ?

[kooshi]

There's no simple way to build a container with llama-swappo instead of llama-swap. The script that builds containers for the upstream repo downloads the llama-swap releases from that repo instead of building it.

We'd need a new script and dockerfile just for this repo, which would build and package these binaries, plus the llama.cpp binaries like the original does.

This would probably only take an hour or two, but I can't get to it right away. If you happen to tackle it, I'd be happy to accept it as a PR though!

[Awooiel]

I would love a docker image too, it prevents me from running it as all my other llm applications runs in compose.