Skip to content

Revisit llama router mode when Lima Fedora template is new enough (44) #5

@eshlox

Description

@eshlox

Fedora 43 installs llama-cpp-b5904-2.fc43, which lacks llama-server --models-dir. The source-build was too heavy and failed on aarch64. Future task is to retest when Lima template:fedora moves to Fedora 44/newer and only enable router mode if packaged llama-cpp supports it.

lima-vm/lima#4905

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions