Skip to content

lemonade run use outdated llamacpp binary #1623

@X-Ryl669

Description

@X-Ryl669

Platform

Linux/Arch

Lemonade Version

10.2.0

GPU / APU Model

HX 350

Component

llama.cpp

Bug Description

If I run lemonade serve, I can select Gemma4 model and run them just fine from the web interface.
However, if I do lemonade pull ...Gemma4... && lemonade run ...Gemma4... I get an error that llamacpp doesn't know about gemma4 model.
Looking at the actual version run, it's an outdated version found from ~/.cache/lemonade/.../llamacpp/bin/llamacpp binary.

I've deleted this binary and it's redownloaded at next run leading to the same error as above.
Notice that I've updated the backend beforehand and it works in the Web GUI, it's just the command run that triggers an old version of llamacpp.

Steps to Reproduce

See above

Expected vs Actual Behavior

No response

Log Output

Additional Context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions