Platform
Windows
Lemonade Version
10.2.0
GPU / APU Model
Strix Halo 395+ 128GB
Component
Desktop App / UI
Bug Description
Changing the settings in the "Model Options" panel in the Web UI has no effect unless you click "Load".
Otherwise, any modifications are silently ignored.
Steps to Reproduce
Click the settings cog to show the "Model Options" panel -> Modify the context size -> Close the window
Observe: The context change is silently ignored.
Click the settings cog -> Modify the context size -> Click load
Observe: The context change sticks
Expected vs Actual Behavior
Expected: Changes in the "Model Options" panel should not be silently ignored
Actual: Changes in the "Model Options" panel are silently ignored
Log Output
Additional Context
It would be great to either have an explicit "Save changes" button, or to have the settings save when the window is closed.
This is a confusing one - I mass-changed a bunch of context sizes in a row, ran some benchmarks overnight, and only realized once they were done that none of the changes stuck.
Changing them and having the settings stick was a painfully slow process: I had to load each model in turn.
Platform
Windows
Lemonade Version
10.2.0
GPU / APU Model
Strix Halo 395+ 128GB
Component
Desktop App / UI
Bug Description
Changing the settings in the "Model Options" panel in the Web UI has no effect unless you click "Load".
Otherwise, any modifications are silently ignored.
Steps to Reproduce
Click the settings cog to show the "Model Options" panel -> Modify the context size -> Close the window
Observe: The context change is silently ignored.
Click the settings cog -> Modify the context size -> Click load
Observe: The context change sticks
Expected vs Actual Behavior
Expected: Changes in the "Model Options" panel should not be silently ignored
Actual: Changes in the "Model Options" panel are silently ignored
Log Output
Additional Context
It would be great to either have an explicit "Save changes" button, or to have the settings save when the window is closed.
This is a confusing one - I mass-changed a bunch of context sizes in a row, ran some benchmarks overnight, and only realized once they were done that none of the changes stuck.
Changing them and having the settings stick was a painfully slow process: I had to load each model in turn.