v153

Changelog

• fcc5ad1 UI: Allow editing of title (#246)
• 305e5a0 improve example config [skip ci]

v152

Changelog

• 04fc673 Improve Activity event handling in the UI (#254)
• 4662cf7 add 'unconfirmed bug' as default label in bug-report.md

v151

Changes:

Pre-loading of models with hooks

• Using hooks.on_startup.preload a set of models can be automatically started on startup.

# hooks: a dictionary of event triggers and actions
# - optional, default: empty dictionary
# - the only supported hook is on_startup
hooks:
  # on_startup: a dictionary of actions to perform on startup
  # - optional, default: empty dictionar
  # - the only supported action is preload
  on_startup:
        # preload: a list of model ids to load on startup
        # - optional, default: empty list
        # - model names must match keys in the models sections
        # - when preloading multiple models at once, define a group
        #   otherwise models will be loaded and swapped out
    preload:
      - "llama"

Prompt Processing Metrics added to Activities page in UI

Changelog

• 5dc6b3e Add barebones but working implementation of model preload (#209, #235)
• 74c69f3 Add prompt processing metrics (#250)
• a186318 Update Readme, Add screenshot for Activities page [skip ci]
• c4e4d5e Update Readme UI Screenshot [skip ci]

v150

Changelog

• 7985e94 add tokens processed to ui models page
• 74556c3 Update bug-report.md [skip ci]
• 5c381e4 Add gofmt linting to ci
• 10569ed Fix model alias usage in upstream path (#230)
• 5b10b3c UI Tweaks (#228)

v149

Changelog

• 45ea792 Fix UI panel not saving position correctly
• 1bc2802 fix panels not saving sizing state
• 701476c Update README.md - remove contributor block [skip ci]
• 5c63e00 return models sorted by id in /v1/models (#222)
• 8be5073 Fix typo (#223) [skip ci]
• 6307bd3 Add support for building Linux ARM64 binary in Makefile (#221)

v148

Changelog

• 558a72d UI Improvements (#219)
• dc42cf3 Add config monitor support for k8s configmap. (#217)
• ba0a819 Update README.md (#216)

v147

Changelog

• 574fdfa UI improvements (#213)
• 5172cb2 Update docs in Readme [skip ci]

v146

Note

This is exactly the same functionality as v145. This release was created to test the new automation of homebrew-llama-swap.

Changelog

• 5672cb0 Update github actions for notifying homebrew build (#212)

v145

Changelog

• 0f58316 add /health (#211)
• 7905fa9 Update trigger-homebrew-update.yml [skip ci]
• bbaf172 add trigger to rebuild homebrew formula (#210)

v144

Changelog

• fd50932 Decouple MetricsMiddleware from downstream handlers (#206)