feature req: Show inference streams for debug purposes #2008
goktug7913
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Sometimes the models i use get into various failure modes, and with some clients i have no way of checking what's going on with the inference.
It would be extremely nice if there was a menu to see what the model is doing, what prompt hit etc. inside from oMLX (web or app UI)
I could probably do a PR for this but not sure if it'd get merged.
Beta Was this translation helpful? Give feedback.
All reactions