Skip to content

Interrupt token generation #187

Closed
Closed

Description

@ivan-pourmir

Hi, thanks for the development of this wonderful and very promising app.

often the LLM generates a lot of tokens that you finally don't want, either after a prompt that was badly formulated or because it is resoning in the wrong direction. That can take a while, waste computing energy and pollute the discussion. Most chat interface have a "stop" button to interrupt it, but I haven't found one in the BTW shiny app.
I think it would be a very convenient addition for every user.

Regards

Activity

  1. gadenbuie commented on Jul 2, 2026

    @gadenbuie
    Collaborator

    This required a few upstream features, but now if you're using ellmer v0.4.1 and shinychat v0.4.0, a cancel button should appear automatically.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions