Skip to content

The recommended model cannot be clicked #778

Description

@kacperpaczos

The panel works out which model fits the hardware and the selected language, and prints it underneath:

Recommended: Small EN (Vulkan GPU with 30GB RAM; English language selected)

But it is just a label. To apply it I have to hit two separate dropdowns by hand, after first working out that "Small EN" means size Small plus specialization English-only.

What happened to me: I had Medium + Standard multilingual selected, the recommendation said Small EN, and I downloaded 1.5 GB of Medium multilingual. Medium English-only, same weight, was already on disk. I still do not have the recommended Small EN, although I do have Small multilingual.

State afterwards:

Medium multilingual     1.5 GB
Medium English-only     1.5 GB
Small multilingual      488 MB
Tiny                     78 MB

And the panel below says "Unused downloads (3 leftover models)".

Requests:

  • make the recommendation a button that sets size and specialization at once
  • check what is already on disk before sending the user for another model; if something of comparable quality is there, offer it instead of a download
  • the Model Size list could show the weight and the downloaded marker, the way the Specialization list already does

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions