Skip to content

examples(spin-llm): updates needed? #135

Description

@vdice

As of #132, it is unclear if the spin-llm example requires updates. An attempt was made to test the updated example but the following was encountered:

With the following ai-model structure:

         .spin/ai-models/
         └── sentence-transformers
             └── all-minilm-l6-v2
                 ├── model.safetensors
                 └── tokenizer.json

When handling a request, the app produces this error:

Traceback (most recent call last):
  File "/1/spin_sdk/http/__init__.py", line 86, in handle
  File "/0/app.py", line 6, in handle_request
  File "/1/spin_sdk/llm.py", line 55, in infer
  File "/1/spin_sdk/llm.py", line 45, in infer_with_options
  File "/1/spin_sdk/wit/imports/fermyon_spin_llm_2_0_0.py", line 93, in infer
componentize_py_types.Err: Error_ModelNotSupported()

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions