Skip to content

Gguf support in packaging #10

Description

@TylerWilsonHC-SC

Loading embeddings from a .gguf file requires llama-cpp and only works in a docker environment. This works when using faiss-search as the main repo but does not work when calling faiss-search as an import from another repo.

One fix could be to have docker integrated into the packaging to support this.
Another workaround could be to setup the dockerfile of the library it's being imported into so that it knows to grab llama-cpp if it sees faiss-search as an import.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions