Skip to content

Ability to Incorporate Open Source Embeddings for Router to Remove OpenAI dependency #62

Description

@madison-evans

As the title suggests, I want to be able to utilize an open source embedding model from huggingface such that I don't require openAI or any other api driven embedding model for the actual routing done in mf routing. I'm able to dig into the source code in the routellm package and accomplish this by modifying the matrix_factorization.model.py file as well as controller.py and routers.py, but it would be great if this option was already available

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions