Describe the feature
Introduce a new CLI command to fetch the Model information that Semantic Router Contains:
Models are the heart of the Semantic Router, it is good to have a new CLI command that describe the different types of models that Semantic Router currently supported/configured, this will increase the UX, otherwise the User have to surf the dashboard to see different types of model that are present for serving.
vllm-sr model list # Show provider models + model cards from config
Primary layer
unsure
Why this layer?
No response
Why do you need this feature?
To increase the User-Experience
Additional context
No response
Describe the feature
Introduce a new CLI command to fetch the Model information that Semantic Router Contains:
Models are the heart of the Semantic Router, it is good to have a new CLI command that describe the different types of models that Semantic Router currently supported/configured, this will increase the UX, otherwise the User have to surf the dashboard to see different types of model that are present for serving.
vllm-sr model list # Show provider models + model cards from config
Primary layer
unsure
Why this layer?
No response
Why do you need this feature?
To increase the User-Experience
Additional context
No response