LiteLLM integration in Prism

[agilan-selvam-zoomrx]

Hi Everyone,

We have Litellm as gateway for all the llm providers in our organization. Does Prism supports Litellm? If yes, Can someone shed light on how to configure prism for LiteLLM?

Thanks in advance.

[agilan-selvam-zoomrx]

Am getting "OpenAI: unknown finish reason" error when i try to call the models via litellm using prism.

[agilan-selvam-zoomrx]

This is how I have implemented it.

$response = Prism::text() ->using(Provider::OpenAI, $model) ->usingProviderConfig([ 'url' => env('LITE_LLM_API_BASE'), 'api_key' => env('LITE_LLM_API_KEY'), ]) ->withPrompt('Hello! Can you respond with a simple greeting?') ->asText();