Skip to content

Modified LiteLLM nlp class to optionally accept Provider URL for self hosted LLMs#517

Open
chibexme wants to merge 23 commits into
emcie-co:developfrom
chibexme:develop
Open

Modified LiteLLM nlp class to optionally accept Provider URL for self hosted LLMs#517
chibexme wants to merge 23 commits into
emcie-co:developfrom
chibexme:develop

Conversation

@chibexme
Copy link
Copy Markdown
Contributor

No description provided.

chibexme and others added 23 commits March 4, 2025 17:44
Signed-off-by: Chibuike Mba <chibexme@yahoo.com>
Signed-off-by: Chibuike Mba <chibexme@yahoo.com>
Signed-off-by: Chibuike Mba <chibexme@yahoo.com>
Signed-off-by: Chibuike Mba <chibexme@yahoo.com>
Signed-off-by: Chibuike Mba <chibexme@yahoo.com>
Signed-off-by: Chibuike Mba <chibexme@yahoo.com>
Signed-off-by: Chibuike Mba <chibexme@yahoo.com>
Signed-off-by: Chibuike Mba <chibexme@yahoo.com>
Signed-off-by: Chibuike Mba <chibexme@yahoo.com>
Signed-off-by: Chibuike Mba <chibexme@yahoo.com>
Signed-off-by: Chibuike Mba <chibexme@yahoo.com>
Signed-off-by: Chibuike Mba <chibexme@yahoo.com>
…velop

Signed-off-by: Chibuike Mba <chibexme@yahoo.com>
Signed-off-by: Chibuike Mba <chibexme@yahoo.com>
Signed-off-by: Chibuike Mba <chibexme@yahoo.com>
Signed-off-by: Chibuike Mba <chibexme@yahoo.com>
Signed-off-by: Chibuike Mba <chibexme@yahoo.com>
Signed-off-by: kichanyurd <160174509+kichanyurd@users.noreply.github.com>
I, Chibuike Mba <chibexme@yahoo.com>, hereby add my Signed-off-by to this commit: 365e57f
I, Chibuike Mba <chibexme@yahoo.com>, hereby add my Signed-off-by to this commit: e98f957

Signed-off-by: Chibuike Mba <chibexme@yahoo.com>
@iwr-redmond
Copy link
Copy Markdown

iwr-redmond commented Aug 27, 2025

According to the documentation, there are three standard fields for completions and embeddings:

  • model
  • api_key
  • api_base

In the absence of the api_base parameter, a LiteLLM proxy server appears to be required when addressing a locally hosted model.

@chibexme, it would be helpful to extend this PR to allow for the selection of two models, an LLM and an embedding model.

cc @Agam1997

@chibexme
Copy link
Copy Markdown
Contributor Author

@iwr-redmond Thanks for your observation, I will work on it.

@kichanyurd
Copy link
Copy Markdown
Contributor

@chibexme Hey mate, please LMK when the changes are made and this is ready to go as far as you can see. No pressure, though.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants