Confirmation
Problem Statement
Add subcomponent of LiteLLM to check for existing proxy and if not present, start it up so LiteLLM works OOTB without user setup
Proposed Solution
Create a LiteLLM subcomponent in this repo and add a config.yaml with all of the current available LLMs. This included Check Point's Azure Open AI models
Scope Boundaries
Don't add more than LiteLLM.
Demo Value
Make it much easier for people running Demo's with random LLMs to do so via LiteLLM
Estimated Complexity
Medium (new module or integration)
Confirmation
Problem Statement
Add subcomponent of LiteLLM to check for existing proxy and if not present, start it up so LiteLLM works OOTB without user setup
Proposed Solution
Create a LiteLLM subcomponent in this repo and add a config.yaml with all of the current available LLMs. This included Check Point's Azure Open AI models
Scope Boundaries
Don't add more than LiteLLM.
Demo Value
Make it much easier for people running Demo's with random LLMs to do so via LiteLLM
Estimated Complexity
Medium (new module or integration)