open-webui-cf

Architecture

This example will deploy the popular Open-webui to Cloud Foundry and Tanzu Platform.

You can wire up many GenAI Services/LLMs to open-webui-cf for testing. This is a great tool to test out many different models and provide a tool to provide a local "Chat GPT" style interface.

This is a rather large python application, it may take a few minutes for the cf push to complete.

See Architecture diagram:

Create Service Intance for open-webui-cf

# Create service instance with a chat and an embedding model
cf create-service genai multi-model-plan my-multi-model-service-instance

Deploy

cd ./open-webui-cf  #navigate to open-webui-cf dir
cf push

Contributing

Contributions to this project are welcome. Please ensure to follow the existing coding style and add unit tests for any new or changed functionality.