Chat UI after initial setup in loading

[maxhardt]

UI stuck in this state. Lack of logs/errors.

[maxhardt]

Seems to be related to the /llm request that takes long (~5 minutes) when using CAII as the model provider.

[maxhardt]

Measured wall-block time ~12 minutes in a busy (many CAII models) Cloudera tenant

[jkwatson]

Not sure how we can fix CAII slowness in RAG Studio. Maybe putting hard timeouts on requests?

[jkwatson]

we've recently made some improvements in how we load CAII models. Can you update to the latest and see if it's better for you?