Commit 67f7d89
committed
feat: make inference provider optional
Inference provider implementations behave inconsistently—some can load
normally without an API key (even though it’s required for proper
functionality), while others simply fail. To ensure consistency, we
should handle inference providers the same way we do vector I/O
providers: treat most of them as optional, with vLLM being the
exception.
Relates to: RHAIENG-1178
Signed-off-by: Sébastien Han <seb@redhat.com>1 parent f222f3b commit 67f7d89
1 file changed
+2
-2
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
20 | 20 | | |
21 | 21 | | |
22 | 22 | | |
23 | | - | |
| 23 | + | |
24 | 24 | | |
25 | 25 | | |
26 | 26 | | |
| |||
36 | 36 | | |
37 | 37 | | |
38 | 38 | | |
39 | | - | |
| 39 | + | |
40 | 40 | | |
41 | 41 | | |
42 | 42 | | |
| |||
0 commit comments