You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: modules/ols-creating-lightspeed-custom-resource-file-using-cli.adoc
+8-6
Original file line number
Diff line number
Diff line change
@@ -53,19 +53,20 @@ spec:
53
53
llm:
54
54
providers:
55
55
- credentialsSecretRef:
56
-
name: openai-api-keys
56
+
name: rhelai-api-keys <1>
57
57
models:
58
58
- name: models/<model_name>
59
59
name: rhelai
60
60
type: rhelai_vllm
61
-
url: <URL> <1>
61
+
url: <URL> <2>
62
62
ols:
63
63
defaultProvider: rhelai
64
64
defaultModel: models/<model_name>
65
65
additionalCAConfigMapRef:
66
66
name: openshift-service-ca.crt
67
67
----
68
-
<1> The URL endpoint must end with `v1` to be valid. For example, `\https://http://3.23.103.8:8000/v1`.
68
+
<1> By default the OpenAI API requires a token as part of the request. If your {rhelai} configuration does not require a token you must set the token value to any valid string for the request to authenticate.
69
+
<2> The URL endpoint must end with `v1` to be valid. For example, `\https://http://3.23.103.8:8000/v1`.
69
70
+
70
71
.{rhoai} CR file
71
72
[source,yaml,subs="attributes,verbatim"]
@@ -78,17 +79,18 @@ spec:
78
79
llm:
79
80
providers:
80
81
- credentialsSecretRef:
81
-
name: openai-api-keys
82
+
name: rhoai-api-keys <1>
82
83
models:
83
84
- name: <model_name>
84
85
name: red_hat_openshift_ai
85
86
type: rhoai_vllm
86
-
url: <url> <1>
87
+
url: <url> <2>
87
88
ols:
88
89
defaultProvider: red_hat_openshift_ai
89
90
defaultModel: <model_name>
90
91
----
91
-
<1> The URL endpoint must end with `v1` to be valid. For example, `\https://<model_name>.<domain_name>.com:443/v1`.
92
+
<1> By default the OpenAI API requires a token as part of the request. If your {rhoai} configuration does not require a token you must set the token value to any valid string for the request to authenticate.
93
+
<2> The URL endpoint must end with `v1` to be valid. For example, `\https://<model_name>.<domain_name>.com:443/v1`.
Copy file name to clipboardExpand all lines: modules/ols-creating-lightspeed-custom-resource-file-using-web-console.adoc
+8-6
Original file line number
Diff line number
Diff line change
@@ -55,17 +55,18 @@ spec:
55
55
llm:
56
56
providers:
57
57
- credentialsSecretRef:
58
-
name: openai-api-keys
58
+
name: rhelai-api-keys <1>
59
59
models:
60
60
- name: models/<model_name>
61
61
name: rhelai
62
62
type: rhelai_vllm
63
-
url: <URL> <1>
63
+
url: <URL> <2>
64
64
ols:
65
65
defaultProvider: rhelai
66
66
defaultModel: models/<model_name>
67
67
----
68
-
<1> The URL endpoint must end with `v1` to be valid. For example, `\https://http://3.23.103.8:8000/v1`.
68
+
<1> By default the OpenAI API requires a token as part of the request. If your {rhelai} configuration does not require a token you must set the token value to any valid string for the request to authenticate.
69
+
<2> The URL endpoint must end with `v1` to be valid. For example, `\https://http://3.23.103.8:8000/v1`.
69
70
+
70
71
.{rhoai} CR file
71
72
[source,yaml,subs="attributes,verbatim"]
@@ -78,17 +79,18 @@ spec:
78
79
llm:
79
80
providers:
80
81
- credentialsSecretRef:
81
-
name: openai-api-keys
82
+
name: rhoai-api-keys <1>
82
83
models:
83
84
- name: <model_name>
84
85
name: red_hat_openshift_ai
85
86
type: rhoai_vllm
86
-
url: <url> <1>
87
+
url: <url> <2>
87
88
ols:
88
89
defaultProvider: red_hat_openshift_ai
89
90
defaultModel: <model_name>
90
91
----
91
-
<1> The URL endpoint must end with `v1` to be valid. For example, `\https://<model_name>.<domain_name>.com:443/v1`.
92
+
<1> By default the OpenAI API requires a token as part of the request. If your {rhoai} configuration does not require a token you must set the token value to any valid string for the request to authenticate.
93
+
<2> The URL endpoint must end with `v1` to be valid. For example, `\https://<model_name>.<domain_name>.com:443/v1`.
0 commit comments