Skip to content

Commit 5d4f1b4

Browse files
committed
OLS-1561: OLS Requires Secret Even When RHOAI Does Not
1 parent 48e2b1c commit 5d4f1b4

2 files changed

+16
-12
lines changed

Diff for: modules/ols-creating-lightspeed-custom-resource-file-using-cli.adoc

+8-6
Original file line numberDiff line numberDiff line change
@@ -53,19 +53,20 @@ spec:
5353
llm:
5454
providers:
5555
- credentialsSecretRef:
56-
name: openai-api-keys
56+
name: rhelai-api-keys <1>
5757
models:
5858
- name: models/<model_name>
5959
name: rhelai
6060
type: rhelai_vllm
61-
url: <URL> <1>
61+
url: <URL> <2>
6262
ols:
6363
defaultProvider: rhelai
6464
defaultModel: models/<model_name>
6565
additionalCAConfigMapRef:
6666
name: openshift-service-ca.crt
6767
----
68-
<1> The URL endpoint must end with `v1` to be valid. For example, `\https://http://3.23.103.8:8000/v1`.
68+
<1> By default the OpenAI API requires a token as part of the request. If your {rhelai} configuration does not require a token you must set the token value to any valid string for the request to authenticate.
69+
<2> The URL endpoint must end with `v1` to be valid. For example, `\https://http://3.23.103.8:8000/v1`.
6970
+
7071
.{rhoai} CR file
7172
[source,yaml,subs="attributes,verbatim"]
@@ -78,17 +79,18 @@ spec:
7879
llm:
7980
providers:
8081
- credentialsSecretRef:
81-
name: openai-api-keys
82+
name: rhoai-api-keys <1>
8283
models:
8384
- name: <model_name>
8485
name: red_hat_openshift_ai
8586
type: rhoai_vllm
86-
url: <url> <1>
87+
url: <url> <2>
8788
ols:
8889
defaultProvider: red_hat_openshift_ai
8990
defaultModel: <model_name>
9091
----
91-
<1> The URL endpoint must end with `v1` to be valid. For example, `\https://<model_name>.<domain_name>.com:443/v1`.
92+
<1> By default the OpenAI API requires a token as part of the request. If your {rhoai} configuration does not require a token you must set the token value to any valid string for the request to authenticate.
93+
<2> The URL endpoint must end with `v1` to be valid. For example, `\https://<model_name>.<domain_name>.com:443/v1`.
9294
+
9395
.{azure-openai} CR file
9496
[source,yaml,subs="attributes,verbatim"]

Diff for: modules/ols-creating-lightspeed-custom-resource-file-using-web-console.adoc

+8-6
Original file line numberDiff line numberDiff line change
@@ -55,17 +55,18 @@ spec:
5555
llm:
5656
providers:
5757
- credentialsSecretRef:
58-
name: openai-api-keys
58+
name: rhelai-api-keys <1>
5959
models:
6060
- name: models/<model_name>
6161
name: rhelai
6262
type: rhelai_vllm
63-
url: <URL> <1>
63+
url: <URL> <2>
6464
ols:
6565
defaultProvider: rhelai
6666
defaultModel: models/<model_name>
6767
----
68-
<1> The URL endpoint must end with `v1` to be valid. For example, `\https://http://3.23.103.8:8000/v1`.
68+
<1> By default the OpenAI API requires a token as part of the request. If your {rhelai} configuration does not require a token you must set the token value to any valid string for the request to authenticate.
69+
<2> The URL endpoint must end with `v1` to be valid. For example, `\https://http://3.23.103.8:8000/v1`.
6970
+
7071
.{rhoai} CR file
7172
[source,yaml,subs="attributes,verbatim"]
@@ -78,17 +79,18 @@ spec:
7879
llm:
7980
providers:
8081
- credentialsSecretRef:
81-
name: openai-api-keys
82+
name: rhoai-api-keys <1>
8283
models:
8384
- name: <model_name>
8485
name: red_hat_openshift_ai
8586
type: rhoai_vllm
86-
url: <url> <1>
87+
url: <url> <2>
8788
ols:
8889
defaultProvider: red_hat_openshift_ai
8990
defaultModel: <model_name>
9091
----
91-
<1> The URL endpoint must end with `v1` to be valid. For example, `\https://<model_name>.<domain_name>.com:443/v1`.
92+
<1> By default the OpenAI API requires a token as part of the request. If your {rhoai} configuration does not require a token you must set the token value to any valid string for the request to authenticate.
93+
<2> The URL endpoint must end with `v1` to be valid. For example, `\https://<model_name>.<domain_name>.com:443/v1`.
9294
+
9395
.{azure-openai} CR file
9496
[source,yaml,subs="attributes,verbatim"]

0 commit comments

Comments
 (0)