Skip to content

Commit 51e956f

Browse files
committed
OLS-1622: minor edits
1 parent 75e6039 commit 51e956f

File tree

2 files changed

+15
-14
lines changed

2 files changed

+15
-14
lines changed

Diff for: modules/ols-activating-token-quota-limits.adoc

+12-11
Original file line numberDiff line numberDiff line change
@@ -17,18 +17,20 @@ Modify the `OLSConfigMap` file to activate token quota limits for the {ols-long}
1717
1818
.Procedure
1919

20-
. Open the `OLSConfigMap` file by running the following command:
20+
. Open the {ols-long} `ConfigMap` file by running the following command:
2121
+
2222
[source,terminal]
2323
----
24-
$ oc edit configmap <configmap_name>
24+
$ oc edit configmap <configmap_filename>
2525
----
2626

27-
. Modify the `OLSConfigMap` file.
27+
. Modify the `ConfigMap` file to include token quota limit information.
2828
+
29-
.Example `ServiceMeshControlPlane` cert-manager configuration
29+
.Example {ols-long} `ConfigMap` file
3030
[source,yaml]
3131
----
32+
kind: ConfigMap
33+
apiVersion: v1
3234
quota_handlers:
3335
storage:
3436
host: <IP_address> <1>
@@ -38,14 +40,14 @@ quota_handlers:
3840
password_path: <file_containing_database_password>
3941
ssl_mode: disable
4042
limiters:
41-
- name: user_monthly_limits <2>
43+
- name: user_monthly_limits
4244
type: user_limiter
43-
initial_quota: 100000
45+
initial_quota: 100000 <2>
4446
quota_increase: 10
4547
period: 30 days
46-
- name: cluster_monthly_limits <3>
48+
- name: cluster_monthly_limits
4749
type: cluster_limiter
48-
quota_increase: 1000000
50+
quota_increase: 1000000 <3>
4951
period: 30 days
5052
scheduler:
5153
period: 300 <4>
@@ -55,10 +57,9 @@ quota_handlers:
5557
<3> Increases the token quota limit for the cluster by 100,000 over a period of 30 days.
5658
<4> Defines the number of seconds that the scheduler waits and then checks if the period interval is over. When the period interval is over, the scheduler stores the timestamp and resets or increases the quota limit.
5759

58-
. Apply the `OLSConfigMap` file so that the token limit quota takes effect by running the following command:
60+
. Apply the `ConfigMap` file so that the token limit quota takes effect by running the following command:
5961
+
6062
[source,terminal]
6163
----
6264
$ oc apply -f <configmap_name>
63-
----
64-
65+
----

Diff for: modules/ols-tokens-and-token-quota-limits.adoc

+3-3
Original file line numberDiff line numberDiff line change
@@ -5,8 +5,8 @@
55
[id="ols-tokens-and-token-quota-limits_{context}"]
66
= Tokens and token quota limits
77

8-
Tokens are small chunks of text, which can be as short as one character or as long as one word. Tokens are the units of measurement used to quantify the amount of text that the {ols-long} Service sends to, or receives from, a large language model (LLM) - every interaction with the LLM is counted in tokens.
8+
Tokens are small chunks of text, which can be as small as one character or as large as one word. Tokens are the units of measurement used to quantify the amount of text that the {ols-long} Service sends to, or receives from, a large language model (LLM). Every interaction with the Service and the LLM is counted in tokens.
99

10-
Token quota limits define the number of tokens that can be used in a certain timeframe. Implementing token quota limits helps control costs, encourages more efficient use of queries, and helps regulate system demands. In multi-user configurations, token quota limits can provide equal access to all users ensuring everyone has an opportunity to submit queries.
10+
Token quota limits define the number of tokens that can be used in a certain timeframe. Implementing token quota limits helps control costs, encourage more efficient use of queries, and regulate system demands. In a multi-user configuration, token quota limits help provide equal access to all users ensuring everyone has an opportunity to submit queries.
1111

12-
Token quota limits can be defined for an {ocp-short-name} cluster or for an individual user account.
12+
You can define token quota limits for {ocp-short-name} clusters or {ocp-short-name} user accounts.

0 commit comments

Comments
 (0)