You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: examples/knowledge-tuning/00_Setup/00_Setup_README.md
+8-8Lines changed: 8 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -20,23 +20,23 @@ To use the Knowledge Tuning example, follow these steps to set up your working e
20
20
3.[Create a workbench](#create-a-workbench)
21
21
4.[Clone the example Git repository](#clone-the-example-git-repository)
22
22
23
-
For this example, you create an OpenShift project and a workbench. From the workench, you launch an JupyterLab integrated development environment. In JupyterLab, you run the provided notebooks that guide you through the example data processing, knowledge generation and mixing, model training, and evaluation workflow.
23
+
For this example, you create an OpenShift project and a workbench. From the workench, you launch a JupyterLab integrated development environment. In JupyterLab, you run the provided notebooks that guide you through the Knowledge Tuning example end-to-end workflow.
24
24
25
25
## Configure resources on the OpenShift cluster
26
26
27
27
The notebooks provided in the Knowledge Tuning example require the following resources:
28
28
29
-
-**GPUs:** GPUs are optional for the preprocessing and mixing steps. For the model training step, fine-tuning large models requires at least one NVIDIA A100/40GB or similar. Training smaller student models requires 8–16 GB GPU.
29
+
-**GPUs:** GPUs are optional for the data processing and mixing steps. For the model training step, fine-tuning large models requires at least one NVIDIA A100/40GB or similar. Training smaller student models requires 8–16 GB GPU.
30
30
31
31
-**Persistent Volumes:** Attach a persistent volume with at least 200 GB.
32
32
33
-
To run all of the notebooks in the Knowledge Training example, you must ensure that the following resources are configured on the OpenShift cluster:
33
+
To run all of the notebooks in the Knowledge Tuning example, you must ensure that the following resources are configured on the OpenShift cluster:
34
34
35
35
- Your Red Hat OpenShift cluster administrator must configure the following resources:
36
36
37
37
- A persistent volume with a storage capacity of 200 GB or greater.
38
38
39
-
-Installed and enabled a NVIDIA GPU as described in [Enabling accelerators]https://docs.redhat.com/en/documentation/red_hat_openshift_ai_self-managed/3.0/html/working_with_accelerators/enabling-accelerators_accelerators.
39
+
-An NVIDIA GPU that is installed and enabled, as described in [Enabling accelerators](https://docs.redhat.com/en/documentation/red_hat_openshift_ai_self-managed/3.0/html/working_with_accelerators/enabling-accelerators_accelerators).
40
40
41
41
- An OpenShift AI administrator must create a hardware profile that allocates the following resources, as described in [Creating a hardware profile](https://docs.redhat.com/en/documentation/red_hat_openshift_ai_self-managed/3.0/html/working_with_accelerators/working-with-hardware-profiles_accelerators#creating-a-hardware-profile_accelerators).
42
42
@@ -74,7 +74,7 @@ You can see your project's initial state.
74
74
75
75
## Create a workbench
76
76
77
-
A workbench is an instance of your development and experimentation environment. When you create a workbench, you select a workbench image that has the tools, libraries, and an integrated development environment, such as JupyetrLab, that you need for developing AI models.
77
+
A workbench is an instance of your development and experimentation environment. When you create a workbench, you select a workbench image that has the tools, libraries, and an integrated development environment, such as JupyterLab, that you need for developing AI models.
78
78
79
79
The JupyterLab environment is a web-based environment, but everything you do inside it happens on Red Hat OpenShift AI and is powered by the OpenShift cluster. This means that, without having to install and maintain anything on your own computer, and without using valuable local resources such as CPU, GPU and RAM, you can conduct your work in this powerful and stable managed environment.
80
80
@@ -90,9 +90,9 @@ The JupyterLab environment is a web-based environment, but everything you do ins
90
90
91
91
3. Fill out the name and description.
92
92
93
-
Red Hat OpenShift AI provides several supported workbench images. In the **Workbench image** section, you can select one of the default images or a custom image that an administrator has set up for you. The **Jupyter | Minimal | CUDA | Python 3.12** has the libraries needed for this example.
93
+
Red Hat OpenShift AI provides several supported workbench images.
94
94
95
-
4.Select the latest**Jupyter | Minimal | CUDA | Python 3.12** image.
95
+
4.For this example, select the**Jupyter | Minimal | CUDA | Python 3.12** image.
96
96
97
97
5. Select the latest version: **2025.2**.
98
98
@@ -138,7 +138,7 @@ The files for each step in the Knowledge Tuning example end-to-end workflow are
138
138
139
139
In the file browser, view the notebooks that you cloned from Git.
140
140
141
-
Congratulations! Your workbench is configured and ready for the knowledge training example. The notebooks and supporting README files provide details about each step in the knowledge training workflow.
141
+
Congratulations! Your workbench is configured and ready for the Knowledge Tuning example. The notebooks and supporting README files provide details about each step in the Knowledge Tuning workflow.
Copy file name to clipboardExpand all lines: examples/knowledge-tuning/01_Base_Model_Evaluation/01_Base_Model_Evaluation_README.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -14,7 +14,7 @@
14
14
15
15
## Evaluate the base model
16
16
17
-
Before you train a base model, evaluate it's preliminary performance. Later, after you train the model with your data, you can objectively compare how effective the knowledge tuning tasks are for customizing the model.
17
+
In the Teacher-Student model paradigm, the student model is also known as the base model. Before you train a base model, evaluate it's preliminary performance. Later, after you train the model with your data, you can objectively compare how effective the knowledge tuning tasks are for customizing the model.
Copy file name to clipboardExpand all lines: examples/knowledge-tuning/01_Base_Model_Evaluation/Base_Model_Evaluation.ipynb
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -9,7 +9,7 @@
9
9
"\n",
10
10
"\n",
11
11
"## Overview\n",
12
-
"Evaluation is a crucial step in the knowldedge tuning workflow. It allows you to measure the performance and generalization ability of your model. In this notebook, you systematically evaluate the base model by using appropriate metrics and validation datasets before you fine tune the model on the example Bank of Montreal (BMO) data.\n",
12
+
"Evaluation is a crucial step in the Knowldedge Tuning workflow. It allows you to measure the performance and generalization ability of your model. In this notebook, you systematically evaluate the base model by using appropriate metrics and validation datasets before you fine tune the model on the example Bank of Montreal (BMO) data.\n",
13
13
"\n",
14
14
"Throughout this notebook, you use visualizations and quantitative metrics to analyze performance of the base model."
0 commit comments