Skip to content

Commit 5f8971f

Browse files
committed
Updated install instructions for CUDA
1 parent 7ad9caa commit 5f8971f

File tree

3 files changed

+6
-17
lines changed

3 files changed

+6
-17
lines changed

docs/genai/howto/install.md

Lines changed: 4 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -38,18 +38,16 @@ The CUDA toolkit can be downloaded from the [CUDA Toolkit Archive](https://devel
3838

3939
Ensure that the `CUDA_PATH` environment variable is set to the location of your CUDA installation.
4040

41-
#### CUDA 11
42-
43-
```bash
44-
pip install onnxruntime-genai-cuda --index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/onnxruntime-cuda-11/pypi/simple/
45-
```
46-
4741
#### CUDA 12
4842

4943
```bash
5044
pip install onnxruntime-genai-cuda
5145
```
5246

47+
#### CUDA 11
48+
49+
To use this API with CUDA 11, you need to [build and install from source](build-from-source.md).
50+
5351

5452
## Nuget package installation
5553

docs/genai/tutorials/phi3-python.md

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -83,7 +83,6 @@ Are you on a Windows machine with GPU?
8383
2. Install the generate() API
8484

8585
```
86-
pip install numpy
8786
pip install --pre onnxruntime-genai-directml
8887
```
8988

@@ -125,8 +124,7 @@ Are you on a Windows machine with GPU?
125124
2. Install the generate() API
126125

127126
```
128-
pip install numpy
129-
pip install --pre onnxruntime-genai-cuda --index-url=https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/onnxruntime-genai/pypi/simple/
127+
pip install --pre onnxruntime-genai-cuda
130128
```
131129

132130
3. Run the model
@@ -159,7 +157,6 @@ Are you on a Windows machine with GPU?
159157
2. Install the generate() API for CPU
160158
161159
```
162-
pip install numpy
163160
pip install --pre onnxruntime-genai
164161
```
165162

docs/genai/tutorials/phi3-v.md

Lines changed: 1 addition & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -102,13 +102,7 @@ You can download the models here:
102102

103103
3. Install the generate() API
104104

105-
* CUDA 11
106-
107-
```bash
108-
pip install onnxruntime-genai-cuda --index-url=https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/onnxruntime-cuda-11/pypi/simple/
109-
```
110-
111-
* CUDA 12
105+
Note: this package uses CUDA 12. To use CUDA 11, you need to [build and install from source](../howto/build-from-source.md).
112106

113107
```bash
114108
pip install onnxruntime-genai-cuda

0 commit comments

Comments
 (0)