File tree Expand file tree Collapse file tree 3 files changed +6
-17
lines changed
Expand file tree Collapse file tree 3 files changed +6
-17
lines changed Original file line number Diff line number Diff line change @@ -38,18 +38,16 @@ The CUDA toolkit can be downloaded from the [CUDA Toolkit Archive](https://devel
3838
3939Ensure that the ` CUDA_PATH ` environment variable is set to the location of your CUDA installation.
4040
41- #### CUDA 11
42-
43- ``` bash
44- pip install onnxruntime-genai-cuda --index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/onnxruntime-cuda-11/pypi/simple/
45- ```
46-
4741#### CUDA 12
4842
4943``` bash
5044pip install onnxruntime-genai-cuda
5145```
5246
47+ #### CUDA 11
48+
49+ To use this API with CUDA 11, you need to [ build and install from source] ( build-from-source.md ) .
50+
5351
5452## Nuget package installation
5553
Original file line number Diff line number Diff line change @@ -83,7 +83,6 @@ Are you on a Windows machine with GPU?
83832 . Install the generate() API
8484
8585 ```
86- pip install numpy
8786 pip install --pre onnxruntime-genai-directml
8887 ```
8988
@@ -125,8 +124,7 @@ Are you on a Windows machine with GPU?
1251242 . Install the generate() API
126125
127126 ```
128- pip install numpy
129- pip install --pre onnxruntime-genai-cuda --index-url=https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/onnxruntime-genai/pypi/simple/
127+ pip install --pre onnxruntime-genai-cuda
130128 ```
131129
1321303 . Run the model
@@ -159,7 +157,6 @@ Are you on a Windows machine with GPU?
1591572. Install the generate() API for CPU
160158
161159 ```
162- pip install numpy
163160 pip install --pre onnxruntime-genai
164161 ```
165162
Original file line number Diff line number Diff line change @@ -102,13 +102,7 @@ You can download the models here:
102102
1031033 . Install the generate() API
104104
105- * CUDA 11
106-
107- ``` bash
108- pip install onnxruntime-genai-cuda --index-url=https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/onnxruntime-cuda-11/pypi/simple/
109- ```
110-
111- * CUDA 12
105+ Note: this package uses CUDA 12. To use CUDA 11, you need to [ build and install from source] ( ../howto/build-from-source.md ) .
112106
113107 ``` bash
114108 pip install onnxruntime-genai-cuda
You can’t perform that action at this time.
0 commit comments