Skip to content

Commit 990b339

Browse files
gitlawrgitlawr
committed
Deployed c87fcfb to 0.4 with MkDocs 1.6.0 and mike 2.1.3
1 parent c87fcfb commit 990b339

File tree

5 files changed

+65
-53
lines changed

5 files changed

+65
-53
lines changed

‎0.4/installation/air-gapped-installation/index.html

+16
Original file line numberDiff line numberDiff line change
@@ -1688,6 +1688,16 @@ <h3 id="step-1-download-the-required-packages">Step 1: Download the Required Pac
16881688
<span class="c1"># Download dependency tools and save them as an archive</span>
16891689
gpustack<span class="w"> </span>download-tools<span class="w"> </span>--save-archive<span class="w"> </span>gpustack_offline_tools.tar.gz
16901690
</code></pre></div>
1691+
<p>Optional: Additional Dependencies for macOS.</p>
1692+
<div class="highlight"><pre><span></span><code><span class="c1"># Deploying the speech-to-text CosyVoice model on macOS requires additional dependencies.</span>
1693+
brew<span class="w"> </span>install<span class="w"> </span>openfst
1694+
<span class="nv">CPLUS_INCLUDE_PATH</span><span class="o">=</span><span class="k">$(</span>brew<span class="w"> </span>--prefix<span class="w"> </span>openfst<span class="k">)</span>/include
1695+
<span class="nv">LIBRARY_PATH</span><span class="o">=</span><span class="k">$(</span>brew<span class="w"> </span>--prefix<span class="w"> </span>openfst<span class="k">)</span>/lib
1696+
1697+
<span class="nv">AUDIO_DEPENDENCY_PACKAGE_SPEC</span><span class="o">=</span><span class="s2">&quot;wetextprocessing&quot;</span>
1698+
pip<span class="w"> </span>wheel<span class="w"> </span><span class="nv">$AUDIO_DEPENDENCY_PACKAGE_SPEC</span><span class="w"> </span>-w<span class="w"> </span>gpustack_audio_dependency_offline_packages
1699+
mv<span class="w"> </span>gpustack_audio_dependency_offline_packages/*<span class="w"> </span>gpustack_offline_packages/<span class="w"> </span><span class="o">&amp;&amp;</span><span class="w"> </span>rm<span class="w"> </span>-rf<span class="w"> </span>gpustack_audio_dependency_offline_packages
1700+
</code></pre></div>
16911701
<div class="admonition note">
16921702
<p class="admonition-title">Note</p>
16931703
<p>This instruction assumes that the online environment uses the same GPU type as the air-gapped environment. If the GPU types differ, use the <code>--device</code> flag to specify the device type for the air-gapped environment. Refer to the <a href="../../cli-reference/download-tools/">download-tools</a> command for more information.</p>
@@ -1706,6 +1716,12 @@ <h3 id="step-3-install-gpustack">Step 3: Install GPUStack</h3>
17061716
<span class="c1"># Load and apply the pre-downloaded tools archive</span>
17071717
gpustack<span class="w"> </span>download-tools<span class="w"> </span>--load-archive<span class="w"> </span>gpustack_offline_tools.tar.gz
17081718
</code></pre></div>
1719+
<p>Optional: Additional Dependencies for macOS.</p>
1720+
<div class="highlight"><pre><span></span><code><span class="c1"># Install the additional dependencies for speech-to-text CosyVoice model on macOS.</span>
1721+
brew<span class="w"> </span>install<span class="w"> </span>openfst
1722+
1723+
pip<span class="w"> </span>install<span class="w"> </span>--no-index<span class="w"> </span>--find-links<span class="o">=</span>gpustack_offline_packages<span class="w"> </span>wetextprocessing
1724+
</code></pre></div>
17091725
<p>Now you can run GPUStack by following the instructions in the <a href="../manual-installation/#run-gpustack">Manual Installation</a> guide.</p>
17101726

17111727

‎0.4/overview/index.html

+2-6
Original file line numberDiff line numberDiff line change
@@ -1762,12 +1762,8 @@ <h2 id="supported-accelerators">Supported Accelerators</h2>
17621762
<p>We plan to support the following accelerators in future releases.</p>
17631763
<ul class="task-list">
17641764
<li class="task-list-item"><label class="task-list-control"><input type="checkbox" disabled/><span class="task-list-indicator"></span></label> AMD ROCm</li>
1765-
<li class="task-list-item">
1766-
<p><label class="task-list-control"><input type="checkbox" disabled/><span class="task-list-indicator"></span></label> Intel oneAPI</p>
1767-
</li>
1768-
<li class="task-list-item">
1769-
<p><label class="task-list-control"><input type="checkbox" disabled/><span class="task-list-indicator"></span></label> Qualcomm AI Engine</p>
1770-
</li>
1765+
<li class="task-list-item"><label class="task-list-control"><input type="checkbox" disabled/><span class="task-list-indicator"></span></label> Intel oneAPI</li>
1766+
<li class="task-list-item"><label class="task-list-control"><input type="checkbox" disabled/><span class="task-list-indicator"></span></label> Qualcomm AI Engine</li>
17711767
</ul>
17721768
<h2 id="supported-models">Supported Models</h2>
17731769
<p>GPUStack uses <a href="https://github.com/gpustack/llama-box">llama-box</a> (bundled <a href="https://github.com/ggerganov/llama.cpp">llama.cpp</a> and <a href="https://github.com/leejet/stable-diffusion.cpp">stable-diffusion.cpp</a> server), <a href="https://github.com/vllm-project/vllm">vLLM</a> and <a href="https://github.com/gpustack/vox-box">vox-box</a> as the backends and supports a wide range of models. Models from the following sources are supported:</p>

‎0.4/search/search_index.json

+1-1
Large diffs are not rendered by default.

‎0.4/sitemap.xml

+46-46
Original file line numberDiff line numberDiff line change
@@ -2,232 +2,232 @@
22
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
33
<url>
44
<loc>https://docs.gpustack.ai/0.4/</loc>
5-
<lastmod>2024-12-05</lastmod>
5+
<lastmod>2024-12-06</lastmod>
66
<changefreq>daily</changefreq>
77
</url>
88
<url>
99
<loc>https://docs.gpustack.ai/0.4/api-reference/</loc>
10-
<lastmod>2024-12-05</lastmod>
10+
<lastmod>2024-12-06</lastmod>
1111
<changefreq>daily</changefreq>
1212
</url>
1313
<url>
1414
<loc>https://docs.gpustack.ai/0.4/architecture/</loc>
15-
<lastmod>2024-12-05</lastmod>
15+
<lastmod>2024-12-06</lastmod>
1616
<changefreq>daily</changefreq>
1717
</url>
1818
<url>
1919
<loc>https://docs.gpustack.ai/0.4/code-of-conduct/</loc>
20-
<lastmod>2024-12-05</lastmod>
20+
<lastmod>2024-12-06</lastmod>
2121
<changefreq>daily</changefreq>
2222
</url>
2323
<url>
2424
<loc>https://docs.gpustack.ai/0.4/contributing/</loc>
25-
<lastmod>2024-12-05</lastmod>
25+
<lastmod>2024-12-06</lastmod>
2626
<changefreq>daily</changefreq>
2727
</url>
2828
<url>
2929
<loc>https://docs.gpustack.ai/0.4/development/</loc>
30-
<lastmod>2024-12-05</lastmod>
30+
<lastmod>2024-12-06</lastmod>
3131
<changefreq>daily</changefreq>
3232
</url>
3333
<url>
3434
<loc>https://docs.gpustack.ai/0.4/overview/</loc>
35-
<lastmod>2024-12-05</lastmod>
35+
<lastmod>2024-12-06</lastmod>
3636
<changefreq>daily</changefreq>
3737
</url>
3838
<url>
3939
<loc>https://docs.gpustack.ai/0.4/quickstart/</loc>
40-
<lastmod>2024-12-05</lastmod>
40+
<lastmod>2024-12-06</lastmod>
4141
<changefreq>daily</changefreq>
4242
</url>
4343
<url>
4444
<loc>https://docs.gpustack.ai/0.4/scheduler/</loc>
45-
<lastmod>2024-12-05</lastmod>
45+
<lastmod>2024-12-06</lastmod>
4646
<changefreq>daily</changefreq>
4747
</url>
4848
<url>
4949
<loc>https://docs.gpustack.ai/0.4/troubleshooting/</loc>
50-
<lastmod>2024-12-05</lastmod>
50+
<lastmod>2024-12-06</lastmod>
5151
<changefreq>daily</changefreq>
5252
</url>
5353
<url>
5454
<loc>https://docs.gpustack.ai/0.4/upgrade/</loc>
55-
<lastmod>2024-12-05</lastmod>
55+
<lastmod>2024-12-06</lastmod>
5656
<changefreq>daily</changefreq>
5757
</url>
5858
<url>
5959
<loc>https://docs.gpustack.ai/0.4/cli-reference/chat/</loc>
60-
<lastmod>2024-12-05</lastmod>
60+
<lastmod>2024-12-06</lastmod>
6161
<changefreq>daily</changefreq>
6262
</url>
6363
<url>
6464
<loc>https://docs.gpustack.ai/0.4/cli-reference/download-tools/</loc>
65-
<lastmod>2024-12-05</lastmod>
65+
<lastmod>2024-12-06</lastmod>
6666
<changefreq>daily</changefreq>
6767
</url>
6868
<url>
6969
<loc>https://docs.gpustack.ai/0.4/cli-reference/draw/</loc>
70-
<lastmod>2024-12-05</lastmod>
70+
<lastmod>2024-12-06</lastmod>
7171
<changefreq>daily</changefreq>
7272
</url>
7373
<url>
7474
<loc>https://docs.gpustack.ai/0.4/cli-reference/start/</loc>
75-
<lastmod>2024-12-05</lastmod>
75+
<lastmod>2024-12-06</lastmod>
7676
<changefreq>daily</changefreq>
7777
</url>
7878
<url>
7979
<loc>https://docs.gpustack.ai/0.4/installation/air-gapped-installation/</loc>
80-
<lastmod>2024-12-05</lastmod>
80+
<lastmod>2024-12-06</lastmod>
8181
<changefreq>daily</changefreq>
8282
</url>
8383
<url>
8484
<loc>https://docs.gpustack.ai/0.4/installation/docker-installation/</loc>
85-
<lastmod>2024-12-05</lastmod>
85+
<lastmod>2024-12-06</lastmod>
8686
<changefreq>daily</changefreq>
8787
</url>
8888
<url>
8989
<loc>https://docs.gpustack.ai/0.4/installation/installation-script/</loc>
90-
<lastmod>2024-12-05</lastmod>
90+
<lastmod>2024-12-06</lastmod>
9191
<changefreq>daily</changefreq>
9292
</url>
9393
<url>
9494
<loc>https://docs.gpustack.ai/0.4/installation/manual-installation/</loc>
95-
<lastmod>2024-12-05</lastmod>
95+
<lastmod>2024-12-06</lastmod>
9696
<changefreq>daily</changefreq>
9797
</url>
9898
<url>
9999
<loc>https://docs.gpustack.ai/0.4/installation/uninstallation/</loc>
100-
<lastmod>2024-12-05</lastmod>
100+
<lastmod>2024-12-06</lastmod>
101101
<changefreq>daily</changefreq>
102102
</url>
103103
<url>
104104
<loc>https://docs.gpustack.ai/0.4/tutorials/creating-text-embeddings/</loc>
105-
<lastmod>2024-12-05</lastmod>
105+
<lastmod>2024-12-06</lastmod>
106106
<changefreq>daily</changefreq>
107107
</url>
108108
<url>
109109
<loc>https://docs.gpustack.ai/0.4/tutorials/inference-on-cpus/</loc>
110-
<lastmod>2024-12-05</lastmod>
110+
<lastmod>2024-12-06</lastmod>
111111
<changefreq>daily</changefreq>
112112
</url>
113113
<url>
114114
<loc>https://docs.gpustack.ai/0.4/tutorials/inference-with-function-calling/</loc>
115-
<lastmod>2024-12-05</lastmod>
115+
<lastmod>2024-12-06</lastmod>
116116
<changefreq>daily</changefreq>
117117
</url>
118118
<url>
119119
<loc>https://docs.gpustack.ai/0.4/tutorials/performing-distributed-inference-across-workers/</loc>
120-
<lastmod>2024-12-05</lastmod>
120+
<lastmod>2024-12-06</lastmod>
121121
<changefreq>daily</changefreq>
122122
</url>
123123
<url>
124124
<loc>https://docs.gpustack.ai/0.4/tutorials/running-inference-with-ascend-npus/</loc>
125-
<lastmod>2024-12-05</lastmod>
125+
<lastmod>2024-12-06</lastmod>
126126
<changefreq>daily</changefreq>
127127
</url>
128128
<url>
129129
<loc>https://docs.gpustack.ai/0.4/tutorials/running-inference-with-moorethreads-gpus/</loc>
130-
<lastmod>2024-12-05</lastmod>
130+
<lastmod>2024-12-06</lastmod>
131131
<changefreq>daily</changefreq>
132132
</url>
133133
<url>
134134
<loc>https://docs.gpustack.ai/0.4/tutorials/running-on-copilot-plus-pcs-with-snapdragon-x/</loc>
135-
<lastmod>2024-12-05</lastmod>
135+
<lastmod>2024-12-06</lastmod>
136136
<changefreq>daily</changefreq>
137137
</url>
138138
<url>
139139
<loc>https://docs.gpustack.ai/0.4/tutorials/setting-up-a-multi-node-gpustack-cluster/</loc>
140-
<lastmod>2024-12-05</lastmod>
140+
<lastmod>2024-12-06</lastmod>
141141
<changefreq>daily</changefreq>
142142
</url>
143143
<url>
144144
<loc>https://docs.gpustack.ai/0.4/tutorials/using-audio-models/</loc>
145-
<lastmod>2024-12-05</lastmod>
145+
<lastmod>2024-12-06</lastmod>
146146
<changefreq>daily</changefreq>
147147
</url>
148148
<url>
149149
<loc>https://docs.gpustack.ai/0.4/tutorials/using-image-generation-models/</loc>
150-
<lastmod>2024-12-05</lastmod>
150+
<lastmod>2024-12-06</lastmod>
151151
<changefreq>daily</changefreq>
152152
</url>
153153
<url>
154154
<loc>https://docs.gpustack.ai/0.4/tutorials/using-reranker-models/</loc>
155-
<lastmod>2024-12-05</lastmod>
155+
<lastmod>2024-12-06</lastmod>
156156
<changefreq>daily</changefreq>
157157
</url>
158158
<url>
159159
<loc>https://docs.gpustack.ai/0.4/tutorials/using-vision-language-models/</loc>
160-
<lastmod>2024-12-05</lastmod>
160+
<lastmod>2024-12-06</lastmod>
161161
<changefreq>daily</changefreq>
162162
</url>
163163
<url>
164164
<loc>https://docs.gpustack.ai/0.4/user-guide/api-key-management/</loc>
165-
<lastmod>2024-12-05</lastmod>
165+
<lastmod>2024-12-06</lastmod>
166166
<changefreq>daily</changefreq>
167167
</url>
168168
<url>
169169
<loc>https://docs.gpustack.ai/0.4/user-guide/image-generation-apis/</loc>
170-
<lastmod>2024-12-05</lastmod>
170+
<lastmod>2024-12-06</lastmod>
171171
<changefreq>daily</changefreq>
172172
</url>
173173
<url>
174174
<loc>https://docs.gpustack.ai/0.4/user-guide/inference-backends/</loc>
175-
<lastmod>2024-12-05</lastmod>
175+
<lastmod>2024-12-06</lastmod>
176176
<changefreq>daily</changefreq>
177177
</url>
178178
<url>
179179
<loc>https://docs.gpustack.ai/0.4/user-guide/model-management/</loc>
180-
<lastmod>2024-12-05</lastmod>
180+
<lastmod>2024-12-06</lastmod>
181181
<changefreq>daily</changefreq>
182182
</url>
183183
<url>
184184
<loc>https://docs.gpustack.ai/0.4/user-guide/openai-compatible-apis/</loc>
185-
<lastmod>2024-12-05</lastmod>
185+
<lastmod>2024-12-06</lastmod>
186186
<changefreq>daily</changefreq>
187187
</url>
188188
<url>
189189
<loc>https://docs.gpustack.ai/0.4/user-guide/pinned-backend-versions/</loc>
190-
<lastmod>2024-12-05</lastmod>
190+
<lastmod>2024-12-06</lastmod>
191191
<changefreq>daily</changefreq>
192192
</url>
193193
<url>
194194
<loc>https://docs.gpustack.ai/0.4/user-guide/rerank-api/</loc>
195-
<lastmod>2024-12-05</lastmod>
195+
<lastmod>2024-12-06</lastmod>
196196
<changefreq>daily</changefreq>
197197
</url>
198198
<url>
199199
<loc>https://docs.gpustack.ai/0.4/user-guide/user-management/</loc>
200-
<lastmod>2024-12-05</lastmod>
200+
<lastmod>2024-12-06</lastmod>
201201
<changefreq>daily</changefreq>
202202
</url>
203203
<url>
204204
<loc>https://docs.gpustack.ai/0.4/user-guide/playground/</loc>
205-
<lastmod>2024-12-05</lastmod>
205+
<lastmod>2024-12-06</lastmod>
206206
<changefreq>daily</changefreq>
207207
</url>
208208
<url>
209209
<loc>https://docs.gpustack.ai/0.4/user-guide/playground/audio/</loc>
210-
<lastmod>2024-12-05</lastmod>
210+
<lastmod>2024-12-06</lastmod>
211211
<changefreq>daily</changefreq>
212212
</url>
213213
<url>
214214
<loc>https://docs.gpustack.ai/0.4/user-guide/playground/chat/</loc>
215-
<lastmod>2024-12-05</lastmod>
215+
<lastmod>2024-12-06</lastmod>
216216
<changefreq>daily</changefreq>
217217
</url>
218218
<url>
219219
<loc>https://docs.gpustack.ai/0.4/user-guide/playground/embedding/</loc>
220-
<lastmod>2024-12-05</lastmod>
220+
<lastmod>2024-12-06</lastmod>
221221
<changefreq>daily</changefreq>
222222
</url>
223223
<url>
224224
<loc>https://docs.gpustack.ai/0.4/user-guide/playground/image/</loc>
225-
<lastmod>2024-12-05</lastmod>
225+
<lastmod>2024-12-06</lastmod>
226226
<changefreq>daily</changefreq>
227227
</url>
228228
<url>
229229
<loc>https://docs.gpustack.ai/0.4/user-guide/playground/rerank/</loc>
230-
<lastmod>2024-12-05</lastmod>
230+
<lastmod>2024-12-06</lastmod>
231231
<changefreq>daily</changefreq>
232232
</url>
233233
</urlset>

‎0.4/sitemap.xml.gz

0 Bytes
Binary file not shown.

0 commit comments

Comments
 (0)