Skip to content

Commit 87b2488

Browse files
committed
Cleaner model download instructions
1 parent a91395f commit 87b2488

4 files changed

Lines changed: 23 additions & 10 deletions

File tree

playbooks/core/lmstudio-rocm-llms/README.md

Lines changed: 2 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -18,21 +18,13 @@ LM Studio is a powerful GUI-based wrapper for [llama.cpp](https://github.com/ggm
1818
<!-- @setup:memory-config -->
1919

2020

21-
## Downloading models
21+
## Downloading Models
2222

23-
Your LM Studio instance in the STX Halo™ comes with OpenAI GPT-OSS 120B pre-downloaded.
24-
25-
26-
Should you wish to download additional models - you can do so by pressing "Ctrl" + "Shift" + "M" on your keyboard or clicking on the "Discover" tab (Magnifying Glass) and searching for additional models.
27-
28-
LM Studio will automatically download and put the model in the correct directory.
23+
<!-- @require:lmstudio-models-gpt-oss-120b -->
2924

3025
## Chatting with an LLM
3126
Learn how to start chatting with a ChatGPT-grade LLM completely locally.
3227

33-
34-
> This example uses OpenAI GPT-OSS 120B in its original MXFP4 precision. Please make sure to have completed the [System Setup](#system-setup) section above for optimal performance.
35-
3628
1. Press "Ctrl" + "L" or select the central drop down menu at the top. Select "manually chose model load parameters" and click on "OpenAI GPT-OSS 120B"
3729
2. Make sure "show advanced settings" is checked.
3830
3. Change context size to "128,000". Make sure "Flash Attention" is On and "GPU offload layers" is set to maximum.
85.5 KB
Loading
Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,14 @@
1+
### Downloading GPT-OSS 120B on LM Studio
2+
3+
To download the GPT-OSS 120B model:
4+
5+
1. Press "Ctrl" + "Shift" + "M" on your keyboard or click on the "Discover" tab (Magnifying Glass icon) on the left sidebar
6+
2. Search for `ggml-org/gpt-oss-120b-GGUF`
7+
3. Select `mxfp4` and click Download
8+
9+
<p align="center">
10+
<img src="/api/dependencies/assets/lmstudio_download.png" alt="LM Studio Download Models" width="600"/>
11+
12+
LM Studio will automatically download and place the model in the correct directory.
13+
14+
Should you wish to download additional models, you can search for them in the Discover tab and LM Studio will handle the rest.

playbooks/dependencies/registry.json

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -51,6 +51,13 @@
5151
"platforms": ["windows", "linux"],
5252
"file": "comfyui_models.md"
5353
},
54+
"lmstudio-models-gpt-oss-120b": {
55+
"name": "GPT-OSS 120B Model",
56+
"description": "OpenAI GPT-OSS 120B model for LM Studio",
57+
"category": "model",
58+
"platforms": ["windows", "linux"],
59+
"file": "lmstudio_models_gpt_oss_120b.md"
60+
},
5461
"driver": {
5562
"name": "AMD GPU Driver",
5663
"description": "Latest AMD GPU driver for optimal performance",

0 commit comments

Comments
 (0)