You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
* hot fixes
* minor edits
* fix tests
* Remove title without content for GPU driver
* updated rocm.md; halo instructions are still doubled for halobox
* Apply suggestion from @danielholanda
Co-authored-by: Daniel Holanda <holand.daniel@gmail.com>
* removing unnecessary rocm for windows
* minor fixes
* Apply suggestions from code review
Co-authored-by: Sreeram <s.sreeram.amd@gmail.com>
* instruction fix
* added link to rocm installation.
* updating comfyui linux install instructions
* Removing `test` tags for ROCm 7.12 installation
Co-authored-by: Sreeram <s.sreeram.amd@gmail.com>
---------
Co-authored-by: Daniel Holanda <holand.daniel@gmail.com>
Co-authored-by: Sreeram <s.sreeram.amd@gmail.com>
Copy file name to clipboardExpand all lines: playbooks/core/lmstudio-rocm-llms/README.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -32,7 +32,7 @@ LM Studio is a powerful GUI-based wrapper for [llama.cpp](https://github.com/ggm
32
32
Learn how to start chatting with a ChatGPT-grade LLM completely locally.
33
33
34
34
1. Open LMStudio.
35
-
2. Press `Ctrl + L` to open the Model Loader, select `Manually chose model load parameters`, and click on `GPT-OSS 120B`
35
+
2. Press `Ctrl + L` to open the Model Loader, select `Manually choose model load parameters`, and click on `GPT-OSS 120B`
36
36
3. Make sure "show advanced settings" is checked.
37
37
4. Change `Context Length` as desired. Higher context length means more model memory, but more system memory used. Recommended for this playbook is 4096.
38
38
5. Make sure `GPU Offload` is set to maximum and `Flash Attention` is On
@@ -80,7 +80,7 @@ LM Studio also offers an OpenAI compliant endpoint in the form of LM Studio Serv
80
80
81
81
To set up LM Studio Server, use the following instructions:
82
82
83
-
1. On the left hand side, click on the `Developer` tab (command line icon) or `CTRL + 2` and then click on `Server Settings`.
83
+
1. On the left hand side, click on the `Developer` tab (command line icon) or `Ctrl + 2` and then click on `Server Settings`.
84
84
2. (Optional): If you want to serve the model over your LAN, check `Serve on Local Network`. If you want to use with a website or extensive calling within VS Code, check `Enable CORS`.
85
85
3. On the upper left corner, make sure the server is running by clicking on the toggle button in front of `Status`.
86
86
4. An OpenAI compliant endpoint will now be running. The address is typically at http://127.0.0.1:1234
Refer this [official documentation](https://rocm.docs.amd.com/projects/radeon-ryzen/en/latest/docs/install/installryz/native_linux/install-ryzen.html) for more info.
For further installation help, please see this [link](https://rocm.docs.amd.com/en/7.12.0-preview/install/rocm.html?fam=ryzen&gpu=max-pro-395&os=ubuntu&os-version=24.04&i=pip).
0 commit comments