File tree 1 file changed +3
-0
lines changed
1 file changed +3
-0
lines changed Original file line number Diff line number Diff line change @@ -345,6 +345,7 @@ If you have loaded a model locally you need to set its URL through the expanded
345
345
346
346
- ` Show/Hide Advanced Options ` Toggle to show/hide advanced options from below
347
347
- ` Log Level ` select how verbose the log messages are
348
+ - ` Use extras ` select to install and allow the use of extra features (flash attention and IQ quants)
348
349
349
350
#### 💻 Setup Settings
350
351
@@ -381,6 +382,7 @@ If the user's GPU is not supported, the LLM will fall back to the CPU
381
382
- ` Model ` the path of the model being used (relative to the Assets/StreamingAssets folder)
382
383
- ` Chat Template ` the chat template being used for the LLM
383
384
- ` Lora ` the path of the LoRA being used (relative to the Assets/StreamingAssets folder)
385
+ - ` Flash Attention ` click to use flash attention in the model (if ` Use extras ` is enabled)
384
386
385
387
</details >
386
388
@@ -395,6 +397,7 @@ If the user's GPU is not supported, the LLM will fall back to the CPU
395
397
396
398
- ` Show/Hide Advanced Options ` Toggle to show/hide advanced options from below
397
399
- ` Log Level ` select how verbose the log messages are
400
+ - ` Use extras ` select to install and allow the use of extra features (flash attention and IQ quants)
398
401
399
402
#### 💻 Setup Settings
400
403
<div >
You can’t perform that action at this time.
0 commit comments