Skip to content

Commit 3b51efd

Browse files
committed
en doc
1 parent d9a2c3a commit 3b51efd

File tree

3 files changed

+4
-4
lines changed

3 files changed

+4
-4
lines changed

docs/source_en/GetStarted/SWIFT-installation.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -131,7 +131,7 @@ More images can be found [here](https://modelscope.cn/docs/intro/environment-set
131131
| modelscope | >=1.23 | | |
132132
| peft | >=0.11,<0.19 | | |
133133
| flash_attn | | 2.8.3/3.0.0b1 | |
134-
| trl | >=0.15,<0.25 | 0.24.0 | RLHF |
134+
| trl | >=0.15,<0.29 | 0.24.0 | RLHF |
135135
| deepspeed | >=0.14 | 0.17.6 | Training |
136136
| vllm | >=0.5.1 | 0.11.0/0.13.0 | Inference/Deployment |
137137
| sglang | >=0.4.6 | 0.5.5.post3 | Inference/Deployment |

docs/source_en/Megatron-SWIFT/Quick-start.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -78,7 +78,7 @@ Recommended Operating Environment:
7878
| transformers | >=4.33 | 4.57.6 | |
7979
| modelscope | >=1.23 | | |
8080
| peft | >=0.11,<0.19 | | LoRA |
81-
| trl | >=0.15,<0.25 | | RLHF |
81+
| trl | >=0.15,<0.29 | | RLHF |
8282

8383

8484
## Quick Start Example

examples/train/rlhf/gkd/full.sh

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -4,8 +4,8 @@ PYTORCH_CUDA_ALLOC_CONF='expandable_segments:True' \
44
CUDA_VISIBLE_DEVICES=0,1,2,3 \
55
swift rlhf \
66
--rlhf_type gkd \
7-
--model Qwen/Qwen2.5-7B \
8-
--teacher_model Qwen/Qwen2.5-14B-Instruct \
7+
--model Qwen/Qwen2.5-0.5B \
8+
--teacher_model Qwen/Qwen2.5-0.5B-Instruct \
99
--tuner_type full \
1010
--dataset 'AI-ModelScope/alpaca-gpt4-data-en#2000' 'AI-ModelScope/alpaca-gpt4-data-zh#2000' \
1111
--split_dataset_ratio 0.01 \

0 commit comments

Comments
 (0)