File tree 1 file changed +10
-1
lines changed
1 file changed +10
-1
lines changed Original file line number Diff line number Diff line change @@ -10,7 +10,10 @@ We tested the scripts with Python 3.10.12 and CUDA 12.4.
10
10
In addition, you need to install the following:
11
11
12
12
- PyTorch v2.6.0
13
- - DeepSpeed (v0.16.6 or newer)
13
+ - For the Mixtral model, we recommend using PyTorch v2.7.0 (currently the final release candidate) due to an issue with ` torch.where ` .
14
+ - See details [ here] ( https://github.com/pytorch/pytorch/issues/149278 )
15
+ - DeepSpeed (v.0.16.6 or newer)
16
+ - As DeepCompile is under active development, we recommend using the latest version or installing from source.
14
17
- transformers
15
18
- accelerate
16
19
- datasets v3.1
@@ -24,6 +27,12 @@ pip3 install transformers datasets==3.1 accelerate
24
27
# Install DeepSpeed
25
28
pip install deepspeed
26
29
30
+ # Or install the latest revision of DeepSpeed from source
31
+ # git clone https://github.com/deepspeedai/DeepSpeed
32
+ # cd DeepSpeed
33
+ # git pip install .
34
+ # cd ..
35
+
27
36
# Clone this repository
28
37
git clone https://github.com/deepspeedai/DeepSpeedExamples
29
38
cd benchmarks/deepcompile
You can’t perform that action at this time.
0 commit comments