Skip to content

Commit 3322558

Browse files
wuisawesomeAlex
andauthored
[autoscaler][aws] Fix example minimal (ray-project#27075)
Why are these changes needed? The DLAMI moved underneath us and broke for 2 reasons. The AMI's snapshot size increased to 140 GB which was more than our hardcoded max EBS volume size of 100GB The AMI dropped support for python 3.7 and only has 3.8 now. The solutions short term solutions are simple. Allocate a bigger EBS volume. Use the tensorflow 3.8 env. Related issue number Closes ray-project#26368 Co-authored-by: Alex <alex@anyscale.com>
1 parent eacc763 commit 3322558

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

python/ray/autoscaler/aws/defaults.yaml

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -60,7 +60,7 @@ available_node_types:
6060
BlockDeviceMappings:
6161
- DeviceName: /dev/sda1
6262
Ebs:
63-
VolumeSize: 100
63+
VolumeSize: 256
6464
# Additional options in the boto docs.
6565
ray.worker.default:
6666
# The minimum number of nodes of this type to launch.
@@ -122,9 +122,9 @@ initialization_commands: []
122122
# List of shell commands to run to set up nodes.
123123
setup_commands:
124124
- >-
125-
(stat $HOME/anaconda3/envs/tensorflow2_latest_p37/ &> /dev/null &&
126-
echo 'export PATH="$HOME/anaconda3/envs/tensorflow2_latest_p37/bin:$PATH"' >> ~/.bashrc) || true
127-
- which ray || pip install -U "ray[default] @ https://s3-us-west-2.amazonaws.com/ray-wheels/latest/ray-3.0.0.dev0-cp37-cp37m-manylinux2014_x86_64.whl"
125+
(stat $HOME/anaconda3/envs/tensorflow2_p38/ &> /dev/null &&
126+
echo 'export PATH="$HOME/anaconda3/envs/tensorflow2_p38/bin:$PATH"' >> ~/.bashrc) || true
127+
- which ray || pip install -U "ray[default] @ https://s3-us-west-2.amazonaws.com/ray-wheels/latest/ray-3.0.0.dev0-cp38-cp38-manylinux2014_x86_64.whl"
128128

129129
# Custom commands that will be run on the head node after common setup.
130130
head_setup_commands:

0 commit comments

Comments
 (0)