Skip to content

[Bug] Turning down stopped cluster doesn't work #2053

@wizeng23

Description

@wizeng23

What happened?

Based on the log lines, it should be possible.

(oumi) 16:08:55 ~/Documents/repos/oumi main $ oumi launch stop --cluster smollm-135m-fft

   ____  _    _ __  __ _____
  / __ \| |  | |  \/  |_   _|
 | |  | | |  | | \  / | | |
 | |  | | |  | | |\/| | | |
 | |__| | |__| | |  | |_| |_
  \____/ \____/|_|  |_|_____|

⠧ Stopping cluster smollm-135m-fftWARNING:torchao.kernel.intmm:Warning: Detected no triton, on systems without Triton certain kernels will not work
Cluster smollm-135m-fft stopped!
Use oumi launch down to turn it down.
(oumi) 16:42:00 ~/Documents/repos/oumi main $ oumi launch down --cluster smollm-135m-fft

   ____  _    _ __  __ _____
  / __ \| |  | |  \/  |_   _|
 | |  | | |  | | \  / | | |
 | |  | | |  | | |\/| | | |
 | |__| | |__| | |  | |_| |_
  \____/ \____/|_|  |_|_____|

⠴ Turning down cluster smollm-135m-fftWARNING:torchao.kernel.intmm:Warning: Detected no triton, on systems without Triton certain kernels will not work
⠴ Turning down cluster smollm-135m-fftCluster smollm-135m-fft not found.
Cluster smollm-135m-fft turned down!
(oumi) 16:42:10 ~/Documents/repos/oumi main $ sky status
Clusters
NAME             LAUNCHED     RESOURCES                                                STATUS   AUTOSTOP  COMMAND
smollm-135m-fft  34 mins ago  1x GCP(a2-highgpu-1g[Spot], {'A100': 1}, disk_size=100)  STOPPED  60m       /opt/miniconda3/envs/oumi...
aledade          1 month ago  1x GCP(a2-highgpu-4g, {'A100': 4}, disk_size=2000)       STOPPED  60m       /opt/miniconda3/envs/oumi...

Managed jobs
No in-progress managed jobs. (See: sky jobs -h)

Services
No live services. (See: sky serve -h)

Steps to reproduce the bug

See above

System Info

N/A

Metadata

Metadata

Assignees

Labels

bugSomething isn't workingtriageThis issue needs review by the core team.

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions