Skip to content

Commit a7bda6f

Browse files
gabrieltsenggabrieltseng
committed
lower beta2
1 parent 54e936b commit a7bda6f

1 file changed

Lines changed: 2 additions & 0 deletions

File tree

‎scripts/vnext/single_bandset_band_dropout/tiny_launch.sh‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4,3 +4,5 @@ python scripts/vnext/single_bandset_band_dropout/tiny.py launch tiny_1.1_lr0.000
44
python scripts/vnext/single_bandset_band_dropout/tiny.py launch tiny_1.1_lr0.0005_wd0.002 ai2/ceres-cirrascale --train_module.optim_config.lr=0.0005 --train_module.optim_config.weight_decay=0.002 --launch.clusters='[ai2/jupiter-cirrascale-2]' --launch.priority=urgent --launch.num_gpus=4
55
python scripts/vnext/single_bandset_band_dropout/tiny.py launch tiny_1.1_lr0.0001_wd0.02 ai2/ceres-cirrascale --train_module.optim_config.lr=0.0001 --train_module.optim_config.weight_decay=0.02 --launch.clusters='[ai2/jupiter-cirrascale-2]' --launch.priority=urgent --launch.num_gpus=4
66
python scripts/vnext/single_bandset_band_dropout/tiny.py launch tiny_1.1_lr0.0001_wd0.002 ai2/ceres-cirrascale --train_module.optim_config.lr=0.0001 --train_module.optim_config.weight_decay=0.002 --launch.clusters='[ai2/jupiter-cirrascale-2]' --launch.priority=urgent --launch.num_gpus=4
7+
python scripts/vnext/single_bandset_band_dropout/tiny.py launch tiny_1.1_lr0.0002_wd0.02_b20.95 ai2/ceres-cirrascale --train_module.optim_config.lr=0.0002 --train_module.optim_config.weight_decay=0.02 --train_module.optim_config.betas='[0.9,0.95]' --launch.clusters='[ai2/jupiter-cirrascale-2]' --launch.priority=urgent --launch.num_gpus=4
8+
python scripts/vnext/single_bandset_band_dropout/tiny.py launch tiny_1.1_lr0.0002_wd0.002_b20.95 ai2/ceres-cirrascale --train_module.optim_config.lr=0.0002 --train_module.optim_config.weight_decay=0.002 --train_module.optim_config.betas='[0.9,0.95]' --launch.clusters='[ai2/jupiter-cirrascale-2]' --launch.priority=urgent --launch.num_gpus=4

0 commit comments

Comments
 (0)