Skip to content

Commit a5e96bb

Browse files
committed
🔧 Increase ViT size and add decoder bounding to cnn_vit_cnn
1 parent 230c6cd commit a5e96bb

1 file changed

Lines changed: 6 additions & 2 deletions

File tree

icenet_mp/config/model/03_cnn_vit_cnn.yaml

Lines changed: 6 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -19,9 +19,13 @@ encoders:
1919

2020
processor:
2121
_target_: icenet_mp.models.processors.VitProcessor
22-
patch_size: 12 # 108 / 12 = 9 patches per dimension
22+
depth: 6 # number of transformer blocks
23+
dropout: 0.1 # dropout rate
24+
emb_dim: 256 # embedding dimension
25+
mlp_dim: 1024 # dimension of the MLP in the transformer block
26+
patch_size: 6 # 108 / 6 = 18 patches per dimension
2327

2428
decoder:
2529
_target_: icenet_mp.models.decoders.CNNDecoder
26-
bounded: false
30+
bounded: true
2731
n_layers: 2

0 commit comments

Comments
 (0)