-
-
Notifications
You must be signed in to change notification settings - Fork 67
Open
Labels
enhancementNew feature or requestNew feature or requestlayersRelated to the Layers module - generic layers for reuse by modelsRelated to the Layers module - generic layers for reuse by models
Description
DropBlock is a type of regularisation that tries to replace dropout. The original paper describes it as best used with a linear scaling rate across blocks in a model, as has been implemented in #174. However, timm adds several experimental features, including:
- a scaling value for the
gammacalculated (already included in Overhaul of ResNet API #174). - a certain configuration of
DropBlockrates picked by experimentation to give better results on ResNets - these however extend only to four-stage ResNets i.e. those similar to the models in the original ResNet paper.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or requestlayersRelated to the Layers module - generic layers for reuse by modelsRelated to the Layers module - generic layers for reuse by models