-
-
Notifications
You must be signed in to change notification settings - Fork 67
Open
Labels
enhancementNew feature or requestNew feature or requestlayersRelated to the Layers module - generic layers for reuse by modelsRelated to the Layers module - generic layers for reuse by models
Description
DropBlock is a type of regularisation that tries to replace dropout. The original paper describes it as best used with a linear scaling rate across blocks in a model, as has been implemented in #174. However, timm adds several experimental features, including:
- a scaling value for the
gammacalculated (already included in Overhaul of ResNet API #174). - a certain configuration of
DropBlockrates picked by experimentation to give better results on ResNets - these however extend only to four-stage ResNets i.e. those similar to the models in the original ResNet paper.
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or requestlayersRelated to the Layers module - generic layers for reuse by modelsRelated to the Layers module - generic layers for reuse by models