Error: self.scale = head_dim ** -0.5 ZeroDivisionError: 0.0 cannot be raised to a negative power.

[binbbaz]

from timm.models import create_model
model = create_model('deit_small_patch16_224', pretrained=True)

The above flags the error:

self.scale = head_dim ** -0.5
ZeroDivisionError: 0.0 cannot be raised to a negative power.

I have not even loaded any data into it.

model = create_model('deit_tiny_patch16_224', pretrained=True) works well. No errors.

I understand this error is as a result of a zero being divided by a non-zero value or when being raised to the power of non-zero. But I don't quite get why the first variant above is flagging an error even before loading any data.

[binbbaz]

So, upgrading timm solved this problem for me