Integrate dreamsim

[LukasMut]

Integrating DreamSim into thingsvision and minor changes to the codebase (mainly for refactoring purposes)

[jonasd4]

The checkpoint_path is currently not passed to the dreamsim function which has the option cache_dir. There, the default cache dir is ./models. I think we should store the checkpoints in the torch default cache dir, as we do for all the ssl models.

[LukasMut]

What are your thoughts @ssundaram21?

[ssundaram21]

I agree! It's a change we've been planning to make for dreamsim anyways. The checkpoint_path argument was supposed to be deleted, apologies for that.

[jonasd4]

Great! We should also pass the device to the dreamsim function. This is cuda by default and currently the reason why the tests fail (the ci worker has no GPU).

[codecov-commenter]

Codecov Report

Patch coverage: 92.50% and project coverage change: +0.47% 🎉

Comparison is base (6f7c777) 74.28% compared to head (7aefc0e) 74.75%.

❗ Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.

Additional details and impacted files

@@            Coverage Diff             @@
##           master     #148      +/-   ##
==========================================
+ Coverage   74.28%   74.75%   +0.47%     
==========================================
  Files          27       28       +1     
  Lines        1287     1319      +32     
  Branches      185      186       +1     
==========================================
+ Hits          956      986      +30     
- Misses        277      278       +1     
- Partials       54       55       +1     

Flag	Coverage Δ
unittests	74.75% <92.50%> (+0.47%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files Changed	Coverage Δ
thingsvision/custom_models/official_clip.py	100.00% <ø> (ø)
thingsvision/custom_models/vgg16_ecoset.py	100.00% <ø> (ø)
thingsvision/core/extraction/extractors.py	77.58% <75.00%> (ø)
thingsvision/custom_models/dreamsim.py	93.93% <93.93%> (ø)
thingsvision/core/extraction/base.py	59.18% <100.00%> (ø)
thingsvision/core/extraction/torch.py	74.19% <100.00%> (ø)

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[andropar]

Great addition!