Add simCLR with temperature schedule

[JannikWirtz]

Hi,

this is my first PR to an open source project so I am starting it out as a draft.

I am looking to contribute to #1319. This PR should cover the first task. I will probably be able to do most of the tasks except for actually running the benchmark, since I don't think I have the neccessary hardware.

Thanks for reviewing :)

[guarin]

Thanks a lot of the PR!

Could you add a test_cosine_schedule__period method to the tests in tests/utils/test_scheduler.py to check that the new functionality works as expected?

[JannikWirtz]

Thanks a lot for the feedback! I will take a look at the benchmark next.

[guarin]

Thanks a lot for the update! This looks pretty much good to merge. Left one small question.

[codecov]

Codecov Report

Attention: 1 lines in your changes are missing coverage. Please review.

Comparison is base (569bf2b) 85.37% compared to head (40c80d5) 85.37%.

Additional details and impacted files

@@           Coverage Diff           @@
##           master    #1413   +/-   ##
=======================================
  Coverage   85.37%   85.37%           
=======================================
  Files         130      130           
  Lines        5476     5484    +8     
=======================================
+ Hits         4675     4682    +7     
- Misses        801      802    +1     

Files	Coverage Δ
lightly/utils/scheduler.py	97.14% <90.00%> (-2.86%)	⬇️

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[petroslk]

Hello there! I stumbled upon this and was wondering, has there been any docs added to document the use of the temperature scheduler with NTXentLoss for simCLR?
Thanks a lot for your work!