Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ablation studies #45

Closed
wants to merge 26 commits into from
Closed

Ablation studies #45

wants to merge 26 commits into from

Conversation

zausin33
Copy link
Collaborator

No description provided.

zausin33 and others added 26 commits January 9, 2025 14:50
* Modified and ran run_language_modeling.py to test on all datasets individually.

* Comparing losses

* Arithmetic dataset testing + Pearson and Spearman metrics

* removed nohup.out from git tracking

* removed result files from git tracking

---------

Co-authored-by: thorben010 <[email protected]>
…py (#42)

* Modified and ran run_language_modeling.py to test on all datasets individually.

* Comparing losses

* Arithmetic dataset testing + Pearson and Spearman metrics

* removed nohup.out from git tracking

* removed result files from git tracking

* Changed calculation of metrics using scipy

---------

Co-authored-by: thorben010 <[email protected]>
Co-authored-by: Jonas Zausinger <[email protected]>
Refactored Code for loading datasets
# Conflicts:
#	config/run_specific_config/config.yaml
#	src/ntl/run_language_modeling.py
#	tests/test_evaluation.py
# Conflicts:
#	config/model_args/vanilla_t5_ntl.yaml
#	config/run_specific_config/config.yaml
#	config/training_args/train.yaml
#	src/ntl/evaluation.py
* add rjokes data

* add evaluate of rjokes dataset

* changes in the logic

* number to str in dataset andwer

* change the config

* change in config

* output logs

* changes

* some changes

* feat: uv compat

* fix: cuda dev

* reset config

* Delete log.txt

* Delete nohup.out

* fixed run_language_modeling.py

---------

Co-authored-by: timotos <[email protected]>
Co-authored-by: thorben010 <[email protected]>
Co-authored-by: Jannis Born <[email protected]>
Co-authored-by: Jonas Zausinger <[email protected]>
* debug

* debug [skip ci]

* debug [skip ci]

* debug [skip ci]

* debug [skip ci]

* debug [skip ci]

* debug [skip ci]

* debug [skip ci]

* debug [skip ci]

* debug [skip ci]

* wip: cleanup
@zausin33 zausin33 closed this Jan 30, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants