Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Why use test_loader instead of validation_loader? #50

Open
missflash opened this issue Aug 29, 2023 · 1 comment
Open

Why use test_loader instead of validation_loader? #50

missflash opened this issue Aug 29, 2023 · 1 comment

Comments

@missflash
Copy link

I think you should use validation_loader instead of test_loader in the following self.vali function.

vali_loss1, vali_loss2 = self.vali(self.test_loader)

@umivic
Copy link

umivic commented Aug 18, 2024

I agree with you. The test dataset should never be used as a validation set during the training process. This practice can lead to data leakage and result in overly optimistic performance evaluations. Any reported test performance metrics would be artificially high and not reflective of the model’s actual ability to generalize to unseen data.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants