Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Specific improvements to vit #15

Open
sure7018 opened this issue Dec 21, 2021 · 3 comments
Open

Specific improvements to vit #15

sure7018 opened this issue Dec 21, 2021 · 3 comments

Comments

@sure7018
Copy link

Hello, how to use CSRA in vit? There is no specific information in the paper?

@Kevinz-code
Copy link
Owner

Hi, thanks for reading.
The 'main.py' in our codebase describes the setting of wider attribute dataset using VIT-CSRA models, say, step_size=5, lr_backbone=0.1, lr_fc=0.01. You can follow the same settings when using VIT-CSRA models in wider attribute dataset.

@sure7018
Copy link
Author

What improvements have your paper made to the original model of Vit?

@Kevinz-code
Copy link
Owner

Kevinz-code commented Dec 21, 2021

Hi, @sure7018, I'm not sure I fully understand your question.
You mean the improvement of the VIT structure, or the improvement of our VIT-CSRA model compared with orginal VIT model? In the later case, refer to the Table 3-4 in MS-COCO and wider-attribute datasets, which clearly demonstrate the performance gain of our method.

Best,
Author

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants