Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Poor performance because of bad initialization #10

Open
JerryPeng21cuhk opened this issue Jun 20, 2019 · 1 comment
Open

Poor performance because of bad initialization #10

JerryPeng21cuhk opened this issue Jun 20, 2019 · 1 comment

Comments

@JerryPeng21cuhk
Copy link

JerryPeng21cuhk commented Jun 20, 2019

This is for those are trying this vae-clustering repo which depends the tensorbayes library. I got very poor performance because of the bad initialization scheme in file: tensorbayes/layers/simple.py line 31.

Pls replace variance_scaling_initializer with xavier_initializier. Also, don't forget to import it: from tensorflow.contrib.layers import xavier_initializer

After this, the performance is boosted.
Hope this help later followers~

@JerryPeng21cuhk
Copy link
Author

JerryPeng21cuhk commented Jun 21, 2019

I implemented a pytorch version and found the clustering accuracy(Or purity ?) can be boosted to 95% after 738 epoches...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant