Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The quantitative results of reproduced generated samples and real samples are different with the LVDM official paper. #15

Open
HanEol-Lee77 opened this issue Oct 17, 2023 · 1 comment

Comments

@HanEol-Lee77
Copy link

As instructed in LVDM official code, we downloaded and used the pretrained weights, then extracted the generated npz files as detailed in the README.md available at the official link (https://github.com/YingqingHe/LVDM). Following this procedure, we conducted evaluations and obtained the following results. (For the real samples, we configured 2048 training splits randomly, following the protocol of StyleGAN-V.)

However, for the SKY dataset, the FVD score was 318.66, and the KVD score was 21.89. Regarding the taichi dataset, the FVD score was 285.76, and the KVD score was 31.62. (In LVDM paper, for the SKY dataset, the FVD score was 95.2 ± 2.3, and the KVD score was 3.9 ± 0.1. Regarding the taichi dataset, the FVD score was 99.0 ± 2.6, and the KVD score was 15.3 ± 0.9)

Could you provide an explanation for any difficulties encountered in reproducing these results? Additionally, could you share the configuration details for the 2048 real samples you used?

@eddieback
Copy link

Meet the same problem. Have you solved it?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants