Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

When I successfully generated the problems " pred.txt" , how can I get the Metrics in the paper? BLEU RG-L Dist-1 Dist-2 Ent-4 #4

Open
kouhonglady opened this issue Oct 9, 2019 · 5 comments

Comments

@kouhonglady
Copy link

No description provided.

@kouhonglady kouhonglady changed the title 当我成功生成了问题 pred.txt ,请问怎么样才能得到论文里给各项指标呢? 当我成功生成了问题 pred.txt ,请问怎么样才能得到论文里给各项指标呢?BLEU RG-L Dist-1 Dist-2 Ent-4 Oct 9, 2019
@kouhonglady kouhonglady changed the title 当我成功生成了问题 pred.txt ,请问怎么样才能得到论文里给各项指标呢?BLEU RG-L Dist-1 Dist-2 Ent-4 When I successfully generated the problems " pred.txt" , how can I get the Metrics in the paper? BLEU RG-L Dist-1 Dist-2 Ent-4 Oct 9, 2019
@ByronPan
Copy link
Member

Thanks for the interest! You can refer to diversity.py in the tools/ folder.

@kugwzk
Copy link

kugwzk commented Nov 20, 2019

@kouhonglady Hi, I finished the train but failed on the validate the model. I see the log give TypeError: forward() missing 1 required positional argument: 'history_lengths' Did you meet a same error? I guess the code loss a parameter 'batch' in outputs, attns, _ = valid_model(src, history, tgt, src_lengths, history_lengths)in trainer.py 290th line.

@zzs-NLP
Copy link

zzs-NLP commented Jul 9, 2020

@kugwzk Hello,I tried to add 'history_len' in the parameter list,but still failed on the validate the model.Maybe I have a problem with the way I add it.I see the same problem as you here.If you can recall how it worked out, can you share it with me?Thank you very much for your kind reply!

@kugwzk
Copy link

kugwzk commented Jul 9, 2020

@zzs-NLP I'm sorry for forgetting that. And my solution is already above. I add 'batch' in valid_model() parameters list.

@zzs-NLP
Copy link

zzs-NLP commented Jul 9, 2020

@kugwzk Thanks again for your kind reply.I'll try again as you suggest.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants