You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello,
thanks for your paper and congratulations on the publication in Nature!
I was trying to reproduce your PPI model's results on the STRING dataset but was unable to reach the reported performance for both PPI-residue-importance (for 1UZN) and best-F1 score (best-F1 achieved is 0.86 vs. reported 0.95).
A few caveats - I used the published random split for training; and to extract residue importance, I used a torch's GNNExplainer customised to be compatible with ProteinGNNTrainer. The .pdb files were obtained using AF2 (which is expected to produce lower performance according to the results you reported for folded & actual structures).
Would you mind sharing the weights of the PPI model or maybe adding extra details relevant to reproduce the reported results (e.g., the exact splits you used, and how residue importance was extracted)?
The text was updated successfully, but these errors were encountered:
Hello,
thanks for your paper and congratulations on the publication in Nature!
I was trying to reproduce your PPI model's results on the STRING dataset but was unable to reach the reported performance for both PPI-residue-importance (for 1UZN) and best-F1 score (best-F1 achieved is 0.86 vs. reported 0.95).
A few caveats - I used the published random split for training; and to extract residue importance, I used a torch's
GNNExplainer
customised to be compatible withProteinGNNTrainer
. The.pdb
files were obtained using AF2 (which is expected to produce lower performance according to the results you reported for folded & actual structures).Would you mind sharing the weights of the PPI model or maybe adding extra details relevant to reproduce the reported results (e.g., the exact splits you used, and how residue importance was extracted)?
The text was updated successfully, but these errors were encountered: