Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Inaccurate Results with PAM Pre-Trained Weights in demo.py #109

Open
Keerthana-chinta opened this issue Sep 2, 2024 · 1 comment
Open

Comments

@Keerthana-chinta
Copy link

Hello,

I am experiencing issues with the accuracy of the results when using the PAM pre-trained weights while running demo.py. Despite following the instructions and loading the PAM pre-trained weights (pam_net_F.pth and pam_net_A.pth), the output does not seem to reflect the expected performance. Could you please verify whether the pre-trained weights are compatible with the current implementation in demo.py? Are there any known issues or additional steps required to get accurate results with the PAM pre-trained weights? Any guidance on improving the accuracy or resolving this issue would be greatly appreciated.
Thank you for your support and for providing this valuable resource to the community!

@ravmarcinMT
Copy link

I tested the pam_net_F.pth and pam_net_A.pth in PAM pre-trained folder, and find out that the scores suggest that they are not pre-trained (or are very early checkpoint). I got the recall 5.6%. I assume that you must retrain the model using instructions from README

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants