New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

How is BN in key-encoder updated (in Moco v1)？ #144

Open

lck1201 opened this issue Sep 15, 2023 · 1 comment

lck1201 commented Sep 15, 2023

updated by momentum update? or by setting BN in .train() mode, updated by itself (i.e., running_mean/running_var)?

lck1201 changed the title ~~How does BN in key-encode update (in Moco v1)？~~ How is BN in key-encoder updated (in Moco v1)？

Author

lck1201 commented Sep 15, 2023

BTW, no gradient in key-encoder, even in BN, right?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment