New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

KL loss Query #1

Open

Yumlembam opened this issue Jul 14, 2021 · 1 comment

Yumlembam commented Jul 14, 2021

Can you please reply what is kl loss kl_loss = 1 / x.size(0) * self.kl_loss() in the loss function. It will be very helpful.

TommyGiak commented May 31, 2023

It is the Kullback–Leibler divergence between the z distribution and a standard Normal distribution.
For more details look at this:
https://towardsdatascience.com/understanding-variational-autoencoders-vaes-f70510919f73

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment