Skip to content

Commit

Permalink
fix
Browse files Browse the repository at this point in the history
  • Loading branch information
NormanTUD committed Jul 17, 2024
1 parent 3b6d037 commit da1d146
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion explain.js
Original file line number Diff line number Diff line change
Expand Up @@ -1940,7 +1940,7 @@ function model_to_latex () {
& \\hspace{5mm}\\textbf{if} \\: \\lambda \\neq 0 & \\text{If weight decay is not zero} \\\\
& \\hspace{10mm} g_t \\leftarrow g_t + \\lambda \\theta_{t-1} & \\text{Add weight decay term to the gradient} \\\\
& \\hspace{5mm}\\textbf{if} \\: \\mu \\neq 0 & \\text{If momentum is used} \\\\
& \\hspace{10mm}\\textbf{if} \\: t > 1 & \\text{If t > 1} \\\\
& \\hspace{10mm}\\textbf{if} \\: t > 1 & \\\\
& \\hspace{15mm} \\textbf{b}_t \\leftarrow \\mu \\textbf{b}_{t-1} + (1-\\tau) g_t & \\text{Update the buffer with momentum and dampening} \\\\
& \\hspace{10mm}\\textbf{else} & \\\\
& \\hspace{15mm} \\textbf{b}_t \\leftarrow g_t & \\text{Set the buffer to the gradient} \\\\
Expand Down

0 comments on commit da1d146

Please sign in to comment.