Skip to content

Commit

Permalink
Update comment for AdamW implementation reference. (ggerganov#4604)
Browse files Browse the repository at this point in the history
Co-authored-by: Will Findley <[email protected]>
  • Loading branch information
WillCorticesAI and WillFindley authored Dec 26, 2023
1 parent 77465da commit de8e496
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions ggml.c
Original file line number Diff line number Diff line change
Expand Up @@ -17456,9 +17456,9 @@ static void ggml_opt_acc_grad(int np, struct ggml_tensor * const ps[], float * g
}

//
// ADAM
// Using AdamW - ref: https://arxiv.org/pdf/1711.05101v3.pdf
//
// ref: https://arxiv.org/pdf/1412.6980.pdf
// (Original Adam - ref: https://arxiv.org/pdf/1412.6980.pdf)
//

static enum ggml_opt_result ggml_opt_adam(
Expand Down

0 comments on commit de8e496

Please sign in to comment.