Skip to content

Commit

Permalink
fix docstring
Browse files Browse the repository at this point in the history
  • Loading branch information
warner-benjamin committed Jun 12, 2024
1 parent 6d72593 commit 4542d04
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion optimi/radam.py
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ class RAdam(OptimiOptimizer):
weight_decay: Weight decay coefficient. If `decouple_wd` and `decouple_lr` are False,
applies L2 penalty (default: 0)
eps: Added to denominator to improve numerical stability (default: 1e-6)
decouple_wd: Apply decoupled weight decay instead of L2 penalty (default: True)
decouple_wd: Apply decoupled weight decay instead of L2 penalty (default: False)
decouple_lr: Apply fully decoupled weight decay instead of L2 penalty (default: False)
max_lr: Maximum scheduled learning rate. Set if `lr` is not the maximum scheduled learning
rate and `decouple_lr` is True (default: None)
Expand Down

0 comments on commit 4542d04

Please sign in to comment.