Skip to content

Commit

Permalink
fix: wrong documentation of ignore_unused_parameters (#4418)
Browse files Browse the repository at this point in the history
Co-authored-by: Olatunji Ruwase <[email protected]>
Co-authored-by: Logan Adams <[email protected]>
  • Loading branch information
3 people authored Oct 3, 2023
1 parent cd0d2ba commit 986b595
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion deepspeed/runtime/zero/config.py
Original file line number Diff line number Diff line change
Expand Up @@ -236,7 +236,7 @@ class DeepSpeedZeroConfig(DeepSpeedConfigModel):
Unused parameters in modules may be unexpected in static networks, but
could be normal in dynamic networks. This controls whether or not training
should terminate with an error message when unused parameters are detected.
This is set to ``False`` by default, which means unused parameters are
This is set to ``True`` by default, which means unused parameters are
ignored and training continues. Now is just used in stage 2.
"""

Expand Down

0 comments on commit 986b595

Please sign in to comment.