Skip to content

Commit

Permalink
fix
Browse files Browse the repository at this point in the history
  • Loading branch information
epwalsh committed Nov 19, 2024
1 parent 5741484 commit 1054dc3
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions src/olmo_core/nn/lm_head.py
Original file line number Diff line number Diff line change
Expand Up @@ -80,6 +80,7 @@ def __init__(
bias: bool = True,
init_device: str = "cpu",
):
super().__init__()
self.norm = (
None if layer_norm is None else layer_norm.build(d_model, init_device=init_device)
)
Expand Down

0 comments on commit 1054dc3

Please sign in to comment.