Skip to content

Commit

Permalink
Fix error message in float8 FSDP utils (#1423)
Browse files Browse the repository at this point in the history
fix error message in float8 fsdp utils

Co-authored-by: Daniel Vega-Myhre <[email protected]>
  • Loading branch information
danielvegamyhre and Daniel Vega-Myhre authored Dec 17, 2024
1 parent cbd7c29 commit ae28114
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion torchao/float8/fsdp_utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -45,7 +45,7 @@ def precompute_float8_dynamic_scale_for_fsdp(module: nn.Module) -> None:
isinstance(m, Float8Linear) and m.scaling_type_weight is ScalingType.DELAYED
for m in module.modules()
):
raise NotImplementedError("Only supports delayed scaling")
raise NotImplementedError("Only supports dynamic scaling")
float8_linears: List[Float8Linear] = [
m
for m in module.modules()
Expand Down

0 comments on commit ae28114

Please sign in to comment.