Skip to content

Commit

Permalink
Dispatch data in the bfloat16 format and let downstream deal with
Browse files Browse the repository at this point in the history
the conversion. This fixes things on Metal.
  • Loading branch information
sobomax committed May 27, 2024
1 parent 86447f6 commit 252a7ca
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion HelloSippyTTSRT/HelloSippyRTPipe.py
Original file line number Diff line number Diff line change
Expand Up @@ -249,7 +249,7 @@ def unbatch_and_dispatch(self, state:HelloSippyPipeStateBatched):
endoff = min(asize, asize - (((state.idx - ends_at) * stepsize) if (ends_at:=state.ends_at[i].item()) >=0 else 0))
assert startoff <= endoff
if startoff != endoff:
dispatch(audio[i][startoff:endoff].to(torch.float16).cpu())
dispatch(audio[i][startoff:endoff].cpu())
if ends_at >= 0 and ends_at <= end_idx:
dispatch(None)
state.dispatch[i] = None
Expand Down

0 comments on commit 252a7ca

Please sign in to comment.