Skip to content

Commit

Permalink
Break copied from in pixtral
Browse files Browse the repository at this point in the history
  • Loading branch information
Rocketknight1 committed Dec 20, 2024
1 parent 2a85be1 commit 1c4b6f6
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion src/transformers/models/pixtral/modeling_pixtral.py
Original file line number Diff line number Diff line change
Expand Up @@ -126,7 +126,6 @@ def rotate_half(x):
return torch.cat((-x2, x1), dim=-1)


# Copied from transformers.models.llama.modeling_llama.apply_rotary_pos_emb
def apply_rotary_pos_emb(q, k, cos, sin, position_ids=None, unsqueeze_dim=1):
"""Applies Rotary Position Embedding to the query and key tensors.
Expand Down

0 comments on commit 1c4b6f6

Please sign in to comment.