Skip to content

Commit

Permalink
Apply suggestions from code review
Browse files Browse the repository at this point in the history
  • Loading branch information
ArthurZucker authored Feb 15, 2024
1 parent c9f3c82 commit 5f54d84
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion src/transformers/models/llama/modeling_llama.py
Original file line number Diff line number Diff line change
Expand Up @@ -1013,7 +1013,6 @@ def forward(
all_hidden_states += (hidden_states,)

next_cache = None
# if use_cache and isinstance(next_decoder_cache, (DynamicCache, SinkCache)):
if use_cache:
next_cache = (
next_decoder_cache.to_legacy_cache() if isinstance(next_decoder_cache, Cache) else next_decoder_cache
Expand Down

0 comments on commit 5f54d84

Please sign in to comment.