Skip to content

Commit

Permalink
py : fix lint (#4889)
Browse files Browse the repository at this point in the history
  • Loading branch information
ggerganov committed Jan 12, 2024
1 parent f445c0e commit 2d00741
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion convert-hf-to-gguf.py
Original file line number Diff line number Diff line change
Expand Up @@ -825,7 +825,7 @@ def set_gguf_parameters(self):
# NOTE: not sure about this change - why does the model not have a rope dimension count when it is smaller
# than the head size?
# ref: https://github.com/ggerganov/llama.cpp/pull/4889
#self.gguf_writer.add_rope_dimension_count(hidden_size // head_count)
# self.gguf_writer.add_rope_dimension_count(hidden_size // head_count)
self.gguf_writer.add_rope_dimension_count(hidden_size // head_count // 2)

self.gguf_writer.add_head_count(head_count)
Expand Down

0 comments on commit 2d00741

Please sign in to comment.