Skip to content
This repository has been archived by the owner on Aug 30, 2024. It is now read-only.

Commit

Permalink
Merge branch 'mixtral' of https://github.com/intel/neural-speed into …
Browse files Browse the repository at this point in the history
…mixtral
  • Loading branch information
intellinjun committed Feb 23, 2024
2 parents 4a01f65 + 9f56f45 commit 38a368b
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion neural_speed/convert/convert_mistral.py
Original file line number Diff line number Diff line change
Expand Up @@ -1062,7 +1062,7 @@ def write_file_header(self, params: Params, file_type: NEFileType) -> None:
self.fout.write(struct.pack("i", 0))
self.fout.write(struct.pack("i", params.ffn_hidden_size))
self.fout.write(struct.pack("i", 0))

self.fout.write(struct.pack("i", 0))
self.fout.write(struct.pack("i", 0))
self.fout.write(struct.pack("f", params.rms_norm_eps))
Expand Down

0 comments on commit 38a368b

Please sign in to comment.