You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When I use convert_hf_to_gguf.py to convert an embedding model with a pooler + dense structure into GGUF, the output vector dimension of the original model is 1792. However, after the conversion, the output vector dimension is 1024, which means it only includes the output of the pooler part and does not include the full pooler + dense structure.
What should I do to achieve a complete conversion? Thank you.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
When I use
convert_hf_to_gguf.pyto convert an embedding model with a pooler + dense structure into GGUF, the output vector dimension of the original model is 1792. However, after the conversion, the output vector dimension is 1024, which means it only includes the output of the pooler part and does not include the full pooler + dense structure.What should I do to achieve a complete conversion? Thank you.
Beta Was this translation helpful? Give feedback.
All reactions