Skip to content

convert : handle tokenizer merges format from transformers 4.45#9696

Merged
ggerganov merged 2 commits intomasterfrom compilade/convert-merges-pairs-to-oldOct 3, 2024
+24-2

Commits