Skip to content

Commit

Permalink
Idefics2: sync added image tokens with transformers (huggingface#2080)
Browse files Browse the repository at this point in the history 
Before this change, the number of reserved image tokens was not the
same as the number of images. Fixes huggingface#2029.

While at it, also remove all the image token handling duplication
in `prepare_input`.
  • Loading branch information
@danieldk @yuanwu2017
danieldk authored and yuanwu2017 committed Sep 24, 2024
1 parent 11fced7 commit d731866
Show file tree
Hide file tree
Showing 13 changed files with 1,556 additions and 1,329 deletions.
1 change: 1 addition & 0 deletions Cargo.lock
View file

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading

0 comments on commit d731866

Please sign in to comment.