Improve vlm support (add idefics3 support)#2437

Open

drbh wants to merge 12 commits intomainfrom improve-vlm-support

+1,430-21

Commits on Dec 19, 2024

feat: consolidate changes with existing vlms and add support and test for smolvlm
drbh
committed

Commits on Dec 21, 2024

fix: create new idefic3 file, simplify logic and adjust llama weight loading
drbh
committed

Commits on Dec 23, 2024

fix: lint with ruff
drbh
committed