Feature request: YOLO-World/Grounding DINO (Zero shot object detection)

[rogueturnip]

Question

Hi!

I'm trying out some of the zero shot capabilities and I've been working with the owlv2 but I was wondering, is support for yolo-world and grounding Dino coming? They seem to be faster than owlv2.

Thanks!

[xenova]

Grounding DINO was added to transformers ~2 months ago in huggingface/transformers#26087, so it's definitely possible! Maybe a contributor would like to get the ONNX conversion working in Optimum - that would unblock us and allow us to add it to Transformers.js

[rogueturnip]

Thanks for that! Looks like the feature request for Optimum was made last month huggingface/optimum#1849

[pacozaa]

Following this one!