Structured JSON Generation

[AvivSham]

Hi All,
Thank you for your amazing work!
Where can we find a list of models that support Structured JSON Generation? Do all the models support that?
We were able to find a list of models in the HF playground, however, we do not know if this list is updated.

We are looking for a small LLM model (<1B) that supports structured JSON Generation.

Cheers,

[CharlieFRuan]

Hi, thanks for the inquiry! There isn't an official list of models that support it -- our mechanism (https://github.com/mlc-ai/xgrammar) is model-agnostic. However, some models may just be better at it.

From my experience, Llama3.1, 3.2, Phi3.5, Qwen2.5, Gemma2 are all pretty good at it. You can try it out on your own, perhaps with some correctness benchmarking with datasets like https://huggingface.co/datasets/NousResearch/json-mode-eval