Skip to content

Tool call support (Llama 3.x, Functionary v3, Hermes 2 Pro, Mistral Nemo, generic) w/ lazy grammars & minimalist Jinja engine #15532

Tool call support (Llama 3.x, Functionary v3, Hermes 2 Pro, Mistral Nemo, generic) w/ lazy grammars & minimalist Jinja engine

Tool call support (Llama 3.x, Functionary v3, Hermes 2 Pro, Mistral Nemo, generic) w/ lazy grammars & minimalist Jinja engine #15532

Job Run time
6m 43s
1m 6s
45s
39s
1m 2s
8m 35s
46s
55s
2m 13s
1m 53s
54s
1s
8m 2s
8m 38s
8m 34s
38s
1s
1m 49s
38s
22s
1m 12s
10m 2s
44s
1m 35s
7m 41s
5m 4s
21s
1m 30s
38s
1m 25s
2m 4s
28s
6s
2m 50s
52s
1m 34s
1s
1m 14s
1m 14s
7m 33s
0s
1s
1h 42m 23s