Tool call support (Llama 3.x, Functionary v3, Hermes 2 Pro, Mistral Nemo, generic) w/ lazy grammars & minimalist Jinja engine #15583
| Job | Run time |
|---|---|
| 1m 35s | |
| 14m 33s | |
| 12m 14s | |
| 8m 59s | |
| 9m 32s | |
| 9m 0s | |
| 1m 30s | |
| 2m 3s | |
| 1m 22s | |
| 1m 5s | |
| 35s | |
| 1m 13s | |
| 17m 1s | |
| 50s | |
| 1m 29s | |
| 1m 14s | |
| 11m 30s | |
| 42s | |
| 1m 57s | |
| 1m 22s | |
| 1m 33s | |
| 2m 38s | |
| 9m 51s | |
| 5m 42s | |
| 1s | |
| 51m 22s | |
| 6m 8s | |
| 53m 45s | |
| 4m 35s | |
| 10m 39s | |
| 3m 39s | |
| 5m 17s | |
| 3m 48s | |
| 1s | |
| 11m 43s | |
| 3m 9s | |
| 1s | |
| 1s | |
| 27m 3s | |
| 2m 28s | |
| 0s | |
| 1s | |
| 5h 3m 11s |