Tool call support (Llama 3.x, Functionary v3, Hermes 2 Pro, Mistral Nemo, generic) w/ lazy grammars & minimalist Jinja engine #15575
| Job | Run time |
|---|---|
| 2m 30s | |
| 2m 31s | |
| 2m 19s | |
| 2m 34s | |
| 1m 58s | |
| 1m 45s | |
| 1m 35s | |
| 1m 48s | |
| 28s | |
| 27s | |
| 47s | |
| 2m 23s | |
| 1s | |
| 1s | |
| 1s | |
| 23s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 2m 11s | |
| 1m 27s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 0s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 25m 32s |