Tool call support (Llama 3.x, Functionary v3, Hermes 2 Pro, Mistral Nemo, generic) w/ lazy grammars & minimalist Jinja engine #15562
| Job | Run time |
|---|---|
| 7m 31s | |
| 1m 36s | |
| 1m 22s | |
| 18m 9s | |
| 9m 22s | |
| 2m 2s | |
| 1m 41s | |
| 1m 44s | |
| 1m 36s | |
| 54s | |
| 1m 57s | |
| 1m 12s | |
| 2m 17s | |
| 1m 42s | |
| 1m 36s | |
| 1m 30s | |
| 54s | |
| 7m 53s | |
| 9m 0s | |
| 1m 33s | |
| 5m 49s | |
| 53s | |
| 1m 13s | |
| 5m 22s | |
| 6m 27s | |
| 1m 44s | |
| 5m 45s | |
| 4m 54s | |
| 7m 55s | |
| 4m 14s | |
| 11m 13s | |
| 8s | |
| 3m 23s | |
| 4m 30s | |
| 3m 8s | |
| 5m 42s | |
| 1s | |
| 6m 34s | |
| 1m 17s | |
| 0s | |
| 55s | |
| 1s | |
| 2h 36m 39s |