Tool call support (Llama 3.x, Functionary v3, Hermes 2 Pro, Mistral Nemo, generic) w/ lazy grammars & minimalist Jinja engine #15532
Job | Run time |
---|---|
6m 43s | |
1m 6s | |
45s | |
39s | |
1m 2s | |
8m 35s | |
46s | |
55s | |
2m 13s | |
1m 53s | |
54s | |
1s | |
8m 2s | |
8m 38s | |
8m 34s | |
38s | |
1s | |
1m 49s | |
38s | |
22s | |
1m 12s | |
10m 2s | |
44s | |
1m 35s | |
7m 41s | |
5m 4s | |
21s | |
1m 30s | |
38s | |
1m 25s | |
2m 4s | |
28s | |
6s | |
2m 50s | |
52s | |
1m 34s | |
1s | |
1m 14s | |
1m 14s | |
7m 33s | |
0s | |
1s | |
1h 42m 23s |