This repository has been archived by the owner on Aug 30, 2024. It is now read-only.
[Neural Speed] Support continuous batching + beam search inference in LLAMA #452
Job | Run time |
---|---|
1m 45s | |
1m 18s | |
1m 31s | |
1m 15s | |
11m 27s | |
17m 16s |