This repository has been archived by the owner on Aug 30, 2024. It is now read-only.
[Neural Speed] Support continuous batching + beam search inference in LLAMA #336
Job | Run time |
---|---|
7m 17s | |
7m 17s |
Job | Run time |
---|---|
7m 17s | |
7m 17s |