Skip to content
This repository has been archived by the owner on Aug 30, 2024. It is now read-only.

[Neural Speed] Support continuous batching + beam search inference in LLAMA #444

[Neural Speed] Support continuous batching + beam search inference in LLAMA

[Neural Speed] Support continuous batching + beam search inference in LLAMA #444

Annotations

1 warning

CPP-Graph-Workflow (llama-2-7b-chat)

succeeded Mar 4, 2024 in 3m 47s