Skip to content
This repository has been archived by the owner on Aug 30, 2024. It is now read-only.
CPP Graph Test

[Neural Speed] Support continuous batching + beam search inference in LLAMA #428

Sign in to view logs

[Neural Speed] Support continuous batching + beam search inference in LLAMA

[Neural Speed] Support continuous batching + beam search inference in LLAMA #428

Run time

Learn about OS pricing on GitHub Actions
Job Run time
CPP-Graph-Workflow (llama-2-7b-chat)
1s
CPP-Graph-Workflow (gptj-6b)
1s
Genreate-Report
1s
3s