Skip to content
This repository has been archived by the owner on Aug 30, 2024. It is now read-only.
CPP Graph Test

[Neural Speed] Support continuous batching + beam search inference in LLAMA #406

Sign in to view logs

[Neural Speed] Support continuous batching + beam search inference in LLAMA

[Neural Speed] Support continuous batching + beam search inference in LLAMA #406

Annotations

2 errors

CPP-Graph-Workflow (gptj-6b)

CPP-Graph-Workflow (gptj-6b)
cancelled Feb 29, 2024 in 3m 23s