Skip to content
This repository has been archived by the owner on Aug 30, 2024. It is now read-only.

[Neural Speed] Support continuous batching + beam search inference in LLAMA #428

[Neural Speed] Support continuous batching + beam search inference in LLAMA

[Neural Speed] Support continuous batching + beam search inference in LLAMA #428

Triggered via pull request March 1, 2024 07:48
Status Cancelled
Total duration 30s
Artifacts

cpp-graph-test.yml

on: pull_request
Matrix: CPP-Graph-Workflow
Genreate-Report
0s
Genreate-Report
Fit to window
Zoom out
Zoom in

Annotations

2 errors
CPP-Graph-Workflow (llama-2-7b-chat)
Canceling since a higher priority waiting request for 'CPP Graph Test-145' exists
CPP-Graph-Workflow (gptj-6b)
Canceling since a higher priority waiting request for 'CPP Graph Test-145' exists