This repository has been archived by the owner on Aug 30, 2024. It is now read-only.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
[Neural Speed] Support continuous batching + beam search inference in LLAMA #145
[Neural Speed] Support continuous batching + beam search inference in LLAMA #145
Changes from 1 commit
4c2ed49
5218757
df0de79
b752811
3d7107b
dcccf6e
1ef5229
2fd9389
b869ee9
7e09822
673b24d
8a4028a
1260483
a560433
ac41d13
b630401
File filter
Filter by extension
Conversations
Jump to
There are no files selected for viewing