Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
int8 dynamic prefill weight only decode #1436
int8 dynamic prefill weight only decode #1436
Changes from 1 commit
f390fd9
67937a9
6b62266
aa4c9df
6b1ede1
3c07c40
a6c7de9
3660766
ddf2e10
ad4d3b0
653587e
c757357
f1b0841
afeaff5
c294765
803e9b3
eb18850
2642212
4eccdb9
13e6fd6
608d70c
b1f1796
30a4fac
6091592
17f9121
75d0a0b
b2fba99
ba5665d
4fdfa7b
111babc
35f1fc7
23f981d
74c52ff
eed072d
67cbcbb
0e579ae
443db19
054717e
2e5b72a
2b81dd6
de2d447
c0fa0da
584c013
38d60c7
97cca7a
525053b
4da1b31
2517406
5b8a28c
e25b30c
a58e0fd
ea5cb0c
17a191a
8899435
a3056ff
67a1a35
1554a8c
5161364
562191f
bf18806
89f03d8
ce58e1e
b144a53
File filter
Filter by extension
Conversations
Jump to
There are no files selected for viewing