I get an error when i want to export quantization bit. ValueError: Please merge adapters before quantizing the model. What does this mean? And how do i merge adapters? #2605
giannisanni
started this conversation in
General
Replies: 2 comments 2 replies
-
|
do not specify quantization_bit when merging the adapters |
Beta Was this translation helpful? Give feedback.
2 replies
-
|
To contribute, in web UI would be this drop down here |
Beta Was this translation helpful? Give feedback.
-
|
Hello, I chose 'none', but it seems to be unhelpful. Why is that? |
Beta Was this translation helpful? Give feedback.
-
|
Hello, I am encountering the same issue. Did you manage to resolve it? How did you solve it?thankyou |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
What does this mean? And how do i merge adapters?
Beta Was this translation helpful? Give feedback.
All reactions