Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Upgrade llama-cpp-python to latest version #49

Open
RomainMendez opened this issue Sep 23, 2023 · 2 comments
Open

[FEATURE] Upgrade llama-cpp-python to latest version #49

RomainMendez opened this issue Sep 23, 2023 · 2 comments
Assignees

Comments

@RomainMendez
Copy link

The version of llama-cpp-python this project uses is quite old. Therefore I get a lot of errors regarding versions of GGML models. It also doesn't support GGUF models.

I would suggest to up the version of llama-cpp-python to the latest one.

GGUF models are the future anyway it would seem.
Perhaps we could work on something that allows chosing ?

@iaalm
Copy link
Owner

iaalm commented Sep 26, 2023

Thanks for remaindering.👍

@iaalm
Copy link
Owner

iaalm commented Oct 15, 2023

This project actually depends on llamacpp-python. Seems their most recent version doesn't support gguf. I will see whether they can have an update.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants