new release for gguf package

[jaideepr97]

Hi all - correct me if I'm wrong, but I believe the gguf pypi package is published out of https://github.com/ggerganov/llama.cpp/tree/master/gguf-py/gguf
The latest release (v0.10.0) was published in August 2024

I have noticed that there have been a lot of additions to that package since the last release, including recognition for new model architectures like granite
I am in need of consuming these new changes and wanted to see if I could request a new release for the GGUF package?
(cc @gabe-l-hart )

On a separate note, I am also interested in consuming the convert_hf_to_gguf.py script in my code, but have not found a good way to import it since it is not published anywhere (to my knowledge), requiring me to manually copy the script and make it fit my needs
If anyone has ideas on better ways to consume that, I'd be interested as well
Thanks!

[ggerganov]

I've bumped the version: #10788
Please ping me if there is no new package published. I forgot if I have to manually tag the release, or if some CI workflow will automatically do it.

On a separate note, I am also interested in consuming the convert_hf_to_gguf.py script in my code, but have not found a good way to import it since it is not published anywhere (to my knowledge), requiring me to manually copy the script and make it fit my needs
If anyone has ideas on better ways to consume that, I'd be interested as well

For now, you should manually synchronize it. We don't have plans to publish it since it would be too difficult to maintain backwards compat.

[jaideepr97]

ack, thanks for the quick response!

[jaideepr97]

@ggerganov looks like pypi is still pointing to 0.10.0

[ggerganov]

Yes, I was thinking that the workflow will start automatically, but it's not the case. Just launched it manually: https://github.com/ggerganov/llama.cpp/actions/runs/12300483697. Let's see if it works.

[jaideepr97]

its published now, thanks!

[gabe-l-hart]

Thanks for the quick turn around!