Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement whisper.cpp #51

Open
ericcurtin opened this issue Aug 21, 2024 · 3 comments
Open

Implement whisper.cpp #51

ericcurtin opened this issue Aug 21, 2024 · 3 comments

Comments

@ericcurtin
Copy link
Collaborator

ericcurtin commented Aug 21, 2024

If there is a way to auto-detect between language model files and asr model files. We should do that, or if that's not possible we should just use a runtime flag, so some options for the runtime flag would be:

ramalama --runtime vllm
ramalama --runtime llama.cpp
ramalama --runtime whisper.cpp
@ericcurtin
Copy link
Collaborator Author

We added a basic version of whisper.cpp to the Container image here:

#49

@rhatdan
Copy link
Member

rhatdan commented Oct 14, 2024

Can this be closed? Do we have this functionality now?

@ericcurtin
Copy link
Collaborator Author

There's still more work for both --runtime whisper.cpp and --runtime vllm ... It can be tracked under this issue or somewhere else.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants