[EAGLE-5211] Refract openai whisper example #103
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What
generate
method i.e it will transcribe the the audio file in the stream way even though openai whisper API don't support streaminggenerate
andstream
methods for batch requestsmodel.py
code is more readableHow
We got the input audio in bytes, first split the original audio into chunks of audios, Each chunk is a valid WAV file with proper headers, allowing them to be processed independently, then run the whisper API for each audio WAV file also ensuring that batch requests also supported.
Test
Tested this model example locally using local dev runner