Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reduce time taken by STT / TTS #34

Open
celian-garcia opened this issue Feb 6, 2022 · 1 comment
Open

Reduce time taken by STT / TTS #34

celian-garcia opened this issue Feb 6, 2022 · 1 comment
Labels
enhancement New feature or request
Milestone

Comments

@celian-garcia
Copy link
Member

As per the previous study #30 , we can identify time taking tasks
image

WUW process

The trace starts when the program starts to listen for the Wake Up Word. That's why we have a lot of WUW processes
Once the keyword is detected, it instantly start the STT, so we can eliminate WUW from the cause.

STT process

Even deducing the time during which we are talking, 5 sec is still a lot of time. It can perhaps be improved using a local library, or using directly Google API instead of SpeechRecognition that does't seems to be very maintained.

HTTP POST

We can probably improve the backend's /talk/text API, to do that we need to have finer grain details of each span in the trace to identify big consumer(s)

TTS process

Not sure if the root cause is the TTS or the play function on the Rasp. To be checked with finer grain.

Summary

It can be improved in every aspect, but generally, a finer grain tracing would be required.

@celian-garcia celian-garcia added this to the backlog milestone Feb 6, 2022
@celian-garcia celian-garcia changed the title Improve time taken for STT / TTS Reduce time taken by STT / TTS Feb 6, 2022
@celian-garcia celian-garcia added the enhancement New feature or request label Oct 12, 2022
@celian-garcia
Copy link
Member Author

Might be interesting to follow this and retry https://wiki.linuxaudio.org/wiki/raspberrypi

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant