[email protected]

0.9.0 and 0.9.1 packs significant improvements to the reliability and performance of VoiceAssistant.

The main changes are:

• Rework of audio publishing/buffering to reduce glitches caused by Python's asyncio scheduler
• Limiting number of prewarm workers that are spawned
• Introducing lk.agent.state attribute to allow client to detect state of VoiceAssistant: speaking, listening, etc
  • Works out of the box with JS Components 2.6.0. See example frontend
• Fixed a rare case where Agent wouldn't reconnect to room after being disconnected
• Additional control for VoiceAssistant
  • min_endpointing_delay: control over how quickly the agent should respond when the user pauses (longer delay reduces agent interruptions)
  • before_llm_cb: ability to control what is being sent to the LLM
  • before_tts_cb: ability to modify text before it's sent to TTS

Detailed Changelog

Patch Changes

• fix VoiceAssisstant being stuck when interrupting before user speech is committed - #790 (@coderlxn)

• Fix function for OpenAI Assistants - #784 (@keepingitneil)