How to stream the tool invocation steps to the client for display #1908
Unanswered
kalcifield
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I am curious if its possible to stream the function calls in the Assistant response right before doing it, so the user knows what process is going on in the background. Like in the case of perplexity:
I am using the bedrock converse implementation.
I suppose the proxy toolcall might be of use, but I would prefer to extend the original assistant message on the fly
Beta Was this translation helpful? Give feedback.
All reactions