-
Is it possible to read data from a stream on a server side by chunks and send them to a client? I'm making a simple app on top of LLM and it is going to be a long running task which i would like to run in a subprocess and read ready data from it by chunks sending them to a client on the go. I see that internally Websocket is used to send data to a client. |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments 10 replies
-
It will be possible soon. You'll need to use our upcoming Once this is released released, your scenario will require attaching a receiver/listener on the client/server respectively. |
Beta Was this translation helpful? Give feedback.
-
Sounds good, then at the next try i'll pay more attention my local enviroment. |
Beta Was this translation helpful? Give feedback.
I'm still spawning a subprocess in the example I gave so I don't think that's the issue. The only thing I can think of is that, somehow, you were creating too many processes. From the example you gave I wasn't able to trigger a situation where that happened. I guess we can revisit this if it comes up again.