server: cancel prompt processing & non-streamed requests when connection closed
#777
| Job | Run time |
|---|---|
| 1m 4s | |
| 1m 4s |
server: cancel prompt processing & non-streamed requests when connection closed
#777
| Job | Run time |
|---|---|
| 1m 4s | |
| 1m 4s |