server: cancel prompt processing & non-streamed requests when connection closed
#4202
| Job | Run time |
|---|---|
| 7s | |
| 7s |
server: cancel prompt processing & non-streamed requests when connection closed
#4202
| Job | Run time |
|---|---|
| 7s | |
| 7s |