server: cancel prompt processing & non-streamed requests when connection closed
#4199
| Job | Run time |
|---|---|
| 6s | |
| 6s |
server: cancel prompt processing & non-streamed requests when connection closed
#4199
| Job | Run time |
|---|---|
| 6s | |
| 6s |