server
: cancel prompt processing & non-streamed requests when connection closed
#7038
Job | Run time |
---|---|
2m 49s | |
3m 22s | |
8m 6s | |
2m 22s | |
16m 39s |