Skip to content

server: cancel prompt processing & non-streamed requests when connection closed #15623

server: cancel prompt processing & non-streamed requests when connection closed

server: cancel prompt processing & non-streamed requests when connection closed #15623

windows-latest-cmake (avx-x64, -DGGML_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DGGML_RPC=ON -DGGML_AVX...

succeeded Sep 29, 2024 in 10m 13s