Skip to content
CI

server: cancel prompt processing & non-streamed requests when connection closed #15612

Sign in to view logs

server: cancel prompt processing & non-streamed requests when connection closed

server: cancel prompt processing & non-streamed requests when connection closed #15612

Annotations

1 error

windows-latest-cmake (avx512-x64, -DGGML_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DGGML_RPC=ON -DGGML_...

windows-latest-cmake (avx512-x64, -DGGML_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DGGML_RPC=ON -DGGML_...
succeeded Sep 29, 2024 in 11m 2s