Skip to content

Commit

Permalink
Update cancel.feature
Browse files Browse the repository at this point in the history
  • Loading branch information
ochafik committed Sep 29, 2024
1 parent 231a5e4 commit c5a0d57
Showing 1 changed file with 0 additions and 2 deletions.
2 changes: 0 additions & 2 deletions examples/server/tests/features/cancel.feature
Original file line number Diff line number Diff line change
Expand Up @@ -18,10 +18,8 @@ Feature: Cancellation of llama.cpp server requests
And 64 server max tokens to predict
And prometheus compatible metrics exposed
And 300 milliseconds delay in sampler for testing
And no warmup
Then the server is starting
Then the server is healthy
# Then the server is healthy with timeout 10 seconds


Scenario Outline: Cancelling an OAI chat completion request frees up slot (streaming <enable_streaming>)
Expand Down

0 comments on commit c5a0d57

Please sign in to comment.