Skip to content

Commit

Permalink
server: tests: change model to: @karpathy's tinyllamas
Browse files Browse the repository at this point in the history
  • Loading branch information
phymbert committed Feb 20, 2024
1 parent 8bb586b commit 6c95ec6
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 4 deletions.
4 changes: 2 additions & 2 deletions .github/workflows/server-test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -40,12 +40,12 @@ jobs:
- name: Download test model
id: download_model
run: |
./scripts/hf.sh --repo ngxson/dummy-llama --file llama_xs_q4.bin
./scripts/hf.sh --repo ggml-org/models --file tinyllamas/stories260K.gguf
- name: Server Integration Tests
id: server_integration_test
run: |
cd examples/server/tests
./tests.sh ../../../llama_xs_q4.bin
./tests.sh ../../../stories260K.gguf
4 changes: 2 additions & 2 deletions examples/server/tests/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,5 +7,5 @@ Functional server tests suite.

### Run tests
1. Build the server
2. download a GGUF model: `../../../scripts/hf.sh --repo ngxson/dummy-llama --file llama_xs_q4.bin`
3. Start the test: `./tests.sh tinyllama-2-1b-miniguanaco.Q2_K.gguf -ngl 23 --log-disable`
2. download a GGUF model: `./scripts/hf.sh --repo ggml-org/models --file tinyllamas/stories260K.gguf`
3. Start the test: `./tests.sh stories260K.gguf -ngl 23`

0 comments on commit 6c95ec6

Please sign in to comment.