Skip to content

Commit

Permalink
Merge remote-tracking branch 'upstream/master' into single-package
Browse files Browse the repository at this point in the history
  • Loading branch information
ilya-lavrenov committed Aug 2, 2024
2 parents d10bf1b + 4e66950 commit cb4cab4
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 2 deletions.
2 changes: 2 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,11 +20,13 @@ It includes the following pipelines:
2. Text generation samples that support most popular models like LLaMA 2:
- Python:
1. [beam_search_causal_lm](./samples/python/beam_search_causal_lm/README.md)
1. [benchmark_genai](./samples/python/benchmark_genai/README.md)
2. [chat_sample](./samples/python/chat_sample/README.md)
3. [greedy_causal_lm](./samples/python/greedy_causal_lm/README.md)
4. [multinomial_causal_lm](./samples/python/multinomial_causal_lm/README.md)
- C++:
1. [beam_search_causal_lm](./samples/cpp/beam_search_causal_lm/README.md)
1. [benchmark_genai](./samples/cpp/benchmark_genai/README.md)
2. [chat_sample](./samples/cpp/chat_sample/README.md)
3. [continuous_batching_accuracy](./samples/cpp/continuous_batching_accuracy)
4. [continuous_batching_benchmark](./samples/cpp/continuous_batching_benchmark)
Expand Down
4 changes: 2 additions & 2 deletions samples/cpp/benchmark_genai/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ optimum-cli export openvino --trust-remote-code --model TinyLlama/TinyLlama-1.1B
## Usage

```sh
benchmark_vanilla_genai [OPTIONS]
benchmark_genai [OPTIONS]
```

### Options
Expand All @@ -31,7 +31,7 @@ benchmark_vanilla_genai [OPTIONS]
### Output:

```
benchmark_vanilla_genai -m TinyLlama-1.1B-Chat-v1.0 -n 10
benchmark_genai -m TinyLlama-1.1B-Chat-v1.0 -n 10
```

```
Expand Down

0 comments on commit cb4cab4

Please sign in to comment.