Skip to content

Commit

Permalink
Add enabling utf8 mode note to readme
Browse files Browse the repository at this point in the history
  • Loading branch information
yatarkan committed Jul 18, 2024
1 parent 6a38d83 commit c851700
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions samples/cpp/beam_search_causal_lm/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ optimum-cli export openvino --trust-remote-code --model TinyLlama/TinyLlama-1.1B
`beam_search_causal_lm TinyLlama-1.1B-Chat-v1.0 "Why is the Sun yellow?"`

To enable Unicode characters for Windows cmd open `Region` settings from `Control panel`. `Administrative`->`Change system locale`->`Beta: Use Unicode UTF-8 for worldwide language support`->`OK`. Reboot.
Also, you can enable UTF-8 mode by setting environment variable `PYTHONIOENCODING="utf8"`.

Discrete GPUs (dGPUs) usually provide better performance compared to CPUs. It is recommended to run larger models on a dGPU with 32GB+ RAM. For example, the model meta-llama/Llama-2-13b-chat-hf can benefit from being run on a dGPU. Modify the source code to change the device for inference to the GPU.

Expand Down

0 comments on commit c851700

Please sign in to comment.