Skip to content

Commit

Permalink
[doc] fix typo
Browse files Browse the repository at this point in the history
  • Loading branch information
stas00 authored Dec 12, 2023
1 parent 78172dc commit a9e77da
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/source/en/perf_infer_gpu_one.md
Original file line number Diff line number Diff line change
Expand Up @@ -227,7 +227,7 @@ model.save_pretrained("saved_model")

bitsandbytes is a quantization library that includes support for 4-bit and 8-bit quantization. Quantization reduces your model size compared to its native full precision version, making it easier to fit large models onto GPUs with limited memory.

Make sure you have bitsnbytes and 🤗 Accelerate installed:
Make sure you have bitsandbytes and 🤗 Accelerate installed:

```bash
# these versions support 8-bit and 4-bit
Expand Down

0 comments on commit a9e77da

Please sign in to comment.