Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
common : ensure llama_batch size does not exceed max size (ggerganov#…
…9668) A crash was observed when the number of tokens added to a batch exceeds llama_batch size. An assertion in llama_batch_add was added to protect against llama_batch size overflow.
- Loading branch information