rpc : track allocated buffers (#7411) · CISC/llama.cpp@db10f01 · GitHub

Commit

rpc : track allocated buffers (ggerganov#7411)

Browse files

* rpc : track allocated buffers

ref: ggerganov#7407

* rpc : pack rpc_tensor tightly

Loading branch information

rgerganov authored May 20, 2024

1 parent 3bc10cb commit db10f01