Skip to content

Commit

Permalink
readme : add llama-swap to infrastructure section (#11032)
Browse files Browse the repository at this point in the history
* list llama-swap under tools in README

* readme: add llama-swap to Infrastructure
  • Loading branch information
mostlygeek authored Jan 2, 2025
1 parent 0827b2c commit a45433b
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -201,6 +201,7 @@ Instructions for adding support for new models: [HOWTO-add-model.md](docs/develo
- [Paddler](https://github.com/distantmagic/paddler) - Stateful load balancer custom-tailored for llama.cpp
- [GPUStack](https://github.com/gpustack/gpustack) - Manage GPU clusters for running LLMs
- [llama_cpp_canister](https://github.com/onicai/llama_cpp_canister) - llama.cpp as a smart contract on the Internet Computer, using WebAssembly
- [llama-swap](https://github.com/mostlygeek/llama-swap) - transparent proxy that adds automatic model switching with llama-server

</details>

Expand Down

0 comments on commit a45433b

Please sign in to comment.