Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.
-
Updated
Nov 21, 2024 - C++
#
open-llm
Here are 7 public repositories matching this topic...
✨ Kubectl plugin to create manifests with LLMs
kubernetes
ai
openai
k8s
kubectl
gpt
hacktoberfest
kubectl-plugins
openai-api
gpt-4
llm
chatgpt
open-llm
localllama
-
Updated
Dec 2, 2024 - Go
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
docker
kubernetes
ai
inference
nvidia
openai
llama
gpt
gemma
mistral
fine-tuning
finetuning
buildkit
large-language-models
llm
chatgpt
open-llm
open-source-llm
localllama
mixtral
-
Updated
Dec 3, 2024 - Go
The code for HerO: a fact-checking pipeline based on open LLMs (the runner-up in AVeriTeC)
-
Updated
Nov 22, 2024 - Python
Improve this page
Add a description, image, and links to the open-llm topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the open-llm topic, visit your repo's landing page and select "manage topics."