Anyone got a tutorial on how to get llama 75b running through this on runpod? #208
austin23cook
started this conversation in
General
Replies: 1 comment
-
|
This is the guide for this repo: https://github.com/oobabooga/text-generation-webui/wiki/LLaMA-model doesn’t look too advanced/difficult, if it works. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Not a lot of interest yet, so I'm having trouble finding instructions. I could probably figure it out on my own eventually but as I don't even know if 1 A100 80g would be enough I'd rather not start burning money until I'm sure I've got it down.
Beta Was this translation helpful? Give feedback.
All reactions