Llama model doesn't answer

[shkim-emily]

when I type a command like above, it doesn't answer.. what is the problem? I use the docker image

[joennlae]

Thank you for the question :-)

Did you also download and build the model and llama.cpp like done here:

riscv-llm/test/src/llama.cpp/test.mk

Lines 2 to 10 in b118853

	test-llama:
	# download llama.cpp
	$(RUN) "git clone https://github.com/ggerganov/llama.cpp.git"
	# building llama.cpp
	$(RUN) "cd llama.cpp && CC=gcc-13 CXX=g++-13 make -j 2"
	# download Llama 7B chat model Q4_K_M https://huggingface.co/TheBloke/Llama-2-7b-Chat-GGUF
	$(RUN) "cd llama.cpp/models/ && wget -q https://huggingface.co/TheBloke/Llama-2-7b-Chat-GGUF/resolve/main/llama-2-7b-chat.Q4_K_M.gguf"
	# run an inference on RISC-V
	$(RUN) "cd llama.cpp && ./main -m models/llama-2-7b-chat.Q4_K_M.gguf -p \"What do you think about RISC-V?\" -n 100 -e"

?