Skip to content

Commit

Permalink
Putting back docker instruction.
Browse files Browse the repository at this point in the history
  • Loading branch information
chigkim committed Feb 18, 2024
1 parent 76f8d32 commit 5eb297c
Show file tree
Hide file tree
Showing 2 changed files with 26 additions and 2 deletions.
26 changes: 25 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,30 @@ ollama pull openhermes

Finally, Run VOLlama.exe

## Ollama with Docker

Instead of using Windows previous build, if you use Ollama with Docker, you might get a faster speed.

Run the command below in the command line to install Ollama:
```
docker run -d -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama
```

To download a model, execute the command below, replacing `openhermes` with a [different model](https://ollama.ai/library) as needed:
```
docker exec ollama ollama pull openhermes
```

To stop Ollama, execute the command below.
```
docker stop ollama
```

To run Ollama again, execute the command below.
```
docker start ollama
```

## Shortcuts

On Mac, press command key instead of control key.
Expand All @@ -26,7 +50,7 @@ If you're operating Ollama on a different machine, you can configure the host ad

## [Retrieval-Augmented Generation](https://blogs.nvidia.com/blog/what-is-retrieval-augmented-generation/)

* Go to Rag menu > Attach url.
* Go to Rag menu > index an url.
* Enter https://www.apple.com/apple-vision-pro/
* Wait until the document is indexed.
* In the message field, type "/q What can you do with Vision Pro?" without the quotes.
Expand Down
2 changes: 1 addition & 1 deletion changelog.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@
* Option to display context sent to RAG system
* Epub reader
* Global settings improvement
* [Retrieval-Augmented Generation](https://blogs.nvidia.com/blog/what-is-retrieval-augmented-generation/) (RAG): See below for insturction on how to use it.
* [Retrieval-Augmented Generation](https://blogs.nvidia.com/blog/what-is-retrieval-augmented-generation/) (RAG): See below for instruction on how to use it.
* Many bug fixes
* Generation parameters in advance menu
* Voice and rate gets saved into persistent settings
Expand Down

0 comments on commit 5eb297c

Please sign in to comment.