Skip to content

Commit

Permalink
[pre-commit.ci] auto fixes from pre-commit.com hooks
Browse files Browse the repository at this point in the history
for more information, see https://pre-commit.ci
  • Loading branch information
pre-commit-ci[bot] committed Nov 15, 2024
1 parent 6fe0708 commit ddb6134
Showing 1 changed file with 5 additions and 3 deletions.
8 changes: 5 additions & 3 deletions AgentQnA/docker_compose/intel/hpu/gaudi/README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Single node on-prem deployment AgentQnA on Gaudi

This example showcases a hierarchical multi-agent system for question-answering applications. We deploy the example on Gaudi using open-source LLMs,
This example showcases a hierarchical multi-agent system for question-answering applications. We deploy the example on Gaudi using open-source LLMs,
For more details, please refer to the deployment guide [here](../../../../README.md).

## Deployment with docker
Expand All @@ -26,8 +26,8 @@ For more details, please refer to the deployment guide [here](../../../../README
# for using open-source llms
export HUGGINGFACEHUB_API_TOKEN=<your-HF-token>
# Example export HF_CACHE_DIR=$WORKDIR so that no need to redownload every time
export HF_CACHE_DIR=<directory-where-llms-are-downloaded>
export HF_CACHE_DIR=<directory-where-llms-are-downloaded>
```

3. Deploy the retrieval tool (i.e., DocIndexRetriever mega-service)
Expand All @@ -53,11 +53,13 @@ For more details, please refer to the deployment guide [here](../../../../README
5. Launch `Agent` service

To use open-source LLMs on Gaudi2, run commands below.

```
cd $WORKDIR/GenAIExamples/AgentQnA/docker_compose/intel/hpu/gaudi
bash launch_tgi_gaudi.sh
bash launch_agent_service_tgi_gaudi.sh
```

6. [Optional] Build `Agent` docker image if pulling images failed.

```
Expand Down

0 comments on commit ddb6134

Please sign in to comment.