From ddb6134a45067f1f15a6f96f7cc39bb28a41627b Mon Sep 17 00:00:00 2001 From: "pre-commit-ci[bot]" <66853113+pre-commit-ci[bot]@users.noreply.github.com> Date: Fri, 15 Nov 2024 08:13:03 +0000 Subject: [PATCH] [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --- AgentQnA/docker_compose/intel/hpu/gaudi/README.md | 8 +++++--- 1 file changed, 5 insertions(+), 3 deletions(-) diff --git a/AgentQnA/docker_compose/intel/hpu/gaudi/README.md b/AgentQnA/docker_compose/intel/hpu/gaudi/README.md index 7cf176f80..21735e398 100644 --- a/AgentQnA/docker_compose/intel/hpu/gaudi/README.md +++ b/AgentQnA/docker_compose/intel/hpu/gaudi/README.md @@ -1,6 +1,6 @@ # Single node on-prem deployment AgentQnA on Gaudi -This example showcases a hierarchical multi-agent system for question-answering applications. We deploy the example on Gaudi using open-source LLMs, +This example showcases a hierarchical multi-agent system for question-answering applications. We deploy the example on Gaudi using open-source LLMs, For more details, please refer to the deployment guide [here](../../../../README.md). ## Deployment with docker @@ -26,8 +26,8 @@ For more details, please refer to the deployment guide [here](../../../../README # for using open-source llms export HUGGINGFACEHUB_API_TOKEN= # Example export HF_CACHE_DIR=$WORKDIR so that no need to redownload every time - export HF_CACHE_DIR= - + export HF_CACHE_DIR= + ``` 3. Deploy the retrieval tool (i.e., DocIndexRetriever mega-service) @@ -53,11 +53,13 @@ For more details, please refer to the deployment guide [here](../../../../README 5. Launch `Agent` service To use open-source LLMs on Gaudi2, run commands below. + ``` cd $WORKDIR/GenAIExamples/AgentQnA/docker_compose/intel/hpu/gaudi bash launch_tgi_gaudi.sh bash launch_agent_service_tgi_gaudi.sh ``` + 6. [Optional] Build `Agent` docker image if pulling images failed. ```