Skip to content

Commit

Permalink
align vllm port
Browse files Browse the repository at this point in the history
Signed-off-by: minmin-intel <[email protected]>
  • Loading branch information
minmin-intel committed Dec 11, 2024
1 parent faeeeb6 commit 14c61f9
Showing 1 changed file with 2 additions and 4 deletions.
6 changes: 2 additions & 4 deletions tests/agent/sql_agent_test/test_sql_agent.sh
Original file line number Diff line number Diff line change
Expand Up @@ -20,10 +20,8 @@ export agent_container_name="test-comps-agent-endpoint"

export ip_address=$(hostname -I | awk '{print $1}')

vllm_port=8085
vllm_volume=${HF_CACHE_DIR} #$WORKPATH #${HF_CACHE_DIR}
# echo "vllm volume: $vllm_volume"
# ls $vllm_volume/hub
vllm_port=8086
vllm_volume=${HF_CACHE_DIR}

export model=meta-llama/Meta-Llama-3.1-70B-Instruct
export HUGGINGFACEHUB_API_TOKEN=${HF_TOKEN}
Expand Down

0 comments on commit 14c61f9

Please sign in to comment.