Skip to content

Commit

Permalink
Fix issue (opea-project#483)
Browse files Browse the repository at this point in the history
* Standardize image names and labels.

Signed-off-by: zepan <[email protected]>

* Remove test cases that are no longer in use.

Signed-off-by: zepan <[email protected]>

---------

Signed-off-by: zepan <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
  • Loading branch information
ZePan110 authored and siddhivelankar23 committed Aug 22, 2024
1 parent d4e66e0 commit 77ad930
Show file tree
Hide file tree
Showing 2 changed files with 1 addition and 99 deletions.
98 changes: 0 additions & 98 deletions tests/test_llms_text-generation_ray_serve.sh

This file was deleted.

2 changes: 1 addition & 1 deletion tests/test_llms_text-generation_vllm-ray.sh
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ function start_service() {
--ipc=host \
-e HUGGINGFACEHUB_API_TOKEN=$HUGGINGFACEHUB_API_TOKEN \
-p $port_number:8000 \
opea/vllm_ray:habana \
opea/vllm_ray-habana:comps \
/bin/bash -c "ray start --head && python vllm_ray_openai.py --port_number 8000 --model_id_or_path $LLM_MODEL --tensor_parallel_size 2 --enforce_eager False"

export vLLM_RAY_ENDPOINT="http://${ip_address}:${port_number}"
Expand Down

0 comments on commit 77ad930

Please sign in to comment.