Skip to content

Commit

Permalink
[pre-commit.ci] auto fixes from pre-commit.com hooks
Browse files Browse the repository at this point in the history 
for more information, see https://pre-commit.ci
  • Loading branch information
@pre-commit-ci
pre-commit-ci[bot] committed Dec 10, 2024
1 parent e02b4cd commit 9d85cb3
Show file tree
Hide file tree
Showing 3 changed files with 68 additions and 36 deletions.
4 changes: 2 additions & 2 deletions comps/agent/langchain/log
View file
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
[HumanMessage(content="what's the most recent album from the founder of ysl records?", id='cfde4aba-0464-4ad9-bd1c-d3fc40bbb46e'), AIMessage(content='', addi
tional_kwargs={'tool_calls': [ChatCompletionOutputToolCall(function=ChatCompletionOutputFunctionDefinition(arguments={'query': 'founder of YSL Records'}, nam
tional_kwargs={'tool_calls': [ChatCompletionOutputToolCall(function=ChatCompletionOutputFunctionDefinition(arguments={'query': 'founder of YSL Records'}, name
e='duckduckgo_search', description=None), id='142bd66e-7ec6-4381-bcb6-2d0bd4fcecd3', type='function')]}, id='6430421d-2238-452b-9fbe-4d6cc8bc0cd8', tool_call
s=[{'name': 'duckduckgo_search', 'args': {'query': 'founder of YSL Records'}, 'id': '142bd66e-7ec6-4381-bcb6-2d0bd4fcecd3', 'type': 'tool_call'}]), ToolMessa
ge(content='Prosecutors allege the chart-topping artist\'s label Young Stoner Life Records also stands for Young Slime ... a YSL co-founder who reached a ple
Expand All @@ -17,7 +17,7 @@ e='function')]}, id='50a644af-3117-4513-be56-5fb4b16d0481', tool_calls=[{'name':
ropel close friends and family members to industry success. The Birth Of YSL Records And Its Impact On The Music Industry In 2016, Young Thug founded YSL Rec
ords, with its full name, "Young Stoner Life," perfectly representing the enigmatic persona of ... Young Thug, who runs the Young Stoner Life label, has been
accused of co-founding the Young Slime Life Atlanta gang and violating the RICO act, among other charges. Here\'s what to know about the ... The rapper foun
ded the record label Young Stoner Life in 2016 as an imprint of 300 Entertainment. YSL Records calls its roster of artists the "Slime Family." One of the YSL
dead the record label Young Stoner Life in 2016 as an imprint of 300 Entertainment. YSL Records calls its roster of artists the "Slime Family." One of the YSL
Records founder\'s charges includes conspiracy to violate the Racketeer Influenced and Corrupt Organizations Act (RICO).', name='duckduckgo_search', id='afc
cee2f-f36f-4d86-8abd-8d05d733649d', tool_call_id='6d073578-5bf1-449e-8d32-4f3b5f999a06'), HumanMessage(content='Retrieved document is not sufficient or relev
ant to answer the query. Reformulate the query to search knowledge base again.', id='22af0af8-92d0-4876-ad4e-16457c37f1f3'), AIMessage(content='', additional
Expand Down
2 changes: 1 addition & 1 deletion tests/agent/test_agent_langchain_on_intel_hpu.sh
View file
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ if [ -d "$WORKPATH/hub" ]; then
ls "$WORKPATH/hub"
fi
vllm_port=8085
export vllm_volume=$WORKPATH
export vllm_volume=$WORKPATH

export WORKPATH=$WORKPATH

Expand Down
98 changes: 65 additions & 33 deletions tests/vllm-gaudi-service.log
View file
Original file line number Diff line number Diff line change
Expand Up @@ -153,38 +153,70 @@ INFO 12-09 23:52:23 weight_utils.py:243] Using model weights format ['*.safetens
(VllmWorkerProcess pid=359) INFO 12-09 23:52:23 weight_utils.py:243] Using model weights format ['*.safetensors']
(VllmWorkerProcess pid=357) INFO 12-09 23:52:23 weight_utils.py:243] Using model weights format ['*.safetensors']
(VllmWorkerProcess pid=358) INFO 12-09 23:52:23 weight_utils.py:243] Using model weights format ['*.safetensors']
Loading safetensors checkpoint shards: 0% Completed | 0/30 [00:00<?, ?it/s]
Loading safetensors checkpoint shards: 3% Completed | 1/30 [00:01<00:46, 1.60s/it]
Loading safetensors checkpoint shards: 7% Completed | 2/30 [00:02<00:35, 1.28s/it]
Loading safetensors checkpoint shards: 10% Completed | 3/30 [00:03<00:34, 1.29s/it]
Loading safetensors checkpoint shards: 13% Completed | 4/30 [00:06<00:47, 1.83s/it]
Loading safetensors checkpoint shards: 17% Completed | 5/30 [00:09<00:51, 2.04s/it]
Loading safetensors checkpoint shards: 20% Completed | 6/30 [00:10<00:46, 1.95s/it]
Loading safetensors checkpoint shards: 23% Completed | 7/30 [00:13<00:52, 2.28s/it]
Loading safetensors checkpoint shards: 27% Completed | 8/30 [00:15<00:49, 2.26s/it]
Loading safetensors checkpoint shards: 30% Completed | 9/30 [00:16<00:37, 1.79s/it]
Loading safetensors checkpoint shards: 33% Completed | 10/30 [00:17<00:29, 1.47s/it]
Loading safetensors checkpoint shards: 37% Completed | 11/30 [00:18<00:23, 1.26s/it]
Loading safetensors checkpoint shards: 40% Completed | 12/30 [00:19<00:23, 1.28s/it]
Loading safetensors checkpoint shards: 43% Completed | 13/30 [00:20<00:22, 1.30s/it]
Loading safetensors checkpoint shards: 47% Completed | 14/30 [00:22<00:20, 1.26s/it]
Loading safetensors checkpoint shards: 50% Completed | 15/30 [00:22<00:15, 1.05s/it]
Loading safetensors checkpoint shards: 53% Completed | 16/30 [00:23<00:12, 1.11it/s]
Loading safetensors checkpoint shards: 57% Completed | 17/30 [00:23<00:10, 1.24it/s]
Loading safetensors checkpoint shards: 60% Completed | 18/30 [00:24<00:09, 1.30it/s]
Loading safetensors checkpoint shards: 63% Completed | 19/30 [00:25<00:07, 1.40it/s]
Loading safetensors checkpoint shards: 67% Completed | 20/30 [00:25<00:06, 1.43it/s]
Loading safetensors checkpoint shards: 70% Completed | 21/30 [00:26<00:05, 1.57it/s]
Loading safetensors checkpoint shards: 73% Completed | 22/30 [00:26<00:05, 1.57it/s]
Loading safetensors checkpoint shards: 77% Completed | 23/30 [00:27<00:04, 1.57it/s]
Loading safetensors checkpoint shards: 80% Completed | 24/30 [00:28<00:03, 1.54it/s]
Loading safetensors checkpoint shards: 83% Completed | 25/30 [00:28<00:02, 1.69it/s]
Loading safetensors checkpoint shards: 87% Completed | 26/30 [00:29<00:02, 1.66it/s]
Loading safetensors checkpoint shards: 90% Completed | 27/30 [00:29<00:01, 1.73it/s]
Loading safetensors checkpoint shards: 93% Completed | 28/30 [00:30<00:01, 1.82it/s]
Loading safetensors checkpoint shards: 97% Completed | 29/30 [00:30<00:00, 1.91it/s]
Loading safetensors checkpoint shards: 100% Completed | 30/30 [00:31<00:00, 1.92it/s]
Loading safetensors checkpoint shards: 100% Completed | 30/30 [00:31<00:00, 1.04s/it]

Loading safetensors checkpoint shards: 0% Completed | 0/30 [00:00<?, ?it/s]

Loading safetensors checkpoint shards: 3% Completed | 1/30 [00:01<00:46, 1.60s/it]

Loading safetensors checkpoint shards: 7% Completed | 2/30 [00:02<00:35, 1.28s/it]

Loading safetensors checkpoint shards: 10% Completed | 3/30 [00:03<00:34, 1.29s/it]

Loading safetensors checkpoint shards: 13% Completed | 4/30 [00:06<00:47, 1.83s/it]

Loading safetensors checkpoint shards: 17% Completed | 5/30 [00:09<00:51, 2.04s/it]

Loading safetensors checkpoint shards: 20% Completed | 6/30 [00:10<00:46, 1.95s/it]

Loading safetensors checkpoint shards: 23% Completed | 7/30 [00:13<00:52, 2.28s/it]

Loading safetensors checkpoint shards: 27% Completed | 8/30 [00:15<00:49, 2.26s/it]

Loading safetensors checkpoint shards: 30% Completed | 9/30 [00:16<00:37, 1.79s/it]

Loading safetensors checkpoint shards: 33% Completed | 10/30 [00:17<00:29, 1.47s/it]

Loading safetensors checkpoint shards: 37% Completed | 11/30 [00:18<00:23, 1.26s/it]

Loading safetensors checkpoint shards: 40% Completed | 12/30 [00:19<00:23, 1.28s/it]

Loading safetensors checkpoint shards: 43% Completed | 13/30 [00:20<00:22, 1.30s/it]

Loading safetensors checkpoint shards: 47% Completed | 14/30 [00:22<00:20, 1.26s/it]

Loading safetensors checkpoint shards: 50% Completed | 15/30 [00:22<00:15, 1.05s/it]

Loading safetensors checkpoint shards: 53% Completed | 16/30 [00:23<00:12, 1.11it/s]

Loading safetensors checkpoint shards: 57% Completed | 17/30 [00:23<00:10, 1.24it/s]

Loading safetensors checkpoint shards: 60% Completed | 18/30 [00:24<00:09, 1.30it/s]

Loading safetensors checkpoint shards: 63% Completed | 19/30 [00:25<00:07, 1.40it/s]

Loading safetensors checkpoint shards: 67% Completed | 20/30 [00:25<00:06, 1.43it/s]

Loading safetensors checkpoint shards: 70% Completed | 21/30 [00:26<00:05, 1.57it/s]

Loading safetensors checkpoint shards: 73% Completed | 22/30 [00:26<00:05, 1.57it/s]

Loading safetensors checkpoint shards: 77% Completed | 23/30 [00:27<00:04, 1.57it/s]

Loading safetensors checkpoint shards: 80% Completed | 24/30 [00:28<00:03, 1.54it/s]

Loading safetensors checkpoint shards: 83% Completed | 25/30 [00:28<00:02, 1.69it/s]

Loading safetensors checkpoint shards: 87% Completed | 26/30 [00:29<00:02, 1.66it/s]

Loading safetensors checkpoint shards: 90% Completed | 27/30 [00:29<00:01, 1.73it/s]

Loading safetensors checkpoint shards: 93% Completed | 28/30 [00:30<00:01, 1.82it/s]

Loading safetensors checkpoint shards: 97% Completed | 29/30 [00:30<00:00, 1.91it/s]

Loading safetensors checkpoint shards: 100% Completed | 30/30 [00:31<00:00, 1.92it/s]

Loading safetensors checkpoint shards: 100% Completed | 30/30 [00:31<00:00, 1.04s/it]

INFO 12-09 23:52:55 hpu_model_runner.py:668] Pre-loading model weights on hpu:0 took 32.95 GiB of device memory (32.95 GiB/94.62 GiB used) and 4.121 GiB of host memory (127.2 GiB/1007 GiB used)
(VllmWorkerProcess pid=358) INFO 12-09 23:52:55 hpu_model_runner.py:668] Pre-loading model weights on hpu:0 took 32.95 GiB of device memory (32.95 GiB/94.62 GiB used) and 4.112 GiB of host memory (127.2 GiB/1007 GiB used)
Expand Down Expand Up @@ -218,7 +250,7 @@ INFO 12-09 23:53:58 hpu_model_runner.py:1617] Skipping warmup...
(VllmWorkerProcess pid=358) INFO 12-09 23:53:59 hpu_model_runner.py:1617] Skipping warmup...
INFO 12-09 23:53:59 llm_engine.py:495] init engine (profile, create kv cache, warmup model) took 62.70 seconds
INFO 12-09 23:53:59 api_server.py:252] vLLM to use /tmp/tmpsrzzvs8g as PROMETHEUS_MULTIPROC_DIR
INFO 12-09 23:53:59 api_server.py:560] Using supplied chat template:
INFO 12-09 23:53:59 api_server.py:560] Using supplied chat template:
INFO 12-09 23:53:59 api_server.py:560] None
INFO 12-09 23:53:59 launcher.py:19] Available routes are:
INFO 12-09 23:53:59 launcher.py:27] Route: /openapi.json, Methods: GET, HEAD
Expand Down

0 comments on commit 9d85cb3

Please sign in to comment.