Skip to content

Commit

Permalink
➕ Install peft for prompt adapter support
Browse files Browse the repository at this point in the history
Signed-off-by: Prashant Gupta <[email protected]>
  • Loading branch information
prashantgupta24 authored and dtrifiro committed Aug 19, 2024
1 parent 9460cfb commit 197e383
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions Dockerfile.ubi
Original file line number Diff line number Diff line change
Expand Up @@ -180,6 +180,10 @@ RUN --mount=type=cache,target=/root/.cache/pip \
--mount=type=cache,target=/root/.cache/uv \
uv pip install https://github.com/flashinfer-ai/flashinfer/releases/download/v0.1.2/flashinfer-0.1.2+cu121torch2.4-cp311-cp311-linux_x86_64.whl

# Install peft for prompt adapter support
RUN --mount=type=cache,target=/root/.cache/pip \
pip install peft==0.12.0

ENV HF_HUB_OFFLINE=1 \
PORT=8000 \
HOME=/home/vllm \
Expand Down

0 comments on commit 197e383

Please sign in to comment.