From 3b786a2c52ad87417c42e61017d241e1d74bf580 Mon Sep 17 00:00:00 2001 From: Naomiusearch <121130001+Naomiusearch@users.noreply.github.com> Date: Wed, 29 Nov 2023 18:59:29 +0100 Subject: [PATCH 1/2] Update README.md Fix numbers --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 6cf6a85b2..8f9cb3bae 100644 --- a/README.md +++ b/README.md @@ -234,7 +234,7 @@ To manually target for MI300 series: ```bash export GPU_ARCHS="gfx940;gfx941;gfx942" ``` -### iii. Build from source +### iv. Build from source ```bash $ cd flash-attention $ export PYTHON_SITE_PACKAGES=$(python -c 'import site; print(site.getsitepackages()[0])') From 820b2b10f11a90c4b388f4ad2549acd580682d5b Mon Sep 17 00:00:00 2001 From: Naomiusearch <121130001+Naomiusearch@users.noreply.github.com> Date: Wed, 29 Nov 2023 19:04:26 +0100 Subject: [PATCH 2/2] Update README.md --- README.md | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/README.md b/README.md index 8f9cb3bae..5dbc08d84 100644 --- a/README.md +++ b/README.md @@ -217,15 +217,15 @@ pytest -q -s tests/test_flash_attn.py - PyTorch 1.12.1+ - MI200 & MI300 GPUs ## Method 1: Build from Source -### i. Launch a ROCm PyTorch docker (recommended): E.g. +### I. Launch a ROCm PyTorch docker (recommended): E.g. ```bash docker run -it --device /dev/dri --device /dev/kfd --network host --ipc host --privileged --cap-add SYS_PTRACE --group-add video --security-opt seccomp=unconfined rocm/pytorch:rocm5.7_ubuntu22.04_py3.10_pytorch_2.0.1 ``` -### ii. Clone the repo with submodules +### II. Clone the repo with submodules ```bash git clone --recursive https://github.com/ROCmSoftwarePlatform/flash-attention.git ``` -### iii. (optional): Build for the desired GPU architecture(s) by setting the enviroment variable (semicolon seperated). We currently only support the following options. If you do not specify, defaultly it will build for your native device architecture: +### III. (optional): Build for the desired GPU architecture(s) by setting the enviroment variable (semicolon seperated). We currently only support the following options. If you do not specify, defaultly it will build for your native device architecture: To manually target for MI200 series: ```bash export GPU_ARCHS="gfx90a" @@ -234,7 +234,7 @@ To manually target for MI300 series: ```bash export GPU_ARCHS="gfx940;gfx941;gfx942" ``` -### iv. Build from source +### IV. Build from source ```bash $ cd flash-attention $ export PYTHON_SITE_PACKAGES=$(python -c 'import site; print(site.getsitepackages()[0])')