[Issue]: Expected dout_seq_stride == out_seq_stride to be true, but got false

[ehartford]

Problem Description

File "/home/ehartford/miniconda3/envs/axolotl/lib/python3.11/site-packages/flash_attn/flash_attn_interface.py", line 79, in _flash_attn_varlen_backward
dq, dk, dv, softmax_d, = flash_attn_cuda.varlen_bwd(
^^^^^^^^^^^^^^^^^^^^^^^^^^^
RuntimeError: Expected dout_seq_stride == out_seq_stride to be true, but got false.

Operating System

Ubuntu 22.04.4 LTS (Jammy Jellyfish)

CPU

AMD EPYC 9654 96-Core Processor

GPU

AMD Instinct MI300X

ROCm Version

ROCm 6.1.0

ROCm Component

No response

Steps to Reproduce

run axolotl with flash attention

(Optional for Linux users) Output of /opt/rocm/bin/rocminfo --support

No response

Additional Information

No response

[ehartford]

seems duplicate of #40

[ehartford]

duplicate of #40