python setup.py bdist_wheel did not run successfully.
Anyone can advise the issue below:
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.10/dist-packages (from jinja2->torch->flash-attn) (3.0.2)
Building wheels for collected packages: flash-attn
error: subprocess-exited-with-error
× python setup.py bdist_wheel did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
Building wheel for flash-attn (setup.py) ... error
ERROR: Failed building wheel for flash-attn
Running setup.py clean for flash-attn
Failed to build flash-attn
ERROR: ERROR: Failed to build installable wheels for some pyproject.toml based projects (flash-attn)
Collecting grouped_gemm==0.1.6
Hi Leonyap,
This issue seems to came from insuccessful build of flash-attention, did you run this on Google Colab T4 cards?
FA2 does not to seem support GPU architecture earlier than Ampere, but T4 is turing, likely to cause this problem.
We can confirm it runs well in Colab Pro's A100 instance.
Best Regards,
Maazel