"Installation Failure: flash-attn Build Error During autodistill-grounded-sam-2 Installation in Google Colab"

[Natty02]

Issue Description:
When attempting to install the autodistill-grounded-sam-2 package in Google Colab using the command !pip install autodistill-grounded-sam-2, an error occurs related to the dependency flash-attn. The issue arises during the wheel-building process (bdist_wheel), with a subprocess-exited-with-error message indicating a failure in installation. Details of the issue:

1. flash-attn installation error: The package flash-attn, required by autodistill-grounded-sam-2, fails to build. The process exits with code 1 during the setup.py bdist_wheel step.
2. Error note: The error originates from an external subprocess, likely due to a build issue with flash-attn in the Colab environment rather than a pip issue itself.

Troubleshooting steps attempted:
Efforts to resolve the issue, such as updating pip, reinstalling torch, and attempting to build dependencies manually, were unsuccessful.

Environment:

• Google Colab
• Python version: [specify if known]
• Torch version: 2.0.1

Any guidance or fixes would be appreciated!

[feitgemel]

I have the same error message . Did you overcome the problem ?

Eran

[Ricool06]

I'm also getting this error when trying to add GroundedSAM 2 with uv:

ModuleNotFoundError: No module named 'torch'

      hint: This error likely indicates that `flash-attn@2.8.3` depends on `torch`, but doesn't declare it as a build dependency. If
      `flash-attn` is a first-party package, consider adding `torch` to its `build-system.requires`. Otherwise, `uv pip install torch` into
      the environment and re-run with `--no-build-isolation`.
  help: If you want to add the package regardless of the failed resolution, provide the `--frozen` flag to skip locking and syncing.

I already have torch installed, so this is a bit confusing. Using --nobuild-isolation and/or --frozen causes other errors.

[nicobrch]

I'm having the same issue. Windows 11 24H2, CUDA 13.0, Python 12.9 and UV.