Skip to content

how to install fastattention2 on Jetson orin #26

@jeffrrrrr

Description

@jeffrrrrr

I am testing it on Nova carter.
For setup step, in the vila_setup.sh, the step to install the Fastattention2 is for x86 platfrom.

# Install FlashAttention2
python -m pip install https://github.com/Dao-AILab/flash-attention/releases/download/v2.5.8/flash_attn-2.5.8+cu122torch2.3cxx11abiFALSE-cp310-cp310-linux_x86_64.whl

How could I install it for jetson?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions