Skip to content

Evo installation with flash-attn==1.0.5 #111

@ItamarElkayam

Description

@ItamarElkayam

Hey!
After struggling with the "No Module Named 'torch'" issue, I installed flash-attn==1.0.5 as suggested. However, when I try to install evo, it attempts to reinstall a newer version of flash-attn and fails.

I also tried manually installing all requirements but ran into:
TypeError: MHA.init() got an unexpected keyword argument 'num_heads_kv'

How can I proceed with evo's installation after manually installing flash-attn?

Thanks!

Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions