Skip to content

help with building wheels #16

Description

@siriluo

Hi, the image works well on the GH200 system, thank you.

Do you mind sharing more details about how to build the wheels (flash-atten, etc ) on aarch64 step by step? The current vLLM version here is 0.7, I want a more updated vLLM, how to build such a container from scratch?

Thank you.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions