Skip to content

can I offload vram to 3 gpus? #156

@JemZhu

Description

@JemZhu

can I offload vram to 3 gpus? I have 6 V100 16G gpus on the server. The flux.2 dev model is too large to offload on 2gpus. Is there a way to offload vram to 3 or more gpus? thanks.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions