Skip to content

automatically detect unsupported gpu and fallback to float32 #363

Description

@bukowa

mtypes = {"cpu": "int8", "cuda": "float16"}

dtype=torch.float16 if args.device == "cuda" else torch.float32,

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions