Skip to content

Make layers (specifically the first normalization layer) public #233

Closed
@andreaferretti

Description

@andreaferretti

Some acceleration techniques, such as TeaCache rely on having access for inference to individual layers in the FLUX transformer. To make them interoperable with Nunchaku, the Nunchaku library should export the relevant layers in its public API.

More specifically, TeaCache requires access to model.transformer_blocks[0].norm1 in this line, so just exposing that in the public API would be enough.

I can provide a PR for this

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions