Closed
Description
Some acceleration techniques, such as TeaCache rely on having access for inference to individual layers in the FLUX transformer. To make them interoperable with Nunchaku, the Nunchaku library should export the relevant layers in its public API.
More specifically, TeaCache requires access to model.transformer_blocks[0].norm1
in this line, so just exposing that in the public API would be enough.
I can provide a PR for this
Metadata
Metadata
Assignees
Labels
No labels