Skip to content

Masking diffusion#624

Open
arrjon wants to merge 5 commits intodevfrom
masking_diffusion
Open

Masking diffusion#624
arrjon wants to merge 5 commits intodevfrom
masking_diffusion

Conversation

@arrjon
Copy link
Member

@arrjon arrjon commented Jan 28, 2026

This pull request introduces new functionality for conditional masking and partial target conditioning in the flow_matching, consistency_model, stable_consistency_model, and diffusion_model classes. The main additions are the drop_cond_prob parameter (which allows probabilistic masking of conditioning inputs during training, enabling simultaneous training of conditional and unconditional models) and, for diffusion models, the drop_target_prob parameter (enabling training and inference with partial targets). The code ensures proper handling of these features during inference and metrics computation.

Diffusion model:

  • During inference, pass a target_mask and targets_fixed to specify which parts of the target should be kept fixed to the values in targets_fixed.

All diffusion type models:

  • During inference, set unconditional_mode=True, to use mask conditions during sampling.

@arrjon arrjon self-assigned this Jan 28, 2026
@arrjon arrjon added the feature New feature or request label Jan 28, 2026
@codecov
Copy link

codecov bot commented Jan 28, 2026

@arrjon arrjon requested a review from stefanradev93 January 28, 2026 09:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

feature New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant