Skip to content

RALI is not robust against noise from Nano Banana Pro #16

@kenantang

Description

@kenantang

Thanks for open-sourcing this great work! I would like to bring this edge case to your attention:

RALI gives a higher score for a noisy image than for a clean image, when the noise comes from an image editing model.

For example, this clean image receive a score of 3.89.

Image

However, this noisy image after 5 steps by Nano Banana Pro receives a higher RALI score of 3.93, despite obvious visual artifacts.

Image

Traditional NR-IQA metrics also fail in this case. Hope to see future improvements of the Q-Insight model family! You can find a dataset of images corrupted by Nano Banana Pro here.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions