Skip to content

Observation-wise losses for classification tasks #51

@jemus42

Description

@jemus42

Generally, both Brier score and logloss should have observation-wise losses available but implementations in mlr3measures don't include them yet.

Unfortunately they're a bit more involved than adding a single line for a mapping like obs_loss = "se", see mlr-org/mlr3measures#57

As of now I think the only classif measure with an obs loss available is CE / Acc, which is better than nothing but when we want to showcase how we can do CPI for example, it would be nice to have at least logloss availaible.

Metadata

Metadata

Assignees

No one assigned

    Labels

    mlr3Issue related to (or caused by) upstream mlr3 behavior

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions