Skip to content

[levanter] lm_eval uses unsupported implementation arg #4852

@eric-czech

Description

@eric-czech

lm-eval passes implementation to fused_cross_entropy_loss_and_logsumexp_penalty from levanter.models.loss here:

implementation="xla",

and this isn't supported in any of the overloads of fused_cross_entropy_loss_and_logsumexp_penalty of levanter/models/loss.py#L160-L216.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions