Skip to content

softmax_scale seems to be multiplied to each token during indexer. Can it be deleted? #57

@jinluyang

Description

@jinluyang

I think softmax_scale does not affect the selected tokens. 在indexer中能不能把它去掉呢,这个乘softmax_scale似乎没什么收益,反而在有些场景影响性能/精度

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions