Skip to content

The range value of dist@k #85

@anpro948

Description

@anpro948

I modified a file to use a BERT model for the conv_model on the redial dataset, and I obtained a dist@k score > 1 (this result is more higher than the scores reported in the papers below, which raises some doubts). Is this normal? It seems that the range values for dist@k, similar to bleu@k, should both fall within the [0,1] range. When I compared it with other papers, the dist@k for the redial dataset mostly seemed to fall within the [0,1] range. Since I don't have a clear understanding of the dist@k code, could someone help me with this?

My results:
image

Paper: (https://arxiv.org/pdf/2007.04032.pdf), (https://arxiv.org/pdf/2206.09363.pdf)
image
image

Bert Model:
image

Dist@k score: I add a hyp_token = hyp.split()
image

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions