Skip to content
This repository was archived by the owner on Apr 19, 2026. It is now read-only.
This repository was archived by the owner on Apr 19, 2026. It is now read-only.

Couldn't reproduce the multiWOZ 2.1 results #47

@tzutengweng33176

Description

@tzutengweng33176

Hello, I had run the baseline code you've provided. The joint goal accuracy goes up to only 0.12 at 50000-ckpt. when I trained further to 100000 or even to 200000, the joint goal accuracy dropped to near zero. I evaluate the predicted state using your evaluation script. Can you give me some hints about how you trained the model (like which global step can reproduce the result? )?
I followed the instructions in the README.md directly.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions