CWQ Ground Truth

[amayuelas]

Where did you obtain the ground truth answers for the CWQ dataset?
I just reran the provided SPARQL queries on my installation of Freebase and I am getting 81.11% answers correct.
Shouldn't I be getting 100%?

[GasolSun36]

Where did you obtain the ground truth answers for the CWQ dataset? I just reran the provided SPARQL queries on my installation of Freebase and I am getting 81.11% answers correct. Shouldn't I be getting 100%?

You can get ground truth answers of CWQ dataset on the official website. Moreover, I think it's definitely need 100% correct, maybe you can talk to @Tanglumy for more information.