It seems that some datasets required by tasks are missing.
For example,
-
For the first task (instance_id = 0) in code_bench_hard.json, the reference_code uses both:
constituency_wise_results_2019constituency_wise_results_2014
However, community_30 only contains constituency_wise_results_2014. The dataset constituency_wise_results_2019 appears to be missing.
-
For the task instance_id = 1 in code_bench_hard.json, the reference_code uses the dataset stubble_burning, but this dataset is not included in community_30.
I have not checked the remaining tasks yet, so I am not sure whether there are other similar cases.
Could you please confirm whether these datasets were omitted unintentionally or whether they are expected to be obtained from another location?
It seems that some datasets required by tasks are missing.
For example,
For the first task (
instance_id = 0) incode_bench_hard.json, thereference_codeuses both:constituency_wise_results_2019constituency_wise_results_2014However,
community_30only containsconstituency_wise_results_2014. The datasetconstituency_wise_results_2019appears to be missing.For the task
instance_id = 1incode_bench_hard.json, thereference_codeuses the datasetstubble_burning, but this dataset is not included incommunity_30.I have not checked the remaining tasks yet, so I am not sure whether there are other similar cases.
Could you please confirm whether these datasets were omitted unintentionally or whether they are expected to be obtained from another location?