Availability of task metadata (LOC and categories)

[ZJK-code]

Hi, thanks for releasing NL2Repo-Bench!

I have a question regarding task-level metadata used in the benchmark.

Would it be possible to release, for each task:

• the LOC (Lines of Code) of the original repository used for difficulty classification, and
• the task category label (e.g., System Tools, Web Development, Data Processing, etc.)?

Having access to this information would be very helpful for result analysis, reproduction, and fair comparison across different settings.

Thanks again for the great work!

[YYDJZ]

Thanks for paying attention to our work. We are currently preparing to release a new version of the repository, which will contain the difficulty and category of each task.

[YYDJZ]

https://github.com/multimodal-art-projection/NL2RepoBench/blob/main/test_files/task_difficulty.csv
See here.