[Benchmark] Add support for CAPEval

[liuzhipenggg]

Summary

Add CAPEval as an image caption benchmark.

The dataset has 300 images. The model produces a caption; a judge LLM scores it against checklist items and reports Coverage (C) and Precision (P), with Scene & Object (SO) / People & Activity (PA) / Text & Interface (TI) / Design & Knowledge (DK) splits.

Changes

• Register CAPEval in IMAGE_DATASET
• Add vlmeval/dataset/capeval.py
• Auto-download from Hugging Face to $LMUData/CAPEval/

Implemented as ImageBaseDataset + build_judge. No changes to run.py, model backends, or shared judge code.

Usage

python run.py --data CAPEval --model <VLM> --judge qwen-72b

--judge defaults to qwen-72b if omitted.

References

• https://github.com/liuzhipenggg/CAPEval
• https://huggingface.co/datasets/LiuzhipengUCAS/CAPEval

[liuzhipenggg]

Hi @kennymckormick, sorry to bother you. I just wanted to kindly ask if you might have time to take a look at this PR. GitHub is holding the Actions run for first-time contributors, so it cannot start until a maintainer approves it. I would be very grateful for any review comments, and I am happy to revise the code. Thank you very much.

[liuzhipenggg]

Hi @TianhaoLiang2000 @kennymckormick , sorry to bother you.
I was wondering if you might have time to take a look at this PR when convenient.
I would be very grateful if you could help trigger the CI or share any feedback.
Thank you very much.