[Benchmark Backfill] Clarify ArcAGI2-Image naming and scope

[Luodian]

Candidate from LMM-299 is ambiguous. Confirm whether ArcAGI2-Image maps to ARC-AGI-2 rendered-image evaluation or a separate benchmark; define exact task scope for implementation.

[Luodian]

Research update for ArcAGI2-Image scope:\n\n- Official ARC-AGI-2 is also grid JSON in the ARC Prize repo (not an official image benchmark): https://github.com/arcprize/ARC-AGI-2\n- I could not find an official/public dataset explicitly named ArcAGI2-Image.\n- There is a community image-rendered conversion with canonical train/evaluation split + image columns: \n - README says it repackages ARC-AGI-2 tasks and adds PNG renderings + prompts.\n - This is promising, but still community-maintained rather than official ARC Prize packaging.\n\nConclusion: ArcAGI2-Image is not an official benchmark name, but there is a viable community conversion if we choose to adopt it explicitly as a derived benchmark.\n\nRecommendation: keep this ticket open only if we explicitly accept community-converted ARC-AGI-2 image data as scope (and rename task to avoid implying official status). Otherwise close as ambiguous.

[Luodian]

Correction note (dataset IDs rendered incorrectly in my prior comment due shell quoting).

Research update for ArcAGI2-Image scope:

• Official ARC-AGI-2 is grid JSON in the ARC Prize repo (not an official image benchmark): https://github.com/arcprize/ARC-AGI-2
• I could not find an official/public dataset explicitly named ArcAGI2-Image.
• There is a community image-rendered conversion with canonical train/evaluation split + image columns: vincentkoc/arc-agi-2
  • README states it repackages ARC-AGI-2 tasks and adds PNG renderings + prompts.
  • This is promising, but still community-maintained rather than official ARC Prize packaging.

Conclusion: ArcAGI2-Image is not an official benchmark name, but there is a viable community conversion if we choose to adopt it explicitly as a derived benchmark.

Recommendation: keep this ticket open only if we explicitly accept community-converted ARC-AGI-2 image data as scope (and rename task to avoid implying official status). Otherwise close as ambiguous.

[Luodian]

Resolved via PR #1190 (merged). ARC-AGI-2 task added.