Search results

setup.sh only downloads swebench-verified-full.jsonl when the subset is missing → evaluate --mode docker fails with FileNotFoundError (reported as a false 0/N)

Status: Open.

#15 In Vexp-ai/vexp-swe-bench;

· marcoscale98 opened on Jul 13, 2026

setup.sh doesn't install swebench, but evaluate --mode docker requires it (benchmark crashes after the paid run)

Status: Open.

#14 In Vexp-ai/vexp-swe-bench;

· marcoscale98 opened on Jul 13, 2026

Expand to full 500-task SWE-bench Verified

enhancementNew feature or requestNew feature or request

Status: Open.

#4 In Vexp-ai/vexp-swe-bench;

· nicolalessi opened on Mar 22, 2026

Add Codex CLI agent adapter

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

new-agent

Status: Open.

#2 In Vexp-ai/vexp-swe-bench;

· nicolalessi opened on Mar 22, 2026

Add Cursor agent adapter

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

new-agent

Status: Open.

#1 In Vexp-ai/vexp-swe-bench;

· nicolalessi opened on Mar 22, 2026