SWE-bench api has change, some point should be modified to fit the newest version of SWE-bench.

[shuaijiumei]

from swebench.harness.test_spec import (
    TestSpec,
    make_env_script_list,
    make_repo_script_list,
)
from swebench.harness.utils import get_test_directives

This import has changed.

    return TestSpec(
        instance_id=instance_id,
        repo=repo,
        env_script_list=env_script_list,
        repo_script_list=repo_script_list,
        eval_script_list=eval_script_list,
        version=version,
        arch=arch,
        FAIL_TO_PASS=fail_to_pass,
        PASS_TO_PASS=pass_to_pass,
        language='py',
        docker_specs= {
        "pnpm_version": "9.5.0",
        "node_version": "21.6.2",
        "python_version": "3.9",
        },
        namespace='swebench'
    )

This class should be updated 3 parameters.
SWE-bench has made some broken changes, agentless should set the fix version of SWE-bench or update with SWE-bench. If needs more information, I would like to provide any details. Thanks.

[yuecao0119]

Hello,

I encountered the same problem, how did you solve it?

Looking forward to your reply.

[shuaijiumei]

The first one has changed into :

from swebench.harness.test_spec.test_spec import (
    TestSpec,
    make_env_script_list,
    make_repo_script_list,
) 

The second one is the answer

[AjaxZhan]

It seems that the import statement from swebench.harness.utils import get_test_directives should be changed into from swebench.harness.test_spec.python import get_test_directives

[zhimin-z]

mark