Search results

[Evaluation] Upper Limit on Resource Usage

Status: Open.

#58 In nus-apr/USEbench;

· lapplislazuli opened on Jul 11, 2025

[Evaluation] Delay Container Startup

APIIssues related to API and higher level logicIssues related to API and higher level logic

TODOOpen Task but not a bugOpen Task but not a bug

Status: Open.

#56 In nus-apr/USEbench;

· lapplislazuli opened on Mar 13, 2025

[SWETRY] Parallel Evaluation

APIIssues related to API and higher level logicIssues related to API and higher level logic

TODOOpen Task but not a bugOpen Task but not a bug

Status: Open.

#55 In nus-apr/USEbench;

· lapplislazuli opened on Mar 13, 2025

Double-Commits possible on Get_Container

APIIssues related to API and higher level logicIssues related to API and higher level logic

BugSomething isn't workingSomething isn't working

Status: Open.

#54 In nus-apr/USEbench;

· lapplislazuli opened on Mar 7, 2025

[Evaluation] SWE Patches fail to apply

Status: Open.

#47 In nus-apr/USEbench;

· lapplislazuli opened on Feb 26, 2025

[SWT] SQFluff Special Test-Cases

APIIssues related to API and higher level logicIssues related to API and higher level logic

TODOOpen Task but not a bugOpen Task but not a bug

Status: Open.

#45 In nus-apr/USEbench;

· lapplislazuli opened on Feb 24, 2025

[Repotest] Faulty Prepatch Flask-13

BugSomething isn't workingSomething isn't working

Downstream BenchmarkSomething related to an individual downstream benchmark, such as SWE or SWTSomething related to an individual downstream benchmark, such as SWE or SWT

Status: Open.

#42 In nus-apr/USEbench;

· lapplislazuli opened on Feb 20, 2025

RepoX: Sympy Timeout

Status: Open.

#30 In nus-apr/USEbench;

· lapplislazuli opened on Jan 17, 2025