Search results

Fix broken workflows

choreThing that needs doingThing that needs doing

Status: Open.

#892 In mlcommons/modelbench;

· rogthefrog opened on Mar 10, 2025

pick chinese SUTs

Status: Open.

#890 In mlcommons/modelbench;

· wpietri opened on Mar 7, 2025

create chinese practice set

Status: Open.

#889 In mlcommons/modelbench;

· wpietri opened on Mar 7, 2025

evaluator proxy dynamically starts and stops instances

Status: Open.

#888 In mlcommons/modelbench;

· wpietri opened on Mar 7, 2025

benchmark Deepseek R2

Status: Open.

#887 In mlcommons/modelbench;

· wpietri opened on Mar 4, 2025

Chinese prototype

milestoneA goal that other cards add up toA goal that other cards add up to

Status: Open.

#886 In mlcommons/modelbench;

· wpietri opened on Mar 4, 2025

Hindi prototype

milestoneA goal that other cards add up toA goal that other cards add up to

Status: Open.

#885 In mlcommons/modelbench;

· wpietri opened on Mar 4, 2025

Change % safe to % violating throughout

choreThing that needs doingThing that needs doing

Status: Open.

#884 In mlcommons/modelbench;

· wpietri opened on Mar 4, 2025

Add param to run-csv-items to specific output file path

Status: Open.

#878 In mlcommons/modelbench;

· bkorycki opened on Feb 24, 2025

Search for config directory up the tree

Status: Open.

#877 In mlcommons/modelbench;

· wpietri opened on Feb 21, 2025

Only 1 SUT completion per prompt

choreThing that needs doingThing that needs doing

Status: Open.

#876 In mlcommons/modelbench;

· bkorycki opened on Feb 20, 2025

Simplify annotation object hierarchy in modelgauge

choreThing that needs doingThing that needs doing

Status: Open.

#874 In mlcommons/modelbench;

· bkorycki opened on Feb 20, 2025