Search results

Rouge score

Status: Open.

#157 In bigscience-workshop/lm-evaluation-harness;

· Muennighoff opened on May 25, 2023

lm_eval.list_model_apis() not found

Status: Open.

#156 In bigscience-workshop/lm-evaluation-harness;

· robertLiuLinFeng opened on May 24, 2023

translation evalution error

Status: Open.

#154 In bigscience-workshop/lm-evaluation-harness;

· laozhanghahaha opened on Apr 24, 2023

Seq2Seq: Special tokens are also added to targets for LL computation

Status: Open.

#149 In bigscience-workshop/lm-evaluation-harness;

· samsontmr opened on Mar 2, 2023

max_length not set correctly

Status: Open.

#148 In bigscience-workshop/lm-evaluation-harness;

· hatimbr opened on Feb 21, 2023

cache not storing predictions

Status: Open.

#146 In bigscience-workshop/lm-evaluation-harness;

· rbawden opened on Dec 27, 2022

different score ranges are confusing

enhancementNew feature or requestNew feature or request

Status: Open.

#119 In bigscience-workshop/lm-evaluation-harness;

· Muennighoff opened on Aug 16, 2022