Search results

Evaluating with adapters

Status: Open.

#35 In declare-lab/instruct-eval;

· maanasharma5 opened on Dec 2, 2024

Support for lm_eval v0.4 and higher

Status: Open.

#34 In declare-lab/instruct-eval;

· Shinning-Zhou opened on Oct 4, 2024

Multi GPU Support is required

Status: Open.

#33 In declare-lab/instruct-eval;

· chintan-ushur opened on May 16, 2024

Evaluate EncoderDecoderModels

Status: Open.

#32 In declare-lab/instruct-eval;

· Bachstelze opened on Jan 25, 2024

Colab notebook

Status: Open.

#31 In declare-lab/instruct-eval;

· Bachstelze opened on Jan 25, 2024

CRASS

Status: Open.

#30 In declare-lab/instruct-eval;

· Bachstelze opened on Jan 24, 2024

Evaluate on a single 24GB/32GB GPU

Status: Open.

#29 In declare-lab/instruct-eval;

· lemyx opened on Jan 16, 2024

How to submit own model to leaderboard?

Status: Open.

#28 In declare-lab/instruct-eval;

· timothylimyl opened on Jan 5, 2024

[Prompt Template] Silent bug - Performance Killer

Status: Open.

#27 In declare-lab/instruct-eval;

· timothylimyl opened on Jan 5, 2024

What are the metrics for the evaluation results?

Status: Open.

#26 In declare-lab/instruct-eval;

· zhimin-z opened on Dec 12, 2023

Reproduce the accuracy of chavinlo/alpaca-native on MMLU

Status: Open.

#25 In declare-lab/instruct-eval;

· sglucas opened on Oct 25, 2023

C-Eval

Status: Open.

#17 In declare-lab/instruct-eval;

· duanqiyuan opened on Jul 20, 2023