Skip to content

Better testing for eval recipe: add test for generation and log likelihood tasks #1873

Open
@SalmanMohammadi

Description

Moving this to it's own issue after being mentioned in #1763 (comment) - it wasn't immediately trivial in trying to get the eval harness to ensure a specific ordering of tasks (we would want successive generation - non-generation tasks). Will follow up in another PR.

Metadata

Labels

better engineeringTasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions