Expose response length in API #1

Open

opened

on Mar 12, 2025

For several analyses we're interested in doing, we need to calculate model response length. Currently that requires extra setup to access the logs saved on s3. It'd be great if that were just exposed as a field for BenchmarkRun!

to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests