Skip to content

Added mmlu accuracy test command format#293

Merged
vgodsoe merged 3 commits intomainfrom
update_mmlu_doc
Mar 12, 2025
Merged

Added mmlu accuracy test command format#293
vgodsoe merged 3 commits intomainfrom
update_mmlu_doc

Conversation

@vgodsoe
Copy link
Copy Markdown
Collaborator

@vgodsoe vgodsoe commented Mar 7, 2025

The current MMLU doc lists the available tests but doesn't include the format for using them with the lemonade command.
This PR adds a column to add the command format.

@vgodsoe vgodsoe requested a review from jeremyfowers March 7, 2025 22:37
Copy link
Copy Markdown
Collaborator

@jeremyfowers jeremyfowers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ramkrishna2910 please review this as well for correctness since you are the file maintainer. I only reviewed for the clarity of the instructions.

@ramkrishna2910
Copy link
Copy Markdown
Collaborator

The correct format for the test names is followed.

vgodsoe and others added 3 commits March 12, 2025 14:04
Signed-off-by: Victoria Godsoe <victoria.godsoe@amd.com>
Co-authored-by: Jeremy Fowers <80718789+jeremyfowers@users.noreply.github.com>
Signed-off-by: Victoria Godsoe <victoria.godsoe@amd.com>
Co-authored-by: Jeremy Fowers <80718789+jeremyfowers@users.noreply.github.com>
Signed-off-by: Victoria Godsoe <victoria.godsoe@amd.com>
@vgodsoe vgodsoe merged commit d750f4a into main Mar 12, 2025
13 checks passed
@vgodsoe vgodsoe deleted the update_mmlu_doc branch March 12, 2025 22:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants