Skip to content

Add QA support to Evals - #210

Merged
husseinmozannar merged 6 commits into
mainfrom
QA
Jun 26, 2025
Merged

Add QA support to Evals#210
husseinmozannar merged 6 commits into
mainfrom
QA

Conversation

@vballoli

Copy link
Copy Markdown
Contributor

No description provided.

@vballoli vballoli changed the title Add QA support w/ SimpleQA Add QA support to Evals Jun 20, 2025
@vballoli
vballoli force-pushed the QA branch 2 times, most recently from 5e0b5e3 to bcb0c90 Compare June 23, 2025 22:11
Comment thread experiments/eval/run.py
@vballoli
vballoli requested a review from husseinmozannar June 23, 2025 22:14
@vballoli
vballoli marked this pull request as ready for review June 23, 2025 22:14
@vballoli
vballoli force-pushed the QA branch 2 times, most recently from f29fda2 to 76ff94d Compare June 23, 2025 23:19

@husseinmozannar husseinmozannar left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Had to make quite a few changes to get it to run, but all good now

@husseinmozannar

Copy link
Copy Markdown
Contributor

@tylerpayne fyi, adding GPQA and SimpleQA

@vballoli

Copy link
Copy Markdown
Contributor Author

@husseinmozannar This looks great, thank you for the changes!

@husseinmozannar
husseinmozannar merged commit 2db1d95 into main Jun 26, 2025
9 checks passed
@husseinmozannar
husseinmozannar deleted the QA branch June 26, 2025 18:21
stefanoamorelli pushed a commit to stefanoamorelli/magentic-ui that referenced this pull request Jun 29, 2025
Co-authored-by: Hussein Mozannar <hssein.mzannar@gmail.com>
Co-authored-by: Hussein Mozannar <hmozannar@microsoft.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants