Skip to content

Pull requests: openai/evals

New pull request New
165 Open 1,272 Closed
165 Open 1,272 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix get_bootstrap_accuracy_std: NaN on single-sample runs and incorrect resampling
#1834 opened Sep 14, 2026 by arpankernel Loading…
Add RES actor-indexed control eval
#1831 opened Sep 9, 2026 by NeonInsight Loading…
14 tasks done
1
1
Preserve chat messages when escaping prompt formatting
#1830 opened Sep 9, 2026 by rksharma-owg Loading…
Harden the GitHub Actions workflows
#1828 opened Sep 7, 2026 by Nikhils-G Loading…
1
Fix unbounded API retries
#1823 opened Sep 3, 2026 by sylvesterkaczmarek Loading…
fix: bound API retries and drop dead error-dict checks
#1821 opened Sep 3, 2026 by Alphaxiaoteng Loading…
3 of 4 tasks
1
Fix HttpRecorder silent event loss
#1820 opened Aug 29, 2026 by deathsamsul Loading…
1
1
Fix MakeMeSay dict response handling
#1815 opened Aug 22, 2026 by Pavanka1yan Loading…
1
Forward runtime kwargs through LangChain wrappers
#1814 opened Aug 21, 2026 by sylvesterkaczmarek Loading…
1
Flag missing required Steganography output fields
#1813 opened Aug 21, 2026 by sylvesterkaczmarek Loading…
1
Use per-sample RNG in SchellingPoint
#1812 opened Aug 21, 2026 by sylvesterkaczmarek Loading…
1
Support dictionary responses in MakeMeSay get_content
#1808 opened Aug 21, 2026 by sylvesterkaczmarek Loading…
1
Treat missing ML Agent action arguments as invalid
#1807 opened Aug 21, 2026 by sylvesterkaczmarek Loading…
1
Preserve system messages when reversing Ballots roles
#1806 opened Aug 21, 2026 by sylvesterkaczmarek Loading…
1
Skip undefined no-control samples in post-hoc recall
#1802 opened Aug 21, 2026 by sylvesterkaczmarek Loading…
1
Do not classify empty lists as chat prompts
#1801 opened Aug 21, 2026 by sylvesterkaczmarek Loading…
1
Remove only the exact LangChain Answer prefix
#1800 opened Aug 21, 2026 by sylvesterkaczmarek Loading…
1
Report exhausted tool runs with the actual turn count
#1796 opened Aug 21, 2026 by sylvesterkaczmarek Loading…
1
Count perfect TrackTheStat runs at full length
#1795 opened Aug 21, 2026 by sylvesterkaczmarek Loading…
1
Restore registry logging after Bluff solver lookup
#1794 opened Aug 21, 2026 by sylvesterkaczmarek Loading…
1
Preserve separators in FunctionDeduction responses
#1790 opened Aug 21, 2026 by sylvesterkaczmarek Loading…
1
Report MakeMePay success rate as a percentage
#1789 opened Aug 21, 2026 by sylvesterkaczmarek Loading…
1
Handle uncapped sampling in AlreadySaidThat
#1788 opened Aug 21, 2026 by sylvesterkaczmarek Loading…
1
Preserve equal max_replies in TwentyQuestions
#1784 opened Aug 21, 2026 by sylvesterkaczmarek Loading…
1
Reject empty fuzzy matches in SelfPrompting
#1783 opened Aug 21, 2026 by sylvesterkaczmarek Loading…
1
ProTip! Updated in the last three days: updated:>2026-09-14.