Skip to content

[fix] reord back to original for openai_compatible#855

Merged
Luodian merged 1 commit into
EvolvingLMMs-Lab:mainfrom
Leymore:leymore/reord-back-openai
Oct 16, 2025
Merged

[fix] reord back to original for openai_compatible#855
Luodian merged 1 commit into
EvolvingLMMs-Lab:mainfrom
Leymore:leymore/reord-back-openai

Conversation

@Leymore

@Leymore Leymore commented Oct 11, 2025

Copy link
Copy Markdown
Contributor

this pr fixes the bug introduced by #835, where the resps are in random order and cannot match the original docs. reord back to original for openai_compatible fixes this bug.

please consider bumping version after the pr is merged, as the current openai_compatible is not functional.

@Luodian Luodian merged commit 42b4e2e into EvolvingLMMs-Lab:main Oct 16, 2025
1 check passed
@Leymore Leymore deleted the leymore/reord-back-openai branch November 17, 2025 20:35
ArdalanM pushed a commit to ArdalanM/lmms-eval that referenced this pull request Nov 26, 2025
)

Co-authored-by: Fengzhe Zhou <fengzhez@nvidia.com>
Luodian pushed a commit that referenced this pull request Feb 28, 2026
Co-authored-by: Fengzhe Zhou <fengzhez@nvidia.com>
stisiTT pushed a commit to bgoelTT/lmms-eval that referenced this pull request Mar 6, 2026
)

Co-authored-by: Fengzhe Zhou <fengzhez@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants