Commit b8b1196
committed
This commit documents the official release of **LMMS-Eval v0.5: Multimodal Expansion**, detailing significant new features including:
* A comprehensive **audio evaluation suite** (Step2 Audio Paralinguistic, VoiceBench, WenetSpeech).
* A production-ready **response caching system**.
* Integration of **five new models** (e.g., GPT-4o Audio Preview, Gemma-3).
* Addition of **numerous new benchmarks** across vision, coding, and STEM domains.
* Support for the **Model Context Protocol (MCP)** and improvements to **Async OpenAI integration**.1 parent 8cf34cb commit b8b1196
1 file changed
Lines changed: 637 additions & 27 deletions
0 commit comments