Repositories list

• SearchAgentService

  Public
  Python

  •1•0•0•0•Updated Apr 2, 2026Apr 2, 2026

• SWE-bench-server

  Public
  Python

  •0•1•0•0•Updated Mar 31, 2026Mar 31, 2026

• opencompass

  Public
  OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets…

  benchmarkevaluationopenai+ 5

  benchmarkevaluationopenaillmchatgptlarge-language-modelllama2llama3

  Python

  •

  Apache License 2.0

  •756•6.8k•372•70•Updated Mar 30, 2026Mar 30, 2026

• VLMEvalKit

  Public
  Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

  computer-visionevaluationpytorch+ 16

  computer-visionevaluationpytorchgeminiopenaivqavitgptmulti-modalclip+ 9

  Python

  •

  Apache License 2.0

  •665•4k•203•27•Updated Mar 27, 2026Mar 27, 2026

• TextEdit

  Public
  We provide TextEdit, a high-quality, multi-scenario text editing benchmark for generation models.

  Python

  •

  MIT License

  •0•19•0•0•Updated Mar 16, 2026Mar 16, 2026

• GenEditEvalKit

  Public
  The first unified, efficient, and extensible evaluation toolkit for evaluating image generation and editing models across multiple benchmarks.

  Jupyter Notebook

  •

  MIT License

  •4•39•0•1•Updated Mar 11, 2026Mar 11, 2026

• GTA

  Public
  [NeurIPS 2024 D&B Track] GTA: A Benchmark for General Tool Agents

  llm-agentllm-evaluation

  llm-agentllm-evaluation

  Python

  •

  Apache License 2.0

  •9•138•0•0•Updated Feb 16, 2026Feb 16, 2026

• MiroFlow

  Public
  MiroMind Research Agent: Fully Open-Source Deep Research Agent with Reproducible State-of-the-Art Performance on FutureX, GAIA, HLE, BrowserComp and xBench.

  Python

  •

  Apache License 2.0

  •301•0•0•0•Updated Dec 30, 2025Dec 30, 2025

• RePro

  Public
  [ICLR 2026] Rectifying LLM Thought From Lens of Optimization

  reinforcement-learninglarge-language-modellarge-language-model-reasoning

  reinforcement-learninglarge-language-modellarge-language-model-reasoning

  Python

  •

  MIT License

  •4•14•1•0•Updated Dec 5, 2025Dec 5, 2025

• SAGA

  Public
  The code repository for the NeurIPS 2025 paper "Rethinking Verification for LLM Code Generation: From Generation to Testing."

  0•11•1•0•Updated Nov 27, 2025Nov 27, 2025

• ATLAS

  Public
  ATLAS: A High-Difficulty, Multidisciplinary Benchmark for Frontier Scientific Reasoning

  1•6•0•0•Updated Nov 20, 2025Nov 20, 2025

• OASIS

  Public
  Python

  •0•3•0•0•Updated Nov 12, 2025Nov 12, 2025

• InteractScience

  Public
  JavaScript

  •

  Apache License 2.0

  •0•8•0•0•Updated Oct 31, 2025Oct 31, 2025

• CognitiveKernel-Pro

  Public
  Deep Research Agent CognitiveKernel-Pro from Tencent AI Lab. Paper: https://arxiv.org/pdf/2508.00414

  Python

  •

  Other

  •50•0•0•0•Updated Oct 27, 2025Oct 27, 2025

• GAOKAO-Eval

  Public
  Jupyter Notebook

  •7•116•5•0•Updated Oct 7, 2025Oct 7, 2025

• .github

  Public
  1•0•0•0•Updated Sep 9, 2025Sep 9, 2025

• MMBench-GUI

  Public
  Official repo of "MMBench-GUI: Hierarchical Multi-Platform Evaluation Framework for GUI Agents". It can be used to evaluate a GUI agent with a hierarchical mann…

  benchmark-frameworkvision-language-modelcomputer-use+ 1

  benchmark-frameworkvision-language-modelcomputer-usegui-agent

  Python

  •6•103•5•0•Updated Sep 8, 2025Sep 8, 2025

• ReasonZoo

  Public
  Python

  •

  Apache License 2.0

  •0•3•0•0•Updated Aug 27, 2025Aug 27, 2025

• CompassVerifier

  Public
  [EMNLP 2025] CompassVerifier: A Unified and Robust Verifier for LLMs Evaluation and Outcome Reward

  Jupyter Notebook

  •2•68•0•0•Updated Aug 10, 2025Aug 10, 2025

• GPassK

  Public
  [ACL 2025] Are Your LLMs Capable of Stable Reasoning?

  large-language-model-evaluationreasoning-stability

  large-language-model-evaluationreasoning-stability

  Python

  •2•32•2•0•Updated Aug 5, 2025Aug 5, 2025

• Creation-MMBench

  Public
  Assessing Context-Aware Creative Intelligence in MLLMs

  JavaScript

  •0•23•1•0•Updated Jul 22, 2025Jul 22, 2025

• CompassJudger

  Public
  The All-in-one Judge Models introduced by Opencompass

  Apache License 2.0

  •6•119•1•0•Updated Jul 15, 2025Jul 15, 2025

• RaML

  Public
  [Preprint 2025] Deciphering Trajectory-Aided LLM Reasoning: An Optimization Perspective

  Jupyter Notebook

  •2•8•0•0•Updated May 27, 2025May 27, 2025

• BotChat

  Public
  Evaluating LLMs' multi-round chatting capability via assessing conversations generated by two LLM instances.

  Jupyter Notebook

  •

  Apache License 2.0

  •7•162•2•0•Updated May 22, 2025May 22, 2025

• Ada-LEval

  Public
  The official implementation of "Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks"

  gpt4llmlong-context

  gpt4llmlong-context

  Python

  •3•56•0•0•Updated May 22, 2025May 22, 2025

• MathBench

  Public
  [ACL 2024 Findings] MathBench: A Comprehensive Multi-Level Difficulty Mathematics Evaluation Dataset

  Apache License 2.0

  •1•112•5•0•Updated May 22, 2025May 22, 2025

• MMBench

  Public
  Official Repo of "MMBench: Is Your Multi-modal Model an All-around Player?"

  Apache License 2.0

  •17•296•13•0•Updated May 22, 2025May 22, 2025

• ProSA

  Public
  [EMNLP 2024 Findings] ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs

  Python

  •

  Apache License 2.0

  •2•29•0•0•Updated May 22, 2025May 22, 2025

• ANAH

  Public
  [ACL 2024] ANAH & [NeurIPS 2024] ANAH-v2 & [ICLR 2025] Mask-DPO

  aclalignmentgpt+ 5

  aclalignmentgpticlrneuripsllmshallucination-detectionhallucination-mitigation

  Python

  •

  Apache License 2.0

  •3•63•1•0•Updated Apr 30, 2025Apr 30, 2025

• oc_doc_website

  Public
  0•0•0•0•Updated Feb 12, 2025Feb 12, 2025