Inference Bench

[Delaunay]

LLM (vLLM)

• MoE - reasoning

  • llama 4 - Maverick
  • https://huggingface.co/datasets/HuggingFaceH4/MATH-500

• Dense - Questions

  • https://huggingface.co/datasets/hendrydong/gpqa_diamond
  • https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/tree/main

Audio

• Whisper: Speech recognition | Speach to text
• Dataset: (?)
• https://github.com/ggml-org/whisper.cpp

Text to Image en mode inference

• Stable Diffusion
• Text to image | image to text
• Dataset: (?)
• Model: FLUX
  • https://huggingface.co/black-forest-labs/FLUX.1-dev

Others

• Alpha Fold

• llama 3 - DENSE

  • Dataset of question

• Gros ctx - small response https://huggingface.co/datasets/mandarjoshi/trivia_qa

• https://github.com/SWE-bench/SWE-bench