Skip to content

@mlcommons MLCommons

Change the repository type filter

All

    Repositories list

    117 repositories

    • modelplane

      Public
      Python
      •
      Apache License 2.0
      •0•1•10•1•Updated Dec 9, 2025Dec 9, 2025

    • croissant

      Public
      Croissant is a high-level format for machine learning datasets that brings together four rich layers.
      machine-learningschema-orgjson-lddatasets
      Jupyter Notebook
      •
      Apache License 2.0
      •94•760•168•34•Updated Dec 9, 2025Dec 9, 2025

    • mobile_app_open

      Public
      Mobile App Open
      C++
      •
      Apache License 2.0
      •29•64•52•4•Updated Dec 9, 2025Dec 9, 2025

    • modelbench

      Public
      Run safety benchmarks against AI models and view detailed reports showing how well they performed.
      Python
      •
      Apache License 2.0
      •27•112•489•4•Updated Dec 8, 2025Dec 8, 2025

    • algorithmic-efficiency

      Public
      MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvements in both training algorithms and models.
      Python
      •
      Apache License 2.0
      •76•402•26•5•Updated Dec 8, 2025Dec 8, 2025

    • mlperf-automations

      Public
      This repository contains automation scripts designed to run MLPerf Inference benchmarks. Originally developed for the Collective Mind (CM) automation framework, these scripts have been adapted to leverage the MLC automation framework, maintained by the MLCommons Benchmark Infrastructure Working Group.
      automationmlperfmlperf-inferencemlcflowmlperf-automations
      Python
      •
      Apache License 2.0
      •24•9•83•1•Updated Dec 8, 2025Dec 8, 2025

    • inference

      Public
      Reference implementations of MLPerf® inference benchmarks
      benchmarkmachine-learning
      Python
      •
      Apache License 2.0
      •593•1.5k•218•37•Updated Dec 6, 2025Dec 6, 2025

    • ck

      Public
      Collective Knowledge (CK), Collective Mind (CM/CMX) and MLPerf automations: community-driven projects to facilitate collaborative and reproducible research and to learn how to run AI, ML, and other emerging workloads more efficiently and cost-effectively across diverse models, datasets, software, and hardware using MLPerf methodology and benchmarks
      metadataeducationbenchmarkingautomationoptimizationbest-practicescollaborationcmmodularityworkflows
      Python
      •
      Apache License 2.0
      •121•638•9•1•Updated Dec 5, 2025Dec 5, 2025

    • storage

      Public
      MLPerf® Storage Benchmark Suite
      benchmarkmachine-learningperformancestorage
      Python
      •
      Apache License 2.0
      •54•170•37•4•Updated Dec 5, 2025Dec 5, 2025

    • logging

      Public
      MLPerf™ logging library
      Python
      •
      Apache License 2.0
      •53•37•41•1•Updated Dec 4, 2025Dec 4, 2025

    • training

      Public
      Reference implementations of MLPerf® training benchmarks
      benchmarkmachine-learning
      Python
      •
      Apache License 2.0
      •585•1.7k•18•3•Updated Dec 4, 2025Dec 4, 2025

    • mlperf_inference_test_submissions_v5.0

      Public
      Mermaid
      •5•0•0•0•Updated Dec 4, 2025Dec 4, 2025

    • mobile_results_v5.0

      Public
      This repository contains the results and code for the MLPerf™ Mobile Inference v5.0 benchmark.
      Apache License 2.0
      •0•0•0•0•Updated Dec 3, 2025Dec 3, 2025

    • medperf

      Public
      An open benchmarking platform for medical artificial intelligence using Federated Evaluation.
      Python
      •
      Apache License 2.0
      •36•163•53•20•Updated Dec 3, 2025Dec 3, 2025

    • mlperf_automotive

      Public
      Python
      •
      Apache License 2.0
      •6•7•2•0•Updated Dec 1, 2025Dec 1, 2025

    • dynabench

      Public
      Python
      •
      MIT License
      •18•27•8•5•Updated Dec 1, 2025Dec 1, 2025

    • tiny

      Public
      MLPerf® Tiny is an ML benchmark suite for extremely low-power systems such as microcontrollers
      C
      •
      Apache License 2.0
      •108•435•14•9•Updated Dec 1, 2025Dec 1, 2025

    • mlcflow

      Public
      MLCFlow: Simplifying MLPerf Automations
      automation-frameworkmlperfmlcflowmlperf-automations
      Python
      •
      Apache License 2.0
      •14•10•3•1•Updated Nov 28, 2025Nov 28, 2025

    • mlcube

      Public
      MLCube® is a project that reduces friction for machine learning by ensuring that models are easily portable and reproducible.
      machine-learningmlperfmlcubemlcommons
      Python
      •
      Apache License 2.0
      •31•157•35•8•Updated Nov 26, 2025Nov 26, 2025

    • common-crawl-dmlr

      Public
      Rust
      •
      Apache License 2.0
      •0•0•0•0•Updated Nov 25, 2025Nov 25, 2025

    • training_results_v5.1

      Public
      This repository contains the results and code for the MLPerf® Training v5.1 benchmark.
      Python
      •
      Apache License 2.0
      •2•2•1•0•Updated Nov 24, 2025Nov 24, 2025

    • r2-infra

      Public
      MLC Cloudflare R2 Dataset Distribution Infrastructure Management
      HTML
      •
      Apache License 2.0
      •0•1•0•0•Updated Nov 18, 2025Nov 18, 2025

    • mlperf_client

      Public
      MLPerf Client is a benchmark for Windows, Linux and macOS, focusing on client form factors in ML inference scenarios.
      benchmarkingmachine-learningml
      C++
      •
      Apache License 2.0
      •4•62•2•1•Updated Nov 17, 2025Nov 17, 2025

    • mobile_models

      Public
      MLPerf™ Mobile models
      Apache License 2.0
      •10•26•4•0•Updated Nov 16, 2025Nov 16, 2025

    • inference_results_v5.0

      Public
      This repository contains the results and code for the MLPerf™ Inference v5.0 benchmark.
      benchmarkingbenchmarkmachine-learning
      HTML
      •13•10•4•3•Updated Nov 13, 2025Nov 13, 2025

    • inference_policies

      Public
      Issues related to MLPerf® Inference policies, including rules and suggested changes
      Apache License 2.0
      •55•64•19•4•Updated Nov 11, 2025Nov 11, 2025

    • policies

      Public
      General policies for MLPerf® benchmarks including submission rules, coding standards, etc.
      Python
      •
      Apache License 2.0
      •60•31•36•40•Updated Nov 11, 2025Nov 11, 2025

    • r2-downloader

      Public
      Cloudflare Access + R2 Object Storage Dataset Download Script
      cloudflarecloudflare-accesscloudflare-r2
      Shell
      •
      Apache License 2.0
      •2•2•0•0•Updated Nov 10, 2025Nov 10, 2025

    • inference_results_v5.1

      Public
      This repository contains the results and code for the MLPerf™ Inference v5.1 benchmark.
      benchmarkingbenchmarkmachine-learning
      HTML
      •8•0•0•0•Updated Oct 29, 2025Oct 29, 2025

    • chakra

      Public
      Repository for MLCommons Chakra schema and tools
      Python
      •
      Apache License 2.0
      •61•143•42•1•Updated Oct 23, 2025Oct 23, 2025