MIT HAN Lab

All

62 repositories

fastrl
Public
[ASPLOS'26] Taming the Long-Tail: Efficient Reasoning RL Training with Adaptive Drafter
Python
•
Apache License 2.0
•2•66•2•0•Updated Nov 26, 2025Nov 26, 2025
flash-moba
Public
C++
•
BSD 3-Clause "New" or "Revised" License
•6•193•3•0•Updated Nov 19, 2025Nov 19, 2025
radial-attention
Public
[NeurIPS 2025] Radial Attention: O(nlogn) Sparse Attention with Energy Decay for Long Video Generation
wan mochi diffusion-models sparse-attention efficientml hunyuan-video
Python
•
Apache License 2.0
•29•559•14•1•Updated Nov 11, 2025Nov 11, 2025
torchquantum
Public
A PyTorch-based framework for Quantum Classical Simulation, Quantum Machine Learning, Quantum Neural Networks, Parameterized Quantum Circuits with support for easy deployments on real quantum computers.
machine-learning system deep-learning neural-network quantum pytorch quantum-computing quantum-machine-learning quantum-simulation ml-for-systems
Jupyter Notebook
•
MIT License
•242•1.6k•69•9•Updated Oct 28, 2025Oct 28, 2025
streaming-vlm
Public
StreamingVLM: Real-Time Understanding for Infinite Video Streams
Python
•
MIT License
•46•733•10•0•Updated Oct 15, 2025Oct 15, 2025
efficientvit
Public
Efficient vision foundation models for high-resolution generation and perception.
imagenet segmentation high-resolution vision-transformer efficientvit segment-anything deep-compression-autoencoder efficient-diffusion-model
Python
•
Apache License 2.0
•232•3.2k•108•0•Updated Sep 5, 2025Sep 5, 2025
llm-awq
Public
[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
Python
•
MIT License
•283•3.4k•169•10•Updated Jul 17, 2025Jul 17, 2025
lpd
Public
Locality-aware Parallel Decoding for Efficient Autoregressive Image Generation
acceleration imagenet image-generation autoregressive efficient-algorithm parallel-decoding
Python
•
MIT License
•6•80•1•0•Updated Jul 13, 2025Jul 13, 2025
Quest
Public
[ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
Cuda
•
MIT License
•38•355•5•0•Updated Jul 10, 2025Jul 10, 2025
x-attention
Public
[ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring
Python
•15•255•9•0•Updated Jul 6, 2025Jul 6, 2025
vila-u
Public
[ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation
Python
•
MIT License
•17•410•18•0•Updated Apr 25, 2025Apr 25, 2025
omniserve
Public
[MLSys'25] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; [MLSys'25] LServe: Efficient Long-sequence LLM Serving with Unified Sparse Attention
C++
•
Apache License 2.0
•54•786•45•4•Updated Mar 6, 2025Mar 6, 2025
torchsparse
Public
[MICRO'23, MLSys'22] TorchSparse: Efficient Training and Inference Framework for Sparse Convolution on GPUs.
acceleration pytorch
Cuda
•
MIT License
•177•1.4k•51•3•Updated Feb 24, 2025Feb 24, 2025
VisCompare
Public
A WebUI for Side-by-Side Comparison of Media (Images/Videos) Across Multiple Folders
python ui video images webui diffusion-models streamlit generative-ai
Python
•
Apache License 2.0
•2•24•0•0•Updated Feb 21, 2025Feb 21, 2025
Block-Sparse-Attention
Public
A sparse attention kernel supporting mix sparse patterns
C++
•
BSD 3-Clause "New" or "Revised" License
•32•389•10•1•Updated Feb 13, 2025Feb 13, 2025
duo-attention
Public
[ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
Python
•
MIT License
•36•507•14•1•Updated Feb 10, 2025Feb 10, 2025
patch_conv
Public
Patch convolution to avoid large GPU memory usage of Conv2D
Python
•
MIT License
•8•93•2•1•Updated Jan 23, 2025Jan 23, 2025
fastcomposer
Public
[IJCV] FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention
Python
•
MIT License
•42•710•16•0•Updated Jan 10, 2025Jan 10, 2025
sparserefine
Public
[ECCV 2024] SparseRefine: Sparse Refinement for Efficient High-Resolution Semantic Segmentation
Python
•
MIT License
•1•15•1•0•Updated Jan 10, 2025Jan 10, 2025
distrifuser
Public
[CVPR 2024 Highlight] DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models
acceleration parallelism generative-model diffusion-models generative-ai
Python
•
MIT License
•31•713•11•1•Updated Dec 2, 2024Dec 2, 2024
tinyengine
Public
[NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021] MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning; [NeurIPS 2022] MCUNetV3: On-Device Training Under 256KB Memory
c microcontroller deep-learning cpp pytorch codegenerator quantization edge-computing neural-architecture-search tinyml
C
•
MIT License
•154•908•35•1•Updated Nov 27, 2024Nov 27, 2024
tinychat-tutorial
Public
C++
•27•76•4•3•Updated Nov 5, 2024Nov 5, 2024
hart
Public
HART: Efficient Visual Generation with Hybrid Autoregressive Transformer
Python
•
MIT License
•42•642•19•2•Updated Oct 16, 2024Oct 16, 2024
data-efficient-gans
Public
[NeurIPS 2020] Differentiable Augmentation for Data-Efficient GAN Training
tensorflow pytorch generative-adversarial-network image-generation gans data-efficient neurips-2020
Python
•
BSD 2-Clause "Simplified" License
•176•1.3k•28•0•Updated Sep 24, 2024Sep 24, 2024
proxylessnas
Public
[ICLR 2019] ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware
acceleration automl specialization efficient-model on-device-ai hardware-aware
C++
•
MIT License
•287•1.5k•0•2•Updated Aug 30, 2024Aug 30, 2024
spatten
Public
[HPCA'21] SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning
rtl attention hardware-acceleration spinalhdl llm-inference
Scala
•
MIT License
•12•114•2•0•Updated Aug 27, 2024Aug 27, 2024
bevfusion
Public archive
[ICRA'23] BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representation
camera pytorch lidar object-detection sensor-fusion semantic-segmentation 3d-perception
Python
•
Apache License 2.0
•528•2.9k•0•0•Updated Jul 31, 2024Jul 31, 2024
hardware-aware-transformers
Public
[ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing
natural-language-processing machine-translation transformer specialization efficient-model hardware-aware
Python
•
Other
•51•336•3•0•Updated Jul 14, 2024Jul 14, 2024
smoothquant
Public
[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
Python
•
MIT License
•190•1.6k•71•0•Updated Jul 12, 2024Jul 12, 2024
spvnas
Public archive
[ECCV 2020] Searching Efficient 3D Architectures with Sparse Point-Voxel Convolution
computer-vision deep-learning efficiency point-cloud pytorch lidar 3d-deep-learning architecture-search semantickitti
Python
•
MIT License
•113•618•0•0•Updated Jul 11, 2024Jul 11, 2024