Skip to content
View happierpig's full-sized avatar
279 followers · 263 following

Achievements

Achievement: Pair Extraordinairex3Achievement: Pull Sharkx3Achievement: YOLOAchievement: Starstruckx2

Achievements

Achievement: Pair Extraordinairex3Achievement: Pull Sharkx3Achievement: YOLOAchievement: Starstruckx2

Highlights

  • Pro

Block or report happierpig

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

Pinned Loading

  1. efeslab/Atom efeslab/Atom Public

    [MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving

    Cuda 337 31

  2. efeslab/Nanoflow efeslab/Nanoflow Public

    A throughput-oriented high-performance serving framework for LLMs

    Jupyter Notebook 952 48

  3. mit-han-lab/Quest mit-han-lab/Quest Public

    [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference

    Cuda 380 46

  4. flashinfer-ai/flashinfer flashinfer-ai/flashinfer Public

    FlashInfer: Kernel Library for LLM Serving

    Python 5.4k 892