Skip to content

@hyscale-lab HyScale

Change the repository type filter

All

    Repositories list

    19 repositories

    • vllm-gc

      Public
      Fork of vLLM for garbage collection
      Python
      •
      Apache License 2.0
      •20k•0•0•0•Updated Jul 27, 2026Jul 27, 2026

    • scholar-scout

      Public
      Python
      •
      MIT License
      •3•3•5•2•Updated Jul 25, 2026Jul 25, 2026

    • vllm-thought-eviction

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •20k•0•0•0•Updated Jul 17, 2026Jul 17, 2026

    • lmcache

      Public
      LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
      Python
      •
      Apache License 2.0
      •1.6k•0•0•0•Updated Jun 25, 2026Jun 25, 2026

    • vllm-multimodal

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •20k•0•0•0•Updated Jun 25, 2026Jun 25, 2026

    • flashinfer

      Public
      FlashInfer: Kernel Library for LLM Serving
      Python
      •
      Apache License 2.0
      •1.2k•0•0•0•Updated Jun 24, 2026Jun 24, 2026

    • hermes-agent_agent_bench

      Public
      The agent that grows with you
      Python
      •
      MIT License
      •42k•0•0•0•Updated Jun 15, 2026Jun 15, 2026

    • openclaw_agent_bench

      Public
      Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞
      TypeScript
      •
      Other
      •81k•0•0•0•Updated Jun 14, 2026Jun 14, 2026

    • OpenHands_agent_bench

      Public
      🙌 OpenHands: AI-Driven Development
      Python
      •
      Other
      •11k•0•0•0•Updated Jun 14, 2026Jun 14, 2026

    • sglang-diffusion

      Public
      SGLang is a high-performance serving framework for large language models and multimodal models.
      Python
      •
      Apache License 2.0
      •7.4k•0•0•0•Updated May 15, 2026May 15, 2026

    • LLM-Benchmarking

      Public
      Benchmarking different llm models from various cloud service providers
      Python
      •2•5•12•7•Updated May 2, 2026May 2, 2026

    • serving

      Public
      Kubernetes-based, scale-to-zero, request-driven compute
      Go
      •
      Apache License 2.0
      •1.2k•0•0•0•Updated May 1, 2026May 1, 2026

    • rdma-demo

      Public
      Go
      •0•0•0•0•Updated Mar 31, 2026Mar 31, 2026

    • vllm-worker-controller

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •20k•0•0•0•Updated Mar 22, 2026Mar 22, 2026

    • aws-sdk-go-v2

      Public
      AWS SDK for the Go programming language.
      Go
      •
      Apache License 2.0
      •809•0•0•0•Updated Mar 21, 2026Mar 21, 2026

    • verl

      Public
      verl: Volcano Engine Reinforcement Learning for LLMs
      Python
      •
      Apache License 2.0
      •4.3k•0•0•0•Updated Feb 26, 2026Feb 26, 2026

    • vllm-kvcache

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •20k•0•0•0•Updated Sep 19, 2025Sep 19, 2025

    • slimsc

      Public
      Official repository for the EMNLP 2025 paper "Slim-SC: Thought Pruning for Efficient Scaling with Self-Consistency".
      Jupyter Notebook
      •
      MIT License
      •0•14•0•0•Updated Sep 18, 2025Sep 18, 2025

    • ntu-icl-hackathon

      Public
      Scripts and docs for self-hosting infrastructure for hackathon
      Shell
      •0•0•0•0•Updated Feb 14, 2025Feb 14, 2025
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.