Pinned Loading

1. DeepSpeed DeepSpeed Public

   Forked from deepspeedai/DeepSpeed

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python

2. forge forge Public

   GPT-2 kernel fusion with Triton: a FlashAttention-style fused causal attention kernel, benchmarked and profiled on an NVIDIA A100.

   Python

3. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 86.3k 19.4k

4. private-text private-text Public

   Python

5. ticket-priority-classifier ticket-priority-classifier Public

   Python

6. server server Public

   Forked from triton-inference-server/server

   The Triton Inference Server provides an optimized cloud and edge inferencing solution.

   Python