Search results

AttributeError: 'Namespace' object has no attribute 'max_concurrent'

Status: Open.

#5 In huseinzol05/transformers-continuous-batching;

· CalunVier opened on May 24, 2025

since VPTQ has been added to the Transformers library, will your program support it for the oai api?

Status: Open.

#4 In huseinzol05/transformers-continuous-batching;

· ColumbusAI opened on Jan 27, 2025

Guidance on Dynamically Loading HF Models and Tokenizers

Status: Open.

#3 In huseinzol05/transformers-continuous-batching;

· NEWbie0709 opened on Dec 11, 2024

add paged attention

Status: Open.

#2 In huseinzol05/transformers-continuous-batching;

· huseinzol05 opened on Oct 29, 2024

Running models on CPU.

Status: Open.

#1 In huseinzol05/transformers-continuous-batching;

· zianttt opened on Oct 15, 2024