Search results

Feature Request: Support multimodal models in correctness test

Status: Open.

#88 In ray-project/llmperf;

· liu-shaojun opened on Mar 12, 2025

How to solve ”ZeroDivisionError: division by zero“

Status: Open.

#87 In ray-project/llmperf;

· Mbmfc opened on Mar 12, 2025

Using multiples CPUs

Status: Open.

#86 In ray-project/llmperf;

· dsantiago opened on Mar 7, 2025

Cannot build with ray in Docker

Status: Open.

#84 In ray-project/llmperf;

· Fmstrat opened on Feb 23, 2025

commit: f1d6bed , In some scenarios, the number of requests will double and the input length will be fixed at two number

Status: Open.

#82 In ray-project/llmperf;

· lq2030 opened on Feb 10, 2025

Support other scenarios

Status: Open.

#78 In ray-project/llmperf;

· yw-furiosa opened on Oct 28, 2024

how to test vllm interface

Status: Open.

#77 In ray-project/llmperf;

· ZTurboX opened on Oct 25, 2024

Using max_concurrency or AsyncActor?

Status: Open.

#76 In ray-project/llmperf;

· chiragjn opened on Oct 21, 2024

Wrong generated prompt length

Status: Open.

#75 In ray-project/llmperf;

· PietroFerr opened on Oct 18, 2024

Error while using pip

Status: Open.

#70 In ray-project/llmperf;

· avi7611 opened on Sep 16, 2024

Contributions guidelines

Status: Open.

#69 In ray-project/llmperf;

· miloszwatroba opened on Sep 16, 2024

Azure OpenAi Endpoint Support

Status: Open.

#67 In ray-project/llmperf;

· gujju62 opened on Aug 22, 2024