Search results

please surport https://huggingface.co/Skywork/Skywork-R1V-38B

feature

Status: Open.

#3084 In xorbitsai/inference;

· moshilangzi opened on Mar 19, 2025

 ·  

v1.x

申请支持： https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503的并发推理

feature

Status: Open.

#3083 In xorbitsai/inference;

· moshilangzi opened on Mar 19, 2025

 ·  

v1.x

和DeepSeek保持一致的流式输出

feature

Status: Open.

#3082 In xorbitsai/inference;

· autherlj opened on Mar 18, 2025

 ·  

v1.x

支持音频模型FireRedASR

feature

Status: Open.

#3080 In xorbitsai/inference;

· hpx502766238 opened on Mar 18, 2025

 ·  

v1.x

Building cuda extension requires PyTorch (>=1.13.0) being installed, please install PyTorch first: No module named 'torch'

gpu

Status: Open.

#3079 In xorbitsai/inference;

· Liusuqing opened on Mar 18, 2025

 ·  

v1.x

inference arm64 support

feature

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#3076 In xorbitsai/inference;

· drummerglen opened on Mar 17, 2025

 ·  

v1.x

模型部署的时候，model engine无法选择vllm部署

gpu

Status: Open.

#3075 In xorbitsai/inference;

· zhangxid opened on Mar 16, 2025

 ·  

v1.x

用cpu部署，加载模型后不断重启模型

gpu

Status: Open.

#3074 In xorbitsai/inference;

· asking002 opened on Mar 16, 2025

 ·  

v1.x

分布式模型不能使用身份验证

Status: Open.

#3073 In xorbitsai/inference;

· YSblack opened on Mar 16, 2025

 ·  

v1.x

Xinference是否支持部署 modelscope社区的OnniSQL模型？

Status: Open.

#3071 In xorbitsai/inference;

· yangyang9966 opened on Mar 16, 2025

 ·  

v1.x

vllm参数配置bug

gpu

Status: Open.

#3070 In xorbitsai/inference;

· Liguoz opened on Mar 15, 2025

 ·  

v1.x

嵌入式模型bge-m在处理文本创建向量数据库阶段报warning

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#3069 In xorbitsai/inference;

· Liguoz opened on Mar 15, 2025

 ·  

v1.x