Search results

BUG: Gemma-3-1b-it failed for transformers engine

bugSomething isn't workingSomething isn't working

gpu

Status: Open.

#3118 In xorbitsai/inference;

· qinxuye opened on Mar 25, 2025

 ·  

v1.x

AMD GPU pip安装transformers引擎报错cuda

gpu

Status: Open.

#3114 In xorbitsai/inference;

· hitechbeijing opened on Mar 24, 2025

 ·  

v1.x

XInference部署本地下载的OCR模型（读光-文字识别-行识别模型-中英-文档印刷体文本领域）报错

gpu

Status: Open.

#3113 In xorbitsai/inference;

· wjyrun opened on Mar 24, 2025

 ·  

v1.x

docker部署无法识别gpu 8.1版本

gpu

Status: Open.

#3112 In xorbitsai/inference;

· mrguo6221 opened on Mar 24, 2025

 ·  

v1.x

[Install Error] exec pip install "xinference[all]" occurred an error.

Status: Open.

#3111 In xorbitsai/inference;

· hllshiro opened on Mar 24, 2025

 ·  

v1.x

In web page "launch model"--"cpu",embedding model can run on cpu. BUT runs commands on the GPU when executed in Ubuntu.

gpu

Status: Open.

#3109 In xorbitsai/inference;

· jeccyyeah opened on Mar 23, 2025

 ·  

v1.x

gemma3回答一小部分就会被截断

gpu

Status: Open.

#3108 In xorbitsai/inference;

· ZimaBlueee opened on Mar 22, 2025

 ·  

v1.x

gemma3推理引擎没有vllm选项

gpu

Status: Open.

#3107 In xorbitsai/inference;

· ZimaBlueee opened on Mar 22, 2025

 ·  

v1.x

同一个Reranker模型，相同的输入，在xinference跟原生Transformers下差别很大，且xinference输出错误的结果

gpu

Status: Open.

#3104 In xorbitsai/inference;

· zhangever opened on Mar 21, 2025

 ·  

v1.x

Hope to support CogView4-6B

feature

Status: Open.

#3101 In xorbitsai/inference;

· TraceIvan opened on Mar 21, 2025

 ·  

v1.x

deepseek-r1-awq无法启动

gpu

Status: Open.

#3100 In xorbitsai/inference;

· ye7love7 opened on Mar 21, 2025

 ·  

v1.x

Xinference does not work properly with HTTP/HTTPS proxy

gpu

Status: Open.

#3099 In xorbitsai/inference;

· HansYeoh opened on Mar 20, 2025

 ·  

v1.x