System Info / 系統信息
CUDA Version: 13.1
Windows 11
5060ti
Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?
Version info / 版本信息
v2.13.0
The command used to start Xinference / 用以启动 xinference 的命令
docker run --name xinference -d --restart always -p 9997:9997 -e XINFERENCE_MODEL_SRC=modelscope -e XINFERENCE_HOME=/data -v "D:\work\code\xinference\xinference_models:/data" --gpus all xprobe/xinference:v2.12.0 xinference-local -H 0.0.0.0 --log-level debug
Reproduction / 复现过程
UI界面安装启动模型,然后报错:
其日志为:
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1387, in _gcd_import
File "", line 1360, in _find_and_load
File "", line 1331, in _find_and_load_unlocked
File "", line 935, in _load_unlocked
File "", line 999, in exec_module
File "", line 488, in _call_with_frames_removed
File "/usr/local/lib/python3.12/dist-packages/diffusers/pipelines/auto_pipeline.py", line 21, in
from ..models.controlnets import ControlNetUnionModel
^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/diffusers/models/controlnets/init.py", line 5, in
from .controlnet import ControlNetModel, ControlNetOutput
^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/diffusers/models/controlnets/controlnet.py", line 22, in
from ...loaders import PeftAdapterMixin
^^^^^^^^^^^^^^^^^
File "", line 1412, in _handle_fromlist
File "/usr/local/lib/python3.12/dist-packages/diffusers/utils/import_utils.py", line 1042, in getattr
module = self._get_module(self._class_to_module[name])
^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/dist-packages/diffusers/utils/import_utils.py", line 1054, in _get_module
raise RuntimeError(
^^^^^^^^^^^^^^^^^
RuntimeError: Failed to import diffusers.loaders.peft because of the following error (look up to see its traceback):
cannot import name 'HybridCache' from 'transformers' (/usr/local/lib/python3.12/dist-packages/transformers/init.py)
Expected behavior / 期待表现
正常安装运行
System Info / 系統信息
CUDA Version: 13.1
Windows 11
5060ti
Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?
Version info / 版本信息
v2.13.0
The command used to start Xinference / 用以启动 xinference 的命令
docker run --name xinference -d --restart always -p 9997:9997 -e XINFERENCE_MODEL_SRC=modelscope -e XINFERENCE_HOME=/data -v "D:\work\code\xinference\xinference_models:/data" --gpus all xprobe/xinference:v2.12.0 xinference-local -H 0.0.0.0 --log-level debug
Reproduction / 复现过程
UI界面安装启动模型,然后报错:
其日志为:
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1387, in _gcd_import
File "", line 1360, in _find_and_load
File "", line 1331, in _find_and_load_unlocked
File "", line 935, in _load_unlocked
File "", line 999, in exec_module
File "", line 488, in _call_with_frames_removed
File "/usr/local/lib/python3.12/dist-packages/diffusers/pipelines/auto_pipeline.py", line 21, in
File "/usr/local/lib/python3.12/dist-packages/diffusers/models/controlnets/init.py", line 5, in
File "/usr/local/lib/python3.12/dist-packages/diffusers/models/controlnets/controlnet.py", line 22, in
File "", line 1412, in _handle_fromlist
File "/usr/local/lib/python3.12/dist-packages/diffusers/utils/import_utils.py", line 1042, in getattr
File "/usr/local/lib/python3.12/dist-packages/diffusers/utils/import_utils.py", line 1054, in _get_module
RuntimeError: Failed to import diffusers.loaders.peft because of the following error (look up to see its traceback):
cannot import name 'HybridCache' from 'transformers' (/usr/local/lib/python3.12/dist-packages/transformers/init.py)
Expected behavior / 期待表现
正常安装运行