按照README_xinference.md搭建成功后调用 glm， Xinference报错get_logits_warper() missing 1 required positional argument: 'device'

[liang-xian]

Xinference报错信息：

Traceback (most recent call last):
  File "/opt/conda/envs/xinference/lib/python3.8/site-packages/xinference/api/restful_api.py", line 1584, in stream_results
    async for item in iterator:
  File "/opt/conda/envs/xinference/lib/python3.8/site-packages/xoscar/api.py", line 340, in __anext__
    return await self._actor_ref.__xoscar_next__(self._uid)
  File "/opt/conda/envs/xinference/lib/python3.8/site-packages/xoscar/backends/context.py", line 227, in send
    return self._process_result_message(result)
  File "/opt/conda/envs/xinference/lib/python3.8/site-packages/xoscar/backends/context.py", line 102, in _process_result_message
    raise message.as_instanceof_cause()
  File "/opt/conda/envs/xinference/lib/python3.8/site-packages/xoscar/backends/pool.py", line 659, in send
    result = await self._run_coro(message.message_id, coro)
  File "/opt/conda/envs/xinference/lib/python3.8/site-packages/xoscar/backends/pool.py", line 370, in _run_coro
    return await coro
  File "/opt/conda/envs/xinference/lib/python3.8/site-packages/xoscar/api.py", line 384, in __on_receive__
    return await super().__on_receive__(message)  # type: ignore
  File "xoscar/core.pyx", line 558, in __on_receive__
    raise ex
  File "xoscar/core.pyx", line 520, in xoscar.core._BaseActor.__on_receive__
    async with self._lock:
  File "xoscar/core.pyx", line 521, in xoscar.core._BaseActor.__on_receive__
    with debug_async_timeout('actor_lock_timeout',
  File "xoscar/core.pyx", line 526, in xoscar.core._BaseActor.__on_receive__
    result = await result
  File "/opt/conda/envs/xinference/lib/python3.8/site-packages/xoscar/api.py", line 431, in __xoscar_next__
    raise e
  File "/opt/conda/envs/xinference/lib/python3.8/site-packages/xoscar/api.py", line 417, in __xoscar_next__
    r = await asyncio.to_thread(_wrapper, gen)
  File "/opt/conda/envs/xinference/lib/python3.8/site-packages/xoscar/aio/_threads.py", line 35, in to_thread
    return await loop.run_in_executor(None, func_call)
  File "/opt/conda/envs/xinference/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/opt/conda/envs/xinference/lib/python3.8/site-packages/xoscar/api.py", line 402, in _wrapper
    return next(_gen)
  File "/opt/conda/envs/xinference/lib/python3.8/site-packages/xinference/core/model.py", line 318, in _to_json_generator
    for v in gen:
  File "/opt/conda/envs/xinference/lib/python3.8/site-packages/xinference/model/llm/utils.py", line 558, in _to_chat_completion_chunks
    for i, chunk in enumerate(chunks):
  File "/opt/conda/envs/xinference/lib/python3.8/site-packages/xinference/model/llm/pytorch/chatglm.py", line 259, in _stream_generator
    for chunk_text, _ in self._model.stream_chat(
  File "/opt/conda/envs/xinference/lib/python3.8/site-packages/torch/utils/_contextlib.py", line 35, in generator_context
    response = gen.send(None)
  File "/root/.cache/huggingface/modules/transformers_modules/glm-4-9b-chat/modeling_chatglm.py", line 1012, in stream_chat
    for outputs in self.stream_generate(**inputs, past_key_values=past_key_values,
  File "/opt/conda/envs/xinference/lib/python3.8/site-packages/torch/utils/_contextlib.py", line 35, in generator_context
    response = gen.send(None)
  File "/root/.cache/huggingface/modules/transformers_modules/glm-4-9b-chat/modeling_chatglm.py", line 1092, in stream_generate
    logits_warper = self._get_logits_warper(generation_config)
TypeError: [address=0.0.0.0:44671, pid=1580] _get_logits_warper() missing 1 required positional argument: 'device'

Langchain-Chatchat 报错信息：

Traceback (most recent call last):
  File "/opt/conda/envs/chatchat/lib/python3.8/site-packages/streamlit/runtime/scriptrunner/script_runner.py", line 600, in _run_script
    exec(code, module.__dict__)
  File "/opt/conda/envs/chatchat/lib/python3.8/site-packages/chatchat/webui.py", line 69, in <module>
    dialogue_page(api=api, is_lite=is_lite)
  File "/opt/conda/envs/chatchat/lib/python3.8/site-packages/chatchat/webui_pages/dialogue/dialogue.py", line 361, in dialogue_page
    for d in client.chat.completions.create(
  File "/opt/conda/envs/chatchat/lib/python3.8/site-packages/openai/_streaming.py", line 46, in __iter__
    for item in self._iterator:
  File "/opt/conda/envs/chatchat/lib/python3.8/site-packages/openai/_streaming.py", line 58, in __stream__
    for sse in iterator:
  File "/opt/conda/envs/chatchat/lib/python3.8/site-packages/openai/_streaming.py", line 50, in _iter_events
    yield from self._decoder.iter_bytes(self.response.iter_bytes())
  File "/opt/conda/envs/chatchat/lib/python3.8/site-packages/openai/_streaming.py", line 280, in iter_bytes
    for chunk in self._iter_chunks(iterator):
  File "/opt/conda/envs/chatchat/lib/python3.8/site-packages/openai/_streaming.py", line 291, in _iter_chunks
    for chunk in iterator:
  File "/opt/conda/envs/chatchat/lib/python3.8/site-packages/httpx/_models.py", line 829, in iter_bytes
    for raw_bytes in self.iter_raw():
  File "/opt/conda/envs/chatchat/lib/python3.8/site-packages/httpx/_models.py", line 883, in iter_raw
    for raw_stream_bytes in self.stream:
  File "/opt/conda/envs/chatchat/lib/python3.8/site-packages/httpx/_client.py", line 126, in __iter__
    for chunk in self._stream:
  File "/opt/conda/envs/chatchat/lib/python3.8/site-packages/httpx/_transports/default.py", line 114, in __iter__
    yield part
  File "/opt/conda/envs/chatchat/lib/python3.8/contextlib.py", line 131, in __exit__
    self.gen.throw(type, value, traceback)
  File "/opt/conda/envs/chatchat/lib/python3.8/site-packages/httpx/_transports/default.py", line 86, in map_httpcore_exceptions
    raise mapped_exc(message) from exc
httpx.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)