-
Notifications
You must be signed in to change notification settings - Fork 22
Open
Labels
Description
Hitting this in new test after vllm v0.13.0 uplift... needs debug and fix or env-var workaround.
tests/integrations/vllm_plugin/sampling/test_sampling_params.py::test_logprobs 2026-02-13 21:07:04.289611: W torch_xla/csrc/runtime/pjrt_computation_client.cpp:703] Failed to deserialize executable: UNIMPLEMENTED: Deserializing serialized executable not supported.
2026-02-13 21:07:04.458756: W torch_xla/csrc/runtime/pjrt_computation_client.cpp:703] Failed to deserialize executable: UNIMPLEMENTED: Deserializing serialized executable not supported.
2026-02-13 21:07:04.554575: W torch_xla/csrc/runtime/pjrt_computation_client.cpp:703] Failed to deserialize executable: UNIMPLEMENTED: Deserializing serialized executable not supported.
(EngineCore_DP0 pid=51725) Exception in thread Thread-6 (process_output_sockets):
(EngineCore_DP0 pid=51725) Traceback (most recent call last):
(EngineCore_DP0 pid=51725) File "/usr/lib/python3.11/threading.py", line 1045, in _bootstrap_inner
(EngineCore_DP0 pid=51725) self.run()
(EngineCore_DP0 pid=51725) File "/usr/lib/python3.11/threading.py", line 982, in run
(EngineCore_DP0 pid=51725) self._target(*self._args, **self._kwargs)
(EngineCore_DP0 pid=51725) File "/localdev/kmabee/tt-xla/venv/lib/python3.11/site-packages/vllm/v1/engine/core.py", line 1126, in process_output_sockets
(EngineCore_DP0 pid=51725) buffers = encoder.encode_into(outputs, buffer)
(EngineCore_DP0 pid=51725) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(EngineCore_DP0 pid=51725) File "/localdev/kmabee/tt-xla/venv/lib/python3.11/site-packages/vllm/v1/serial_utils.py", line 152, in encode_into
(EngineCore_DP0 pid=51725) self.encoder.encode_into(obj, buf)
(EngineCore_DP0 pid=51725) File "/localdev/kmabee/tt-xla/venv/lib/python3.11/site-packages/vllm/v1/serial_utils.py", line 188, in enc_hook
(EngineCore_DP0 pid=51725) raise TypeError(
(EngineCore_DP0 pid=51725) TypeError: Object of type <class 'numpy.int64'> is not serializableSet VLLM_ALLOW_INSECURE_SERIALIZATION=1 to allow fallback to pickle-based serialization.
[TESTOUT test_logprobs] logprobs=None: time when there was a time wh... has_logprobs=False
FAILED
Reactions are currently unavailable