Skip to content

VLLM test_logprobs : TypeError: Object of type <class 'numpy.int64'> is not serializableSet #3310

@kmabeeTT

Description

@kmabeeTT

Hitting this in new test after vllm v0.13.0 uplift... needs debug and fix or env-var workaround.

tests/integrations/vllm_plugin/sampling/test_sampling_params.py::test_logprobs 2026-02-13 21:07:04.289611: W torch_xla/csrc/runtime/pjrt_computation_client.cpp:703] Failed to deserialize executable: UNIMPLEMENTED: Deserializing serialized executable not supported.
2026-02-13 21:07:04.458756: W torch_xla/csrc/runtime/pjrt_computation_client.cpp:703] Failed to deserialize executable: UNIMPLEMENTED: Deserializing serialized executable not supported.
2026-02-13 21:07:04.554575: W torch_xla/csrc/runtime/pjrt_computation_client.cpp:703] Failed to deserialize executable: UNIMPLEMENTED: Deserializing serialized executable not supported.
(EngineCore_DP0 pid=51725) Exception in thread Thread-6 (process_output_sockets):
(EngineCore_DP0 pid=51725) Traceback (most recent call last):
(EngineCore_DP0 pid=51725)   File "/usr/lib/python3.11/threading.py", line 1045, in _bootstrap_inner
(EngineCore_DP0 pid=51725)     self.run()
(EngineCore_DP0 pid=51725)   File "/usr/lib/python3.11/threading.py", line 982, in run
(EngineCore_DP0 pid=51725)     self._target(*self._args, **self._kwargs)
(EngineCore_DP0 pid=51725)   File "/localdev/kmabee/tt-xla/venv/lib/python3.11/site-packages/vllm/v1/engine/core.py", line 1126, in process_output_sockets
(EngineCore_DP0 pid=51725)     buffers = encoder.encode_into(outputs, buffer)
(EngineCore_DP0 pid=51725)               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(EngineCore_DP0 pid=51725)   File "/localdev/kmabee/tt-xla/venv/lib/python3.11/site-packages/vllm/v1/serial_utils.py", line 152, in encode_into
(EngineCore_DP0 pid=51725)     self.encoder.encode_into(obj, buf)
(EngineCore_DP0 pid=51725)   File "/localdev/kmabee/tt-xla/venv/lib/python3.11/site-packages/vllm/v1/serial_utils.py", line 188, in enc_hook
(EngineCore_DP0 pid=51725)     raise TypeError(
(EngineCore_DP0 pid=51725) TypeError: Object of type <class 'numpy.int64'> is not serializableSet VLLM_ALLOW_INSECURE_SERIALIZATION=1 to allow fallback to pickle-based serialization.
[TESTOUT test_logprobs] logprobs=None:  time when there was a time wh... has_logprobs=False
FAILED

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions